Aug 14 19:40:40 user nova-compute[72782]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 14 19:40:42 user nova-compute[72782]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72782) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 19:40:42 user nova-compute[72782]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72782) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 19:40:42 user nova-compute[72782]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72782) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 19:40:42 user nova-compute[72782]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 14 19:40:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:40:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:40:43 user nova-compute[72782]: INFO nova.virt.driver [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 14 19:40:43 user nova-compute[72782]: INFO nova.compute.provider_config [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] Acquiring lock "singleton_lock" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] Acquired lock "singleton_lock" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] Releasing lock "singleton_lock" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] Full set of CONF: {{(pid=72782) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ******************************************************************************** {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] Configuration options gathered from: {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ================================================================================ {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] allow_resize_to_same_host      = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] arq_binding_timeout            = 300 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] backdoor_port                  = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] backdoor_socket                = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] block_device_allocate_retries  = 300 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] block_device_allocate_retries_interval = 5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cert                           = self.pem {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] compute_monitors               = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] config_dir                     = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] config_drive_format            = iso9660 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] config_source                  = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] console_host                   = user {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] control_exchange               = nova {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cpu_allocation_ratio           = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] daemon                         = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] debug                          = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] default_access_ip_network_name = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] default_availability_zone      = nova {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] default_ephemeral_format       = ext4 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] default_schedule_zone          = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] disk_allocation_ratio          = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] enable_new_services            = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] enabled_ssl_apis               = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] flat_injected                  = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] force_config_drive             = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] force_raw_images               = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] graceful_shutdown_timeout      = 5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] heal_instance_info_cache_interval = 60 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] host                           = user {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] instance_build_timeout         = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] instance_delete_interval       = 300 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] instance_name_template         = instance-%08x {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] instance_usage_audit           = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] instance_usage_audit_period    = month {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] internal_service_availability_zone = internal {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] key                            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] live_migration_retry_count     = 30 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] log_config_append              = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] log_dir                        = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] log_file                       = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] log_options                    = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] log_rotate_interval            = 1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] log_rotate_interval_type       = days {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] log_rotation_type              = none {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] long_rpc_timeout               = 1800 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] max_concurrent_builds          = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] max_concurrent_live_migrations = 1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] max_concurrent_snapshots       = 5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] max_local_block_devices        = 3 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] max_logfile_count              = 30 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] max_logfile_size_mb            = 200 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] maximum_instance_delete_attempts = 5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] metadata_listen                = 0.0.0.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] metadata_listen_port           = 8775 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] metadata_workers               = 3 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] migrate_max_retries            = -1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] mkisofs_cmd                    = genisoimage {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] my_ip                          = 10.0.0.210 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] network_allocate_retries       = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] osapi_compute_listen_port      = 8774 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] osapi_compute_unique_server_name_scope =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] osapi_compute_workers          = 3 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] password_length                = 12 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] periodic_enable                = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] periodic_fuzzy_delay           = 60 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] pointer_model                  = ps2mouse {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] preallocate_images             = none {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] publish_errors                 = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] pybasedir                      = /opt/stack/nova {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ram_allocation_ratio           = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] rate_limit_burst               = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] rate_limit_except_level        = CRITICAL {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] rate_limit_interval            = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] reboot_timeout                 = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] reclaim_instance_interval      = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] record                         = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] reimage_timeout_per_gb         = 60 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] report_interval                = 120 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] rescue_timeout                 = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] reserved_host_cpus             = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] reserved_host_disk_mb          = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] reserved_host_memory_mb        = 512 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] reserved_huge_pages            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] resize_confirm_window          = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] resize_fs_using_block_device   = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] resume_guests_state_on_host_boot = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] rpc_response_timeout           = 60 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] run_external_periodic_tasks    = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] running_deleted_instance_action = reap {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] running_deleted_instance_timeout = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] scheduler_instance_sync_interval = 120 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] service_down_time              = 720 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] servicegroup_driver            = db {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] shelved_offload_time           = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] shelved_poll_interval          = 3600 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] shutdown_timeout               = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] source_is_ipv6                 = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ssl_only                       = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] state_path                     = /opt/stack/data/nova {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] sync_power_state_interval      = 600 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] sync_power_state_pool_size     = 1000 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] syslog_log_facility            = LOG_USER {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] tempdir                        = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] timeout_nbd                    = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] transport_url                  = **** {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] update_resources_interval      = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] use_cow_images                 = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] use_eventlog                   = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] use_journal                    = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] use_json                       = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] use_rootwrap_daemon            = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] use_stderr                     = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] use_syslog                     = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vcpu_pin_set                   = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vif_plugging_is_fatal          = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vif_plugging_timeout           = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] virt_mkfs                      = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] volume_usage_poll_interval     = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] watch_log_file                 = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] web                            = /usr/share/spice-html5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_concurrency.disable_process_locking = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.auth_strategy              = keystone {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.compute_link_prefix        = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.dhcp_domain                = novalocal {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.enable_instance_password   = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.glance_link_prefix         = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.instance_list_per_project_cells = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.list_records_by_skipping_down_cells = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.local_metadata_per_cell    = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.max_limit                  = 1000 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.metadata_cache_expiration  = 15 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.neutron_default_tenant_id  = default {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.use_forwarded_for          = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.use_neutron_default_nets   = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.vendordata_dynamic_targets = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.vendordata_jsonfile_path   = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.backend_argument         = **** {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.config_prefix            = cache.oslo {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.dead_timeout             = 60.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.debug_cache_backend      = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.enable_retry_client      = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.enable_socket_keepalive  = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.enabled                  = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.expiration_time          = 600 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.hashclient_retry_attempts = 2 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.memcache_dead_retry      = 300 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.memcache_password        =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.memcache_sasl_enabled    = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.memcache_username        =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.proxies                  = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.retry_attempts           = 2 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.retry_delay              = 0.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.socket_keepalive_count   = 1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.socket_keepalive_idle    = 1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.socket_keepalive_interval = 1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.tls_allowed_ciphers      = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.tls_cafile               = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.tls_certfile             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.tls_enabled              = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cache.tls_keyfile              = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cinder.auth_section            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cinder.auth_type               = password {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cinder.cafile                  = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cinder.certfile                = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cinder.collect_timing          = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cinder.cross_az_attach         = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cinder.debug                   = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cinder.endpoint_template       = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cinder.http_retries            = 3 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cinder.insecure                = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cinder.keyfile                 = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cinder.os_region_name          = RegionOne {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cinder.split_loggers           = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cinder.timeout                 = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] compute.cpu_dedicated_set      = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] compute.cpu_shared_set         = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] compute.image_type_exclude_list = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] compute.resource_provider_association_refresh = 300 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] compute.shutdown_retry_interval = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] conductor.workers              = 3 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] console.allowed_origins        = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] console.ssl_ciphers            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] console.ssl_minimum_version    = default {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] consoleauth.token_ttl          = 600 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.cafile                  = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.certfile                = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.collect_timing          = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.connect_retries         = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.connect_retry_delay     = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.endpoint_override       = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.insecure                = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.keyfile                 = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.max_version             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.min_version             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.region_name             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.service_name            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.service_type            = accelerator {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.split_loggers           = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.status_code_retries     = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.status_code_retry_delay = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.timeout                 = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] cyborg.version                 = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.backend               = sqlalchemy {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.connection            = **** {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.connection_debug      = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.connection_parameters =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.connection_recycle_time = 3600 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.connection_trace      = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.db_inc_retry_interval = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.db_max_retries        = 20 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.db_max_retry_interval = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.db_retry_interval     = 1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.max_overflow          = 50 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.max_pool_size         = 5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.max_retries           = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.mysql_enable_ndb      = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.mysql_wsrep_sync_wait = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.pool_timeout          = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.retry_interval        = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.slave_connection      = **** {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] database.sqlite_synchronous    = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.backend           = sqlalchemy {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.connection        = **** {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.connection_debug  = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.connection_parameters =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.connection_recycle_time = 3600 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.connection_trace  = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.db_inc_retry_interval = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.db_max_retries    = 20 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.db_max_retry_interval = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.db_retry_interval = 1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.max_overflow      = 50 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.max_pool_size     = 5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.max_retries       = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.mysql_enable_ndb  = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.pool_timeout      = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.retry_interval    = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.slave_connection  = **** {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] api_database.sqlite_synchronous = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] devices.enabled_mdev_types     = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ephemeral_storage_encryption.enabled = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.api_servers             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.cafile                  = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.certfile                = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.collect_timing          = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.connect_retries         = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.connect_retry_delay     = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.debug                   = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.default_trusted_certificate_ids = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.enable_certificate_validation = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.enable_rbd_download     = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.endpoint_override       = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.insecure                = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.keyfile                 = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.max_version             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.min_version             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.num_retries             = 3 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.rbd_ceph_conf           =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.rbd_connect_timeout     = 5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.rbd_pool                =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.rbd_user                =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.region_name             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.service_name            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.service_type            = image {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.split_loggers           = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.status_code_retries     = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.status_code_retry_delay = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.timeout                 = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.verify_glance_signatures = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] glance.version                 = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] guestfs.debug                  = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] hyperv.config_drive_cdrom      = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] hyperv.config_drive_inject_password = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] hyperv.enable_remotefx         = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] hyperv.instances_path_share    =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] hyperv.limit_cpu_features      = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] hyperv.use_multipath_io        = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] hyperv.vswitch_name            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] mks.enabled                    = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] image_cache.manager_interval   = 2400 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] image_cache.precache_concurrency = 1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] image_cache.remove_unused_base_images = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] image_cache.subdirectory_name  = _base {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.api_max_retries         = 60 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.api_retry_interval      = 2 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.auth_section            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.auth_type               = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.cafile                  = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.certfile                = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.collect_timing          = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.connect_retries         = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.connect_retry_delay     = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.endpoint_override       = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.insecure                = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.keyfile                 = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.max_version             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.min_version             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.partition_key           = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.peer_list               = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.region_name             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.serial_console_state_timeout = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.service_name            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.service_type            = baremetal {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.split_loggers           = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.status_code_retries     = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.status_code_retry_delay = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.timeout                 = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ironic.version                 = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] key_manager.fixed_key          = **** {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican.barbican_api_version  = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican.barbican_endpoint     = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican.barbican_endpoint_type = public {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican.barbican_region_name  = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican.cafile                = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican.certfile              = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican.collect_timing        = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican.insecure              = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican.keyfile               = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican.number_of_retries     = 60 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican.retry_delay           = 1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican.send_service_user_token = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican.split_loggers         = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican.timeout               = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican.verify_ssl            = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican.verify_ssl_path       = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican_service_user.auth_section = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican_service_user.auth_type = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican_service_user.cafile   = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican_service_user.certfile = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican_service_user.collect_timing = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican_service_user.insecure = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican_service_user.keyfile  = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican_service_user.split_loggers = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] barbican_service_user.timeout  = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vault.approle_role_id          = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vault.approle_secret_id        = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vault.cafile                   = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vault.certfile                 = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vault.collect_timing           = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vault.insecure                 = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vault.keyfile                  = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vault.kv_mountpoint            = secret {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vault.kv_version               = 2 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vault.namespace                = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vault.root_token_id            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vault.split_loggers            = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vault.ssl_ca_crt_file          = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vault.timeout                  = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vault.use_ssl                  = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.cafile                = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.certfile              = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.collect_timing        = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.connect_retries       = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.connect_retry_delay   = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.endpoint_override     = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.insecure              = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.keyfile               = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.max_version           = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.min_version           = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.region_name           = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.service_name          = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.service_type          = identity {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.split_loggers         = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.status_code_retries   = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.status_code_retry_delay = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.timeout               = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] keystone.version               = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.connection_uri         =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.cpu_mode               = custom {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: WARNING oslo_config.cfg [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.cpu_power_governor_high = performance {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.cpu_power_management   = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.device_detach_attempts = 8 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.device_detach_timeout  = 20 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.disk_cachemodes        = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.disk_prefix            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.enabled_perf_events    = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.file_backed_memory     = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.gid_maps               = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.hw_disk_discard        = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.hw_machine_type        = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.images_rbd_pool        = rbd {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.images_type            = default {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.images_volume_group    = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.inject_key             = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.inject_partition       = -2 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.inject_password        = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.iscsi_iface            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.iser_use_multipath     = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.live_migration_downtime = 500 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.live_migration_inbound_addr = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.live_migration_scheme  = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.live_migration_timeout_action = abort {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.live_migration_tunnelled = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: WARNING oslo_config.cfg [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 14 19:40:43 user nova-compute[72782]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 14 19:40:43 user nova-compute[72782]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 14 19:40:43 user nova-compute[72782]: and ``live_migration_inbound_addr`` respectively.
Aug 14 19:40:43 user nova-compute[72782]: ).  Its value may be silently ignored in the future.
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.live_migration_with_native_tls = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.max_queues             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.nfs_mount_options      = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.num_pcie_ports         = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.pmem_namespaces        = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.quobyte_client_cfg     = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.rbd_secret_uuid        = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.rbd_user               = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.rescue_image_id        = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.rescue_kernel_id       = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.rx_queue_size          = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.smbfs_mount_options    =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.snapshot_compression   = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.snapshot_image_format  = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.sparse_logical_volumes = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.swtpm_enabled          = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.swtpm_group            = tss {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.swtpm_user             = tss {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.sysinfo_serial         = unique {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.tb_cache_size          = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.tx_queue_size          = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.uid_maps               = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.use_virtio_for_bridges = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.virt_type              = kvm {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.volume_clear           = zero {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.volume_clear_size      = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.volume_use_multipath   = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.vzstorage_cache_path   = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.auth_section           = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.auth_type              = password {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.cafile                 = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.certfile               = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.collect_timing         = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.connect_retries        = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.connect_retry_delay    = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.default_floating_pool  = public {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.endpoint_override      = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.extension_sync_interval = 600 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.http_retries           = 3 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.insecure               = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.keyfile                = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.max_version            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.min_version            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.ovs_bridge             = br-int {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.physnets               = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.region_name            = RegionOne {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.service_metadata_proxy = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.service_name           = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.service_type           = network {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.split_loggers          = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.status_code_retries    = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.status_code_retry_delay = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.timeout                = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] neutron.version                = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] notifications.bdms_in_notifications = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] notifications.default_level    = INFO {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] notifications.notification_format = unversioned {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] notifications.notify_on_state_change = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] pci.alias                      = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] pci.device_spec                = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] pci.report_in_placement        = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.auth_section         = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.auth_type            = password {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.cafile               = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.certfile             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.collect_timing       = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.connect_retries      = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.connect_retry_delay  = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.default_domain_id    = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.default_domain_name  = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.domain_id            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.domain_name          = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.endpoint_override    = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.insecure             = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.keyfile              = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.max_version          = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.min_version          = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.password             = **** {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.project_domain_id    = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.project_domain_name  = Default {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.project_id           = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.project_name         = service {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.region_name          = RegionOne {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.service_name         = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.service_type         = placement {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.split_loggers        = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.status_code_retries  = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.status_code_retry_delay = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.system_scope         = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.timeout              = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.trust_id             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.user_domain_id       = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.user_domain_name     = Default {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.user_id              = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.username             = placement {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] placement.version              = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] quota.cores                    = 20 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] quota.count_usage_from_placement = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] quota.injected_file_content_bytes = 10240 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] quota.injected_file_path_length = 255 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] quota.injected_files           = 5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] quota.instances                = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] quota.key_pairs                = 100 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] quota.metadata_items           = 128 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] quota.ram                      = 51200 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] quota.recheck_quota            = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] quota.server_group_members     = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] quota.server_groups            = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] rdp.enabled                    = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] scheduler.image_metadata_prefilter = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] scheduler.max_attempts         = 3 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] scheduler.max_placement_results = 1000 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] scheduler.workers              = 3 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.host_subset_size = 1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.isolated_hosts = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.isolated_images = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.pci_in_placement = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.track_instance_changes = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] metrics.required               = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] metrics.weight_multiplier      = 1.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] metrics.weight_setting         = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] serial_console.enabled         = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] serial_console.port_range      = 10000:20000 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] serial_console.serialproxy_port = 6083 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] service_user.auth_section      = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] service_user.auth_type         = password {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] service_user.cafile            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] service_user.certfile          = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] service_user.collect_timing    = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] service_user.insecure          = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] service_user.keyfile           = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] service_user.send_service_user_token = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] service_user.split_loggers     = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] service_user.timeout           = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] spice.agent_enabled            = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] spice.enabled                  = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] spice.html5proxy_port          = 6082 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] spice.image_compression        = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] spice.jpeg_compression         = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] spice.playback_compression     = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] spice.server_listen            = 127.0.0.1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] spice.streaming_mode           = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] spice.zlib_compression         = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] upgrade_levels.baseapi         = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] upgrade_levels.cert            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] upgrade_levels.compute         = auto {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] upgrade_levels.conductor       = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] upgrade_levels.scheduler       = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vendordata_dynamic_auth.cafile = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vendordata_dynamic_auth.certfile = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vendordata_dynamic_auth.insecure = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vendordata_dynamic_auth.timeout = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.api_retry_count         = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.ca_file                 = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.cache_prefix            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.cluster_name            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.connection_pool_size    = 10 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.console_delay_seconds   = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.datastore_regex         = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.host_ip                 = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.host_password           = **** {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.host_port               = 443 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.host_username           = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.insecure                = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.integration_bridge      = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.maximum_objects         = 100 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.pbm_default_policy      = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.pbm_enabled             = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.pbm_wsdl_location       = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.serial_port_proxy_uri   = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.serial_port_service_uri = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.task_poll_interval      = 0.5 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.use_linked_clone        = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.vnc_keymap              = en-us {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.vnc_port                = 5900 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vmware.vnc_port_total          = 10000 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vnc.auth_schemes               = ['none'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vnc.enabled                    = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vnc.novncproxy_port            = 6080 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vnc.vencrypt_ca_certs          = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vnc.vencrypt_client_cert       = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vnc.vencrypt_client_key        = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.disable_rootwrap   = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.enable_numa_live_migration = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.libvirt_disable_apic = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] wsgi.client_socket_timeout     = 900 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] wsgi.default_pool_size         = 1000 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] wsgi.keep_alive                = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] wsgi.max_header_line           = 16384 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] wsgi.ssl_ca_file               = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] wsgi.ssl_cert_file             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] wsgi.ssl_key_file              = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] wsgi.tcp_keepidle              = 600 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] zvm.ca_file                    = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] zvm.cloud_connector_url        = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] zvm.reachable_timeout          = 300 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_policy.enforce_new_defaults = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_policy.enforce_scope      = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_policy.policy_default_rule = default {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] profiler.connection_string     = messaging:// {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] profiler.enabled               = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] profiler.es_doc_type           = notification {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] profiler.es_scroll_size        = 10000 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] profiler.es_scroll_time        = 2m {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] profiler.filter_error_trace    = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] profiler.hmac_keys             = **** {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] profiler.sentinel_service_name = mymaster {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] profiler.socket_timeout        = 0.1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] profiler.trace_requests        = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] profiler.trace_sqlalchemy      = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] profiler_jaeger.process_tags   = {} {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] profiler_jaeger.service_name_prefix = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] profiler_otlp.service_name_prefix = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] remote_debug.host              = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] remote_debug.port              = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_notifications.retry = -1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.auth_section        = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.auth_type           = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.cafile              = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.certfile            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.collect_timing      = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.connect_retries     = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.connect_retry_delay = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.endpoint_id         = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.endpoint_override   = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.insecure            = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.keyfile             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.max_version         = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.min_version         = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.region_name         = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.service_name        = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.service_type        = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.split_loggers       = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.status_code_retries = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.status_code_retry_delay = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.timeout             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.valid_interfaces    = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_limit.version             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_reports.file_event_handler = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] oslo_reports.log_dir           = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vif_plug_ovs_privileged.group  = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] vif_plug_ovs_privileged.user   = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] os_vif_ovs.isolate_vif         = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] os_brick.lock_path             = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] privsep_osbrick.capabilities   = [21] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] privsep_osbrick.group          = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] privsep_osbrick.helper_command = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] privsep_osbrick.user           = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] nova_sys_admin.group           = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] nova_sys_admin.helper_command  = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] nova_sys_admin.user            = None {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG oslo_service.service [None req-b7317c27-100f-48a1-b6aa-97d3769d3c17 None None] ******************************************************************************** {{(pid=72782) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 14 19:40:43 user nova-compute[72782]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 14 19:40:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Starting native event thread {{(pid=72782) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Starting green dispatch thread {{(pid=72782) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Starting connection event dispatch thread {{(pid=72782) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Connecting to libvirt: qemu:///system {{(pid=72782) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f6410ee8d60> {{(pid=72782) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 14 19:40:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f6410ee8d60> {{(pid=72782) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 14 19:40:43 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Connection event '1' reason 'None'
Aug 14 19:40:43 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 14 19:40:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.mount [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Initialising _HostMountState generation 0 {{(pid=72782) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 14 19:40:51 user nova-compute[72782]: INFO nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Libvirt host capabilities <capabilities>
Aug 14 19:40:51 user nova-compute[72782]:   <host>
Aug 14 19:40:51 user nova-compute[72782]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 14 19:40:51 user nova-compute[72782]:     <cpu>
Aug 14 19:40:51 user nova-compute[72782]:       <arch>x86_64</arch>
Aug 14 19:40:51 user nova-compute[72782]:       <model>IvyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <vendor>Intel</vendor>
Aug 14 19:40:51 user nova-compute[72782]:       <microcode version='1070'/>
Aug 14 19:40:51 user nova-compute[72782]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 14 19:40:51 user nova-compute[72782]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature name='ss'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature name='vmx'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature name='pcid'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature name='osxsave'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature name='hypervisor'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature name='arat'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature name='tsc_adjust'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature name='md-clear'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature name='stibp'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature name='arch-capabilities'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature name='ssbd'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature name='invtsc'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature name='rsba'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature name='skip-l1dfl-vmentry'/>
Aug 14 19:40:51 user nova-compute[72782]:       <pages unit='KiB' size='4'/>
Aug 14 19:40:51 user nova-compute[72782]:       <pages unit='KiB' size='2048'/>
Aug 14 19:40:51 user nova-compute[72782]:     </cpu>
Aug 14 19:40:51 user nova-compute[72782]:     <power_management>
Aug 14 19:40:51 user nova-compute[72782]:       <suspend_mem/>
Aug 14 19:40:51 user nova-compute[72782]:       <suspend_disk/>
Aug 14 19:40:51 user nova-compute[72782]:       <suspend_hybrid/>
Aug 14 19:40:51 user nova-compute[72782]:     </power_management>
Aug 14 19:40:51 user nova-compute[72782]:     <iommu support='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     <migration_features>
Aug 14 19:40:51 user nova-compute[72782]:       <live/>
Aug 14 19:40:51 user nova-compute[72782]:       <uri_transports>
Aug 14 19:40:51 user nova-compute[72782]:         <uri_transport>tcp</uri_transport>
Aug 14 19:40:51 user nova-compute[72782]:         <uri_transport>rdma</uri_transport>
Aug 14 19:40:51 user nova-compute[72782]:       </uri_transports>
Aug 14 19:40:51 user nova-compute[72782]:     </migration_features>
Aug 14 19:40:51 user nova-compute[72782]:     <topology>
Aug 14 19:40:51 user nova-compute[72782]:       <cells num='2'>
Aug 14 19:40:51 user nova-compute[72782]:         <cell id='0'>
Aug 14 19:40:51 user nova-compute[72782]:           <memory unit='KiB'>8189224</memory>
Aug 14 19:40:51 user nova-compute[72782]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 14 19:40:51 user nova-compute[72782]:           <pages unit='KiB' size='2048'>0</pages>
Aug 14 19:40:51 user nova-compute[72782]:           <distances>
Aug 14 19:40:51 user nova-compute[72782]:             <sibling id='0' value='10'/>
Aug 14 19:40:51 user nova-compute[72782]:             <sibling id='1' value='20'/>
Aug 14 19:40:51 user nova-compute[72782]:           </distances>
Aug 14 19:40:51 user nova-compute[72782]:           <cpus num='6'>
Aug 14 19:40:51 user nova-compute[72782]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 14 19:40:51 user nova-compute[72782]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 14 19:40:51 user nova-compute[72782]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 14 19:40:51 user nova-compute[72782]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 14 19:40:51 user nova-compute[72782]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 14 19:40:51 user nova-compute[72782]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 14 19:40:51 user nova-compute[72782]:           </cpus>
Aug 14 19:40:51 user nova-compute[72782]:         </cell>
Aug 14 19:40:51 user nova-compute[72782]:         <cell id='1'>
Aug 14 19:40:51 user nova-compute[72782]:           <memory unit='KiB'>8206460</memory>
Aug 14 19:40:51 user nova-compute[72782]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 14 19:40:51 user nova-compute[72782]:           <pages unit='KiB' size='2048'>0</pages>
Aug 14 19:40:51 user nova-compute[72782]:           <distances>
Aug 14 19:40:51 user nova-compute[72782]:             <sibling id='0' value='20'/>
Aug 14 19:40:51 user nova-compute[72782]:             <sibling id='1' value='10'/>
Aug 14 19:40:51 user nova-compute[72782]:           </distances>
Aug 14 19:40:51 user nova-compute[72782]:           <cpus num='6'>
Aug 14 19:40:51 user nova-compute[72782]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 14 19:40:51 user nova-compute[72782]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 14 19:40:51 user nova-compute[72782]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 14 19:40:51 user nova-compute[72782]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 14 19:40:51 user nova-compute[72782]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 14 19:40:51 user nova-compute[72782]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 14 19:40:51 user nova-compute[72782]:           </cpus>
Aug 14 19:40:51 user nova-compute[72782]:         </cell>
Aug 14 19:40:51 user nova-compute[72782]:       </cells>
Aug 14 19:40:51 user nova-compute[72782]:     </topology>
Aug 14 19:40:51 user nova-compute[72782]:     <cache>
Aug 14 19:40:51 user nova-compute[72782]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 14 19:40:51 user nova-compute[72782]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 14 19:40:51 user nova-compute[72782]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 14 19:40:51 user nova-compute[72782]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 14 19:40:51 user nova-compute[72782]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 14 19:40:51 user nova-compute[72782]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 14 19:40:51 user nova-compute[72782]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 14 19:40:51 user nova-compute[72782]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 14 19:40:51 user nova-compute[72782]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 14 19:40:51 user nova-compute[72782]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 14 19:40:51 user nova-compute[72782]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 14 19:40:51 user nova-compute[72782]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 14 19:40:51 user nova-compute[72782]:     </cache>
Aug 14 19:40:51 user nova-compute[72782]:     <secmodel>
Aug 14 19:40:51 user nova-compute[72782]:       <model>apparmor</model>
Aug 14 19:40:51 user nova-compute[72782]:       <doi>0</doi>
Aug 14 19:40:51 user nova-compute[72782]:     </secmodel>
Aug 14 19:40:51 user nova-compute[72782]:     <secmodel>
Aug 14 19:40:51 user nova-compute[72782]:       <model>dac</model>
Aug 14 19:40:51 user nova-compute[72782]:       <doi>0</doi>
Aug 14 19:40:51 user nova-compute[72782]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 14 19:40:51 user nova-compute[72782]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 14 19:40:51 user nova-compute[72782]:     </secmodel>
Aug 14 19:40:51 user nova-compute[72782]:   </host>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='alpha'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>64</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>clipper</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='armv6l'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>32</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>spitz</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>nuri</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>kzm</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>sx1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>z2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>tosa</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>n810</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>n800</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>terrier</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>midway</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>microbit</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>verdex</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>highbank</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>akita</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>connex</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>collie</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='armv7l'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>32</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>spitz</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>nuri</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>kzm</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>sx1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>z2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>tosa</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>n810</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>n800</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>terrier</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>midway</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>microbit</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>verdex</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>highbank</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>akita</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>connex</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>collie</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='aarch64'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>64</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>spitz</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>nuri</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>kzm</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>sx1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>z2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>tosa</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>n810</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>n800</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>terrier</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>midway</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>microbit</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>verdex</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>raspi3b</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>highbank</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>akita</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>connex</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>collie</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <acpi default='on' toggle='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='cris'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>32</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='i686'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>32</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>x-remote</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>isapc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>microvm</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='kvm'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <pae/>
Aug 14 19:40:51 user nova-compute[72782]:       <nonpae/>
Aug 14 19:40:51 user nova-compute[72782]:       <acpi default='on' toggle='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:       <apic default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='m68k'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>32</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>an5206</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>q800</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>next-cube</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='microblaze'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>32</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='microblazeel'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>32</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='mips'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>32</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='16'>malta</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='mipsel'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>32</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='16'>malta</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='mips64'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>64</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='16'>malta</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>pica61</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>magnum</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='mips64el'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>64</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='16'>malta</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>pica61</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>magnum</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='16'>boston</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='ppc'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>32</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mac99</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>40p</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>taihu</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='ppc64'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>64</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2048'>powernv9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>taihu</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2048'>powernv10</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>40p</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mac99</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2048'>powernv8</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='ppc64le'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>64</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2048'>powernv9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>taihu</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2048'>powernv10</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>40p</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>mac99</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2048'>powernv8</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='riscv32'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>32</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='8'>spike</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>opentitan</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='5'>sifive_u</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>sifive_e</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='8'>virt</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='riscv64'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>64</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='8'>spike</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='5'>sifive_u</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>shakti_c</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>sifive_e</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='8'>virt</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='s390x'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>64</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='sh4'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>32</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>shix</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>r2d</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='sh4eb'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>64</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>shix</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>r2d</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='sparc'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>32</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>SS-5</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>SS-20</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>LX</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>SS-4</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>SS-10</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>Voyager</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='sparc64'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>64</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>sun4u</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>niagara</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>sun4v</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='x86_64'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>64</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>x-remote</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='1'>isapc</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>microvm</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='kvm'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <acpi default='on' toggle='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:       <apic default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='xtensa'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>32</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>sim</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>kc705</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>ml605</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>virt</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>lx200</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>lx60</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]:   <guest>
Aug 14 19:40:51 user nova-compute[72782]:     <os_type>hvm</os_type>
Aug 14 19:40:51 user nova-compute[72782]:     <arch name='xtensaeb'>
Aug 14 19:40:51 user nova-compute[72782]:       <wordsize>32</wordsize>
Aug 14 19:40:51 user nova-compute[72782]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='4'>sim</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>kc705</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>ml605</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>virt</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>lx200</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>lx60</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 14 19:40:51 user nova-compute[72782]:       <domain type='qemu'/>
Aug 14 19:40:51 user nova-compute[72782]:     </arch>
Aug 14 19:40:51 user nova-compute[72782]:     <features>
Aug 14 19:40:51 user nova-compute[72782]:       <cpuselection/>
Aug 14 19:40:51 user nova-compute[72782]:       <deviceboot/>
Aug 14 19:40:51 user nova-compute[72782]:       <disksnapshot default='on' toggle='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     </features>
Aug 14 19:40:51 user nova-compute[72782]:   </guest>
Aug 14 19:40:51 user nova-compute[72782]: </capabilities>
Aug 14 19:40:51 user nova-compute[72782]: 
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 14 19:40:51 user nova-compute[72782]: <domainCapabilities>
Aug 14 19:40:51 user nova-compute[72782]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 19:40:51 user nova-compute[72782]:   <domain>kvm</domain>
Aug 14 19:40:51 user nova-compute[72782]:   <machine>pc-q35-6.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:   <arch>i686</arch>
Aug 14 19:40:51 user nova-compute[72782]:   <vcpu max='288'/>
Aug 14 19:40:51 user nova-compute[72782]:   <iothreads supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:   <os supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:     <enum name='firmware'/>
Aug 14 19:40:51 user nova-compute[72782]:     <loader supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='type'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>rom</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>pflash</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='readonly'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>yes</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>no</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='secure'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>no</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </loader>
Aug 14 19:40:51 user nova-compute[72782]:   </os>
Aug 14 19:40:51 user nova-compute[72782]:   <cpu>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='host-passthrough' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='hostPassthroughMigratable'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>off</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='maximum' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='maximumMigratable'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>on</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>off</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='host-model' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <vendor>Intel</vendor>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ss'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='vmx'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='pcid'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='hypervisor'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='arat'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='umip'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='md-clear'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='stibp'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ssbd'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ibpb'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ibrs'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='amd-stibp'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='erms'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='lm'/>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='custom' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>qemu64</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>qemu32</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>phenom</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium3</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium2</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>n270</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>kvm64</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>kvm32</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>coreduo</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>core2duo</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>athlon</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Westmere</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Snowridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>SandyBridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Penryn</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G5</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G4</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G3</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G2</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G1</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Nehalem</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>IvyBridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Icelake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-Rome</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-Milan</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Dhyana</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cooperlake</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Conroe</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>486</model>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:   </cpu>
Aug 14 19:40:51 user nova-compute[72782]:   <memoryBacking supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:     <enum name='sourceType'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>file</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>anonymous</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>memfd</value>
Aug 14 19:40:51 user nova-compute[72782]:     </enum>
Aug 14 19:40:51 user nova-compute[72782]:   </memoryBacking>
Aug 14 19:40:51 user nova-compute[72782]:   <devices>
Aug 14 19:40:51 user nova-compute[72782]:     <disk supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='diskDevice'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>disk</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>cdrom</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>floppy</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>lun</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='bus'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>fdc</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>scsi</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>usb</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>sata</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-non-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </disk>
Aug 14 19:40:51 user nova-compute[72782]:     <graphics supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='type'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>sdl</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vnc</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>spice</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>egl-headless</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </graphics>
Aug 14 19:40:51 user nova-compute[72782]:     <video supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='modelType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vga</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>cirrus</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vmvga</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>qxl</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>none</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>bochs</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>ramfb</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </video>
Aug 14 19:40:51 user nova-compute[72782]:     <hostdev supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='mode'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>subsystem</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='startupPolicy'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>default</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>mandatory</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>requisite</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>optional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='subsysType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>usb</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>pci</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>scsi</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='capsType'/>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='pciBackend'/>
Aug 14 19:40:51 user nova-compute[72782]:     </hostdev>
Aug 14 19:40:51 user nova-compute[72782]:     <rng supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-non-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='backendModel'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>random</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>egd</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>builtin</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </rng>
Aug 14 19:40:51 user nova-compute[72782]:     <filesystem supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='driverType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>path</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>handle</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtiofs</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </filesystem>
Aug 14 19:40:51 user nova-compute[72782]:     <tpm supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>tpm-tis</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>tpm-crb</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='backendModel'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>passthrough</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>emulator</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </tpm>
Aug 14 19:40:51 user nova-compute[72782]:   </devices>
Aug 14 19:40:51 user nova-compute[72782]:   <features>
Aug 14 19:40:51 user nova-compute[72782]:     <gic supported='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     <vmcoreinfo supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <genid supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <backingStoreInput supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <backup supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <sev supported='no'/>
Aug 14 19:40:51 user nova-compute[72782]:   </features>
Aug 14 19:40:51 user nova-compute[72782]: </domainCapabilities>
Aug 14 19:40:51 user nova-compute[72782]:  {{(pid=72782) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 14 19:40:51 user nova-compute[72782]: <domainCapabilities>
Aug 14 19:40:51 user nova-compute[72782]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 19:40:51 user nova-compute[72782]:   <domain>kvm</domain>
Aug 14 19:40:51 user nova-compute[72782]:   <machine>pc-q35-jammy</machine>
Aug 14 19:40:51 user nova-compute[72782]:   <arch>i686</arch>
Aug 14 19:40:51 user nova-compute[72782]:   <vcpu max='288'/>
Aug 14 19:40:51 user nova-compute[72782]:   <iothreads supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:   <os supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:     <enum name='firmware'/>
Aug 14 19:40:51 user nova-compute[72782]:     <loader supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='type'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>rom</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>pflash</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='readonly'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>yes</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>no</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='secure'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>no</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </loader>
Aug 14 19:40:51 user nova-compute[72782]:   </os>
Aug 14 19:40:51 user nova-compute[72782]:   <cpu>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='host-passthrough' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='hostPassthroughMigratable'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>off</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='maximum' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='maximumMigratable'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>on</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>off</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='host-model' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <vendor>Intel</vendor>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ss'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='vmx'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='pcid'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='hypervisor'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='arat'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='umip'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='md-clear'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='stibp'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ssbd'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ibpb'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ibrs'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='amd-stibp'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='erms'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='lm'/>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='custom' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>qemu64</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>qemu32</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>phenom</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium3</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium2</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>n270</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>kvm64</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>kvm32</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>coreduo</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>core2duo</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>athlon</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Westmere</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Snowridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>SandyBridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Penryn</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G5</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G4</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G3</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G2</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G1</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Nehalem</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>IvyBridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Icelake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-Rome</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-Milan</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Dhyana</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cooperlake</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Conroe</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>486</model>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:   </cpu>
Aug 14 19:40:51 user nova-compute[72782]:   <memoryBacking supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:     <enum name='sourceType'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>file</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>anonymous</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>memfd</value>
Aug 14 19:40:51 user nova-compute[72782]:     </enum>
Aug 14 19:40:51 user nova-compute[72782]:   </memoryBacking>
Aug 14 19:40:51 user nova-compute[72782]:   <devices>
Aug 14 19:40:51 user nova-compute[72782]:     <disk supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='diskDevice'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>disk</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>cdrom</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>floppy</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>lun</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='bus'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>fdc</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>scsi</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>usb</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>sata</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-non-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </disk>
Aug 14 19:40:51 user nova-compute[72782]:     <graphics supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='type'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>sdl</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vnc</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>spice</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>egl-headless</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </graphics>
Aug 14 19:40:51 user nova-compute[72782]:     <video supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='modelType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vga</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>cirrus</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vmvga</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>qxl</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>none</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>bochs</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>ramfb</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </video>
Aug 14 19:40:51 user nova-compute[72782]:     <hostdev supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='mode'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>subsystem</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='startupPolicy'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>default</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>mandatory</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>requisite</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>optional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='subsysType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>usb</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>pci</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>scsi</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='capsType'/>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='pciBackend'/>
Aug 14 19:40:51 user nova-compute[72782]:     </hostdev>
Aug 14 19:40:51 user nova-compute[72782]:     <rng supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-non-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='backendModel'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>random</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>egd</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>builtin</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </rng>
Aug 14 19:40:51 user nova-compute[72782]:     <filesystem supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='driverType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>path</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>handle</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtiofs</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </filesystem>
Aug 14 19:40:51 user nova-compute[72782]:     <tpm supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>tpm-tis</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>tpm-crb</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='backendModel'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>passthrough</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>emulator</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </tpm>
Aug 14 19:40:51 user nova-compute[72782]:   </devices>
Aug 14 19:40:51 user nova-compute[72782]:   <features>
Aug 14 19:40:51 user nova-compute[72782]:     <gic supported='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     <vmcoreinfo supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <genid supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <backingStoreInput supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <backup supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <sev supported='no'/>
Aug 14 19:40:51 user nova-compute[72782]:   </features>
Aug 14 19:40:51 user nova-compute[72782]: </domainCapabilities>
Aug 14 19:40:51 user nova-compute[72782]:  {{(pid=72782) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 14 19:40:51 user nova-compute[72782]: <domainCapabilities>
Aug 14 19:40:51 user nova-compute[72782]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 19:40:51 user nova-compute[72782]:   <domain>kvm</domain>
Aug 14 19:40:51 user nova-compute[72782]:   <machine>pc-i440fx-6.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:   <arch>i686</arch>
Aug 14 19:40:51 user nova-compute[72782]:   <vcpu max='255'/>
Aug 14 19:40:51 user nova-compute[72782]:   <iothreads supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:   <os supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:     <enum name='firmware'/>
Aug 14 19:40:51 user nova-compute[72782]:     <loader supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='type'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>rom</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>pflash</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='readonly'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>yes</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>no</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='secure'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>no</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </loader>
Aug 14 19:40:51 user nova-compute[72782]:   </os>
Aug 14 19:40:51 user nova-compute[72782]:   <cpu>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='host-passthrough' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='hostPassthroughMigratable'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>off</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='maximum' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='maximumMigratable'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>on</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>off</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='host-model' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <vendor>Intel</vendor>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ss'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='vmx'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='pcid'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='hypervisor'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='arat'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='umip'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='md-clear'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='stibp'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ssbd'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ibpb'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ibrs'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='amd-stibp'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='erms'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='lm'/>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='custom' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>qemu64</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>qemu32</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>phenom</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium3</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium2</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>n270</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>kvm64</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>kvm32</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>coreduo</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>core2duo</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>athlon</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Westmere</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Snowridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>SandyBridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Penryn</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G5</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G4</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G3</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G2</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G1</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Nehalem</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>IvyBridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Icelake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-Rome</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-Milan</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Dhyana</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cooperlake</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Conroe</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>486</model>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:   </cpu>
Aug 14 19:40:51 user nova-compute[72782]:   <memoryBacking supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:     <enum name='sourceType'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>file</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>anonymous</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>memfd</value>
Aug 14 19:40:51 user nova-compute[72782]:     </enum>
Aug 14 19:40:51 user nova-compute[72782]:   </memoryBacking>
Aug 14 19:40:51 user nova-compute[72782]:   <devices>
Aug 14 19:40:51 user nova-compute[72782]:     <disk supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='diskDevice'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>disk</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>cdrom</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>floppy</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>lun</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='bus'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>ide</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>fdc</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>scsi</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>usb</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>sata</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-non-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </disk>
Aug 14 19:40:51 user nova-compute[72782]:     <graphics supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='type'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>sdl</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vnc</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>spice</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>egl-headless</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </graphics>
Aug 14 19:40:51 user nova-compute[72782]:     <video supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='modelType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vga</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>cirrus</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vmvga</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>qxl</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>none</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>bochs</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>ramfb</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </video>
Aug 14 19:40:51 user nova-compute[72782]:     <hostdev supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='mode'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>subsystem</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='startupPolicy'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>default</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>mandatory</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>requisite</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>optional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='subsysType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>usb</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>pci</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>scsi</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='capsType'/>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='pciBackend'/>
Aug 14 19:40:51 user nova-compute[72782]:     </hostdev>
Aug 14 19:40:51 user nova-compute[72782]:     <rng supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-non-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='backendModel'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>random</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>egd</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>builtin</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </rng>
Aug 14 19:40:51 user nova-compute[72782]:     <filesystem supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='driverType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>path</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>handle</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtiofs</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </filesystem>
Aug 14 19:40:51 user nova-compute[72782]:     <tpm supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>tpm-tis</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>tpm-crb</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='backendModel'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>passthrough</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>emulator</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </tpm>
Aug 14 19:40:51 user nova-compute[72782]:   </devices>
Aug 14 19:40:51 user nova-compute[72782]:   <features>
Aug 14 19:40:51 user nova-compute[72782]:     <gic supported='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     <vmcoreinfo supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <genid supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <backingStoreInput supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <backup supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <sev supported='no'/>
Aug 14 19:40:51 user nova-compute[72782]:   </features>
Aug 14 19:40:51 user nova-compute[72782]: </domainCapabilities>
Aug 14 19:40:51 user nova-compute[72782]:  {{(pid=72782) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 14 19:40:51 user nova-compute[72782]: <domainCapabilities>
Aug 14 19:40:51 user nova-compute[72782]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 19:40:51 user nova-compute[72782]:   <domain>kvm</domain>
Aug 14 19:40:51 user nova-compute[72782]:   <machine>pc-i440fx-jammy</machine>
Aug 14 19:40:51 user nova-compute[72782]:   <arch>i686</arch>
Aug 14 19:40:51 user nova-compute[72782]:   <vcpu max='255'/>
Aug 14 19:40:51 user nova-compute[72782]:   <iothreads supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:   <os supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:     <enum name='firmware'/>
Aug 14 19:40:51 user nova-compute[72782]:     <loader supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='type'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>rom</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>pflash</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='readonly'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>yes</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>no</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='secure'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>no</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </loader>
Aug 14 19:40:51 user nova-compute[72782]:   </os>
Aug 14 19:40:51 user nova-compute[72782]:   <cpu>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='host-passthrough' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='hostPassthroughMigratable'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>off</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='maximum' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='maximumMigratable'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>on</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>off</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='host-model' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <vendor>Intel</vendor>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ss'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='vmx'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='pcid'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='hypervisor'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='arat'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='umip'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='md-clear'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='stibp'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ssbd'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ibpb'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ibrs'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='amd-stibp'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='erms'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='lm'/>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='custom' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>qemu64</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>qemu32</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>phenom</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium3</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium2</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>n270</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>kvm64</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>kvm32</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>coreduo</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>core2duo</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>athlon</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Westmere</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Snowridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>SandyBridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Penryn</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G5</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G4</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G3</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G2</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G1</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Nehalem</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>IvyBridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Icelake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-Rome</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-Milan</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Dhyana</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cooperlake</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Conroe</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>486</model>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:   </cpu>
Aug 14 19:40:51 user nova-compute[72782]:   <memoryBacking supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:     <enum name='sourceType'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>file</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>anonymous</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>memfd</value>
Aug 14 19:40:51 user nova-compute[72782]:     </enum>
Aug 14 19:40:51 user nova-compute[72782]:   </memoryBacking>
Aug 14 19:40:51 user nova-compute[72782]:   <devices>
Aug 14 19:40:51 user nova-compute[72782]:     <disk supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='diskDevice'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>disk</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>cdrom</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>floppy</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>lun</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='bus'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>ide</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>fdc</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>scsi</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>usb</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>sata</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-non-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </disk>
Aug 14 19:40:51 user nova-compute[72782]:     <graphics supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='type'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>sdl</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vnc</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>spice</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>egl-headless</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </graphics>
Aug 14 19:40:51 user nova-compute[72782]:     <video supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='modelType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vga</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>cirrus</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vmvga</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>qxl</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>none</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>bochs</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>ramfb</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </video>
Aug 14 19:40:51 user nova-compute[72782]:     <hostdev supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='mode'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>subsystem</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='startupPolicy'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>default</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>mandatory</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>requisite</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>optional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='subsysType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>usb</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>pci</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>scsi</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='capsType'/>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='pciBackend'/>
Aug 14 19:40:51 user nova-compute[72782]:     </hostdev>
Aug 14 19:40:51 user nova-compute[72782]:     <rng supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-non-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='backendModel'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>random</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>egd</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>builtin</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </rng>
Aug 14 19:40:51 user nova-compute[72782]:     <filesystem supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='driverType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>path</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>handle</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtiofs</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </filesystem>
Aug 14 19:40:51 user nova-compute[72782]:     <tpm supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>tpm-tis</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>tpm-crb</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='backendModel'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>passthrough</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>emulator</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </tpm>
Aug 14 19:40:51 user nova-compute[72782]:   </devices>
Aug 14 19:40:51 user nova-compute[72782]:   <features>
Aug 14 19:40:51 user nova-compute[72782]:     <gic supported='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     <vmcoreinfo supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <genid supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <backingStoreInput supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <backup supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <sev supported='no'/>
Aug 14 19:40:51 user nova-compute[72782]:   </features>
Aug 14 19:40:51 user nova-compute[72782]: </domainCapabilities>
Aug 14 19:40:51 user nova-compute[72782]:  {{(pid=72782) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 14 19:40:51 user nova-compute[72782]: <domainCapabilities>
Aug 14 19:40:51 user nova-compute[72782]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 19:40:51 user nova-compute[72782]:   <domain>kvm</domain>
Aug 14 19:40:51 user nova-compute[72782]:   <machine>pc-q35-6.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:   <arch>x86_64</arch>
Aug 14 19:40:51 user nova-compute[72782]:   <vcpu max='288'/>
Aug 14 19:40:51 user nova-compute[72782]:   <iothreads supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:   <os supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:     <enum name='firmware'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>efi</value>
Aug 14 19:40:51 user nova-compute[72782]:     </enum>
Aug 14 19:40:51 user nova-compute[72782]:     <loader supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='type'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>rom</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>pflash</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='readonly'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>yes</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>no</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='secure'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>yes</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>no</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </loader>
Aug 14 19:40:51 user nova-compute[72782]:   </os>
Aug 14 19:40:51 user nova-compute[72782]:   <cpu>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='host-passthrough' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='hostPassthroughMigratable'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>on</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>off</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='maximum' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='maximumMigratable'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>on</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>off</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='host-model' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <vendor>Intel</vendor>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ss'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='vmx'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='pcid'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='hypervisor'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='arat'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='umip'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='md-clear'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='stibp'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ssbd'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='invtsc'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ibpb'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ibrs'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='amd-stibp'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='rsba'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='erms'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='custom' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>qemu64</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>qemu32</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>phenom</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium3</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium2</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>n270</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>kvm64</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>kvm32</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>coreduo</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>core2duo</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>athlon</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Westmere</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Snowridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>SandyBridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Penryn</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G5</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G4</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G3</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G2</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Opteron_G1</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Nehalem</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>IvyBridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Icelake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-Rome</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-Milan</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Dhyana</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cooperlake</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Conroe</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>486</model>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:   </cpu>
Aug 14 19:40:51 user nova-compute[72782]:   <memoryBacking supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:     <enum name='sourceType'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>file</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>anonymous</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>memfd</value>
Aug 14 19:40:51 user nova-compute[72782]:     </enum>
Aug 14 19:40:51 user nova-compute[72782]:   </memoryBacking>
Aug 14 19:40:51 user nova-compute[72782]:   <devices>
Aug 14 19:40:51 user nova-compute[72782]:     <disk supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='diskDevice'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>disk</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>cdrom</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>floppy</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>lun</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='bus'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>fdc</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>scsi</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>usb</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>sata</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-non-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </disk>
Aug 14 19:40:51 user nova-compute[72782]:     <graphics supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='type'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>sdl</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vnc</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>spice</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>egl-headless</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </graphics>
Aug 14 19:40:51 user nova-compute[72782]:     <video supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='modelType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vga</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>cirrus</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vmvga</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>qxl</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>none</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>bochs</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>ramfb</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </video>
Aug 14 19:40:51 user nova-compute[72782]:     <hostdev supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='mode'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>subsystem</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='startupPolicy'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>default</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>mandatory</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>requisite</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>optional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='subsysType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>usb</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>pci</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>scsi</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='capsType'/>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='pciBackend'/>
Aug 14 19:40:51 user nova-compute[72782]:     </hostdev>
Aug 14 19:40:51 user nova-compute[72782]:     <rng supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-non-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='backendModel'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>random</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>egd</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>builtin</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </rng>
Aug 14 19:40:51 user nova-compute[72782]:     <filesystem supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='driverType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>path</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>handle</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtiofs</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </filesystem>
Aug 14 19:40:51 user nova-compute[72782]:     <tpm supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>tpm-tis</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>tpm-crb</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='backendModel'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>passthrough</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>emulator</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </tpm>
Aug 14 19:40:51 user nova-compute[72782]:   </devices>
Aug 14 19:40:51 user nova-compute[72782]:   <features>
Aug 14 19:40:51 user nova-compute[72782]:     <gic supported='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     <vmcoreinfo supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <genid supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <backingStoreInput supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <backup supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <sev supported='no'/>
Aug 14 19:40:51 user nova-compute[72782]:   </features>
Aug 14 19:40:51 user nova-compute[72782]: </domainCapabilities>
Aug 14 19:40:51 user nova-compute[72782]:  {{(pid=72782) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 14 19:40:51 user nova-compute[72782]: <domainCapabilities>
Aug 14 19:40:51 user nova-compute[72782]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 19:40:51 user nova-compute[72782]:   <domain>kvm</domain>
Aug 14 19:40:51 user nova-compute[72782]:   <machine>pc-q35-jammy</machine>
Aug 14 19:40:51 user nova-compute[72782]:   <arch>x86_64</arch>
Aug 14 19:40:51 user nova-compute[72782]:   <vcpu max='288'/>
Aug 14 19:40:51 user nova-compute[72782]:   <iothreads supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:   <os supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:     <enum name='firmware'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>efi</value>
Aug 14 19:40:51 user nova-compute[72782]:     </enum>
Aug 14 19:40:51 user nova-compute[72782]:     <loader supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='type'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>rom</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>pflash</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='readonly'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>yes</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>no</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='secure'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>yes</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>no</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </loader>
Aug 14 19:40:51 user nova-compute[72782]:   </os>
Aug 14 19:40:51 user nova-compute[72782]:   <cpu>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='host-passthrough' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='hostPassthroughMigratable'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>on</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>off</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='maximum' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='maximumMigratable'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>on</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>off</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='host-model' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <vendor>Intel</vendor>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ss'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='vmx'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='pcid'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='hypervisor'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='arat'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='umip'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='md-clear'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='stibp'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ssbd'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='invtsc'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ibpb'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ibrs'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='amd-stibp'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='rsba'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='erms'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='custom' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>qemu64</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>qemu32</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>phenom</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium3</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium2</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>n270</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>kvm64</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>kvm32</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>coreduo</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>core2duo</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>athlon</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Westmere</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Snowridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>SandyBridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Penryn</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G5</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G4</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G3</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G2</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Opteron_G1</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Nehalem</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>IvyBridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Icelake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-Rome</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-Milan</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Dhyana</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cooperlake</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Conroe</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>486</model>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:   </cpu>
Aug 14 19:40:51 user nova-compute[72782]:   <memoryBacking supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:     <enum name='sourceType'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>file</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>anonymous</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>memfd</value>
Aug 14 19:40:51 user nova-compute[72782]:     </enum>
Aug 14 19:40:51 user nova-compute[72782]:   </memoryBacking>
Aug 14 19:40:51 user nova-compute[72782]:   <devices>
Aug 14 19:40:51 user nova-compute[72782]:     <disk supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='diskDevice'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>disk</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>cdrom</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>floppy</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>lun</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='bus'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>fdc</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>scsi</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>usb</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>sata</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-non-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </disk>
Aug 14 19:40:51 user nova-compute[72782]:     <graphics supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='type'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>sdl</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vnc</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>spice</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>egl-headless</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </graphics>
Aug 14 19:40:51 user nova-compute[72782]:     <video supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='modelType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vga</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>cirrus</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vmvga</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>qxl</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>none</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>bochs</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>ramfb</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </video>
Aug 14 19:40:51 user nova-compute[72782]:     <hostdev supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='mode'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>subsystem</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='startupPolicy'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>default</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>mandatory</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>requisite</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>optional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='subsysType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>usb</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>pci</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>scsi</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='capsType'/>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='pciBackend'/>
Aug 14 19:40:51 user nova-compute[72782]:     </hostdev>
Aug 14 19:40:51 user nova-compute[72782]:     <rng supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-non-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='backendModel'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>random</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>egd</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>builtin</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </rng>
Aug 14 19:40:51 user nova-compute[72782]:     <filesystem supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='driverType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>path</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>handle</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtiofs</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </filesystem>
Aug 14 19:40:51 user nova-compute[72782]:     <tpm supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>tpm-tis</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>tpm-crb</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='backendModel'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>passthrough</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>emulator</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </tpm>
Aug 14 19:40:51 user nova-compute[72782]:   </devices>
Aug 14 19:40:51 user nova-compute[72782]:   <features>
Aug 14 19:40:51 user nova-compute[72782]:     <gic supported='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     <vmcoreinfo supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <genid supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <backingStoreInput supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <backup supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <sev supported='no'/>
Aug 14 19:40:51 user nova-compute[72782]:   </features>
Aug 14 19:40:51 user nova-compute[72782]: </domainCapabilities>
Aug 14 19:40:51 user nova-compute[72782]:  {{(pid=72782) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 14 19:40:51 user nova-compute[72782]: <domainCapabilities>
Aug 14 19:40:51 user nova-compute[72782]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 19:40:51 user nova-compute[72782]:   <domain>kvm</domain>
Aug 14 19:40:51 user nova-compute[72782]:   <machine>pc-i440fx-6.2</machine>
Aug 14 19:40:51 user nova-compute[72782]:   <arch>x86_64</arch>
Aug 14 19:40:51 user nova-compute[72782]:   <vcpu max='255'/>
Aug 14 19:40:51 user nova-compute[72782]:   <iothreads supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:   <os supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:     <enum name='firmware'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>efi</value>
Aug 14 19:40:51 user nova-compute[72782]:     </enum>
Aug 14 19:40:51 user nova-compute[72782]:     <loader supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='type'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>rom</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>pflash</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='readonly'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>yes</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>no</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='secure'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>no</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </loader>
Aug 14 19:40:51 user nova-compute[72782]:   </os>
Aug 14 19:40:51 user nova-compute[72782]:   <cpu>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='host-passthrough' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='hostPassthroughMigratable'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>on</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>off</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='maximum' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='maximumMigratable'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>on</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>off</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='host-model' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <vendor>Intel</vendor>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ss'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='vmx'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='pcid'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='hypervisor'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='arat'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='umip'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='md-clear'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='stibp'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ssbd'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='invtsc'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ibpb'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ibrs'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='amd-stibp'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='rsba'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='erms'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='custom' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>qemu64</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>qemu32</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>phenom</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium3</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium2</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>n270</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>kvm64</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>kvm32</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>coreduo</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>core2duo</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>athlon</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Westmere</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Snowridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>SandyBridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Penryn</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G5</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G4</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G3</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G2</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Opteron_G1</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Nehalem</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>IvyBridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Icelake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-Rome</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-Milan</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Dhyana</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cooperlake</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Conroe</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>486</model>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:   </cpu>
Aug 14 19:40:51 user nova-compute[72782]:   <memoryBacking supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:     <enum name='sourceType'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>file</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>anonymous</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>memfd</value>
Aug 14 19:40:51 user nova-compute[72782]:     </enum>
Aug 14 19:40:51 user nova-compute[72782]:   </memoryBacking>
Aug 14 19:40:51 user nova-compute[72782]:   <devices>
Aug 14 19:40:51 user nova-compute[72782]:     <disk supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='diskDevice'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>disk</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>cdrom</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>floppy</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>lun</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='bus'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>ide</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>fdc</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>scsi</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>usb</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>sata</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-non-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </disk>
Aug 14 19:40:51 user nova-compute[72782]:     <graphics supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='type'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>sdl</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vnc</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>spice</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>egl-headless</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </graphics>
Aug 14 19:40:51 user nova-compute[72782]:     <video supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='modelType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vga</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>cirrus</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vmvga</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>qxl</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>none</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>bochs</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>ramfb</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </video>
Aug 14 19:40:51 user nova-compute[72782]:     <hostdev supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='mode'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>subsystem</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='startupPolicy'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>default</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>mandatory</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>requisite</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>optional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='subsysType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>usb</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>pci</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>scsi</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='capsType'/>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='pciBackend'/>
Aug 14 19:40:51 user nova-compute[72782]:     </hostdev>
Aug 14 19:40:51 user nova-compute[72782]:     <rng supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-non-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='backendModel'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>random</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>egd</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>builtin</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </rng>
Aug 14 19:40:51 user nova-compute[72782]:     <filesystem supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='driverType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>path</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>handle</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtiofs</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </filesystem>
Aug 14 19:40:51 user nova-compute[72782]:     <tpm supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>tpm-tis</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>tpm-crb</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='backendModel'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>passthrough</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>emulator</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </tpm>
Aug 14 19:40:51 user nova-compute[72782]:   </devices>
Aug 14 19:40:51 user nova-compute[72782]:   <features>
Aug 14 19:40:51 user nova-compute[72782]:     <gic supported='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     <vmcoreinfo supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <genid supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <backingStoreInput supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <backup supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <sev supported='no'/>
Aug 14 19:40:51 user nova-compute[72782]:   </features>
Aug 14 19:40:51 user nova-compute[72782]: </domainCapabilities>
Aug 14 19:40:51 user nova-compute[72782]:  {{(pid=72782) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 14 19:40:51 user nova-compute[72782]: <domainCapabilities>
Aug 14 19:40:51 user nova-compute[72782]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 19:40:51 user nova-compute[72782]:   <domain>kvm</domain>
Aug 14 19:40:51 user nova-compute[72782]:   <machine>pc-i440fx-jammy</machine>
Aug 14 19:40:51 user nova-compute[72782]:   <arch>x86_64</arch>
Aug 14 19:40:51 user nova-compute[72782]:   <vcpu max='255'/>
Aug 14 19:40:51 user nova-compute[72782]:   <iothreads supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:   <os supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:     <enum name='firmware'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>efi</value>
Aug 14 19:40:51 user nova-compute[72782]:     </enum>
Aug 14 19:40:51 user nova-compute[72782]:     <loader supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='type'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>rom</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>pflash</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='readonly'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>yes</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>no</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='secure'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>no</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </loader>
Aug 14 19:40:51 user nova-compute[72782]:   </os>
Aug 14 19:40:51 user nova-compute[72782]:   <cpu>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='host-passthrough' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='hostPassthroughMigratable'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>on</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>off</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='maximum' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='maximumMigratable'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>on</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>off</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='host-model' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <vendor>Intel</vendor>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ss'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='vmx'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='pcid'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='hypervisor'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='arat'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='umip'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='md-clear'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='stibp'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ssbd'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='invtsc'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ibpb'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='ibrs'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='amd-stibp'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='rsba'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='erms'/>
Aug 14 19:40:51 user nova-compute[72782]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:     <mode name='custom' supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>qemu64</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>qemu32</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>phenom</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium3</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium2</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>pentium</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>n270</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>kvm64</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>kvm32</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>coreduo</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>core2duo</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>athlon</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Westmere</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Snowridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Skylake-Client</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>SandyBridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Penryn</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G5</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G4</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G3</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Opteron_G2</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Opteron_G1</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Nehalem</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>IvyBridge</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Icelake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Haswell</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-Rome</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-Milan</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>EPYC</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Dhyana</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cooperlake</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>Conroe</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='no'>Broadwell</model>
Aug 14 19:40:51 user nova-compute[72782]:       <model usable='yes'>486</model>
Aug 14 19:40:51 user nova-compute[72782]:     </mode>
Aug 14 19:40:51 user nova-compute[72782]:   </cpu>
Aug 14 19:40:51 user nova-compute[72782]:   <memoryBacking supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:     <enum name='sourceType'>
Aug 14 19:40:51 user nova-compute[72782]:       <value>file</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>anonymous</value>
Aug 14 19:40:51 user nova-compute[72782]:       <value>memfd</value>
Aug 14 19:40:51 user nova-compute[72782]:     </enum>
Aug 14 19:40:51 user nova-compute[72782]:   </memoryBacking>
Aug 14 19:40:51 user nova-compute[72782]:   <devices>
Aug 14 19:40:51 user nova-compute[72782]:     <disk supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='diskDevice'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>disk</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>cdrom</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>floppy</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>lun</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='bus'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>ide</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>fdc</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>scsi</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>usb</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>sata</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-non-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </disk>
Aug 14 19:40:51 user nova-compute[72782]:     <graphics supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='type'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>sdl</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vnc</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>spice</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>egl-headless</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </graphics>
Aug 14 19:40:51 user nova-compute[72782]:     <video supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='modelType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vga</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>cirrus</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>vmvga</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>qxl</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>none</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>bochs</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>ramfb</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </video>
Aug 14 19:40:51 user nova-compute[72782]:     <hostdev supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='mode'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>subsystem</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='startupPolicy'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>default</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>mandatory</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>requisite</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>optional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='subsysType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>usb</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>pci</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>scsi</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='capsType'/>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='pciBackend'/>
Aug 14 19:40:51 user nova-compute[72782]:     </hostdev>
Aug 14 19:40:51 user nova-compute[72782]:     <rng supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtio-non-transitional</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='backendModel'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>random</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>egd</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>builtin</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </rng>
Aug 14 19:40:51 user nova-compute[72782]:     <filesystem supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='driverType'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>path</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>handle</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>virtiofs</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </filesystem>
Aug 14 19:40:51 user nova-compute[72782]:     <tpm supported='yes'>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='model'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>tpm-tis</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>tpm-crb</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:       <enum name='backendModel'>
Aug 14 19:40:51 user nova-compute[72782]:         <value>passthrough</value>
Aug 14 19:40:51 user nova-compute[72782]:         <value>emulator</value>
Aug 14 19:40:51 user nova-compute[72782]:       </enum>
Aug 14 19:40:51 user nova-compute[72782]:     </tpm>
Aug 14 19:40:51 user nova-compute[72782]:   </devices>
Aug 14 19:40:51 user nova-compute[72782]:   <features>
Aug 14 19:40:51 user nova-compute[72782]:     <gic supported='no'/>
Aug 14 19:40:51 user nova-compute[72782]:     <vmcoreinfo supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <genid supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <backingStoreInput supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <backup supported='yes'/>
Aug 14 19:40:51 user nova-compute[72782]:     <sev supported='no'/>
Aug 14 19:40:51 user nova-compute[72782]:   </features>
Aug 14 19:40:51 user nova-compute[72782]: </domainCapabilities>
Aug 14 19:40:51 user nova-compute[72782]:  {{(pid=72782) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72782) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72782) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Checking secure boot support for host arch (x86_64) {{(pid=72782) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 14 19:40:51 user nova-compute[72782]: INFO nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Secure Boot support detected
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] cpu compare xml: <cpu match="exact">
Aug 14 19:40:51 user nova-compute[72782]:   <model>Nehalem</model>
Aug 14 19:40:51 user nova-compute[72782]: </cpu>
Aug 14 19:40:51 user nova-compute[72782]:  {{(pid=72782) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 14 19:40:51 user nova-compute[72782]: INFO nova.virt.node [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Generated node identity d26c9e3b-40e6-476e-9664-3119ebf5873b
Aug 14 19:40:51 user nova-compute[72782]: INFO nova.virt.node [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Wrote node identity d26c9e3b-40e6-476e-9664-3119ebf5873b to /opt/stack/data/nova/compute_id
Aug 14 19:40:51 user nova-compute[72782]: WARNING nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Compute nodes ['d26c9e3b-40e6-476e-9664-3119ebf5873b'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 14 19:40:51 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 14 19:40:51 user nova-compute[72782]: WARNING nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 14 19:40:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:40:51 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:40:51 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Hypervisor/Node resource view: name=user free_ram=10855MB free_disk=26.38364028930664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:40:51 user nova-compute[72782]: WARNING nova.compute.resource_tracker [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] No compute node record for user:d26c9e3b-40e6-476e-9664-3119ebf5873b: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host d26c9e3b-40e6-476e-9664-3119ebf5873b could not be found.
Aug 14 19:40:51 user nova-compute[72782]: INFO nova.compute.resource_tracker [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Compute node record created for user:user with uuid: d26c9e3b-40e6-476e-9664-3119ebf5873b
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:40:51 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:40:52 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [req-8bd5dd50-4cc7-4dff-81ad-3e7ce0d7a5cb] Created resource provider record via placement API for resource provider with UUID d26c9e3b-40e6-476e-9664-3119ebf5873b and name user.
Aug 14 19:40:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72782) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 14 19:40:52 user nova-compute[72782]: INFO nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] kernel doesn't support AMD SEV
Aug 14 19:40:52 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 19:40:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:40:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Libvirt baseline CPU <cpu>
Aug 14 19:40:52 user nova-compute[72782]:   <arch>x86_64</arch>
Aug 14 19:40:52 user nova-compute[72782]:   <model>Nehalem</model>
Aug 14 19:40:52 user nova-compute[72782]:   <vendor>Intel</vendor>
Aug 14 19:40:52 user nova-compute[72782]:   <topology sockets="6" cores="1" threads="1"/>
Aug 14 19:40:52 user nova-compute[72782]: </cpu>
Aug 14 19:40:52 user nova-compute[72782]:  {{(pid=72782) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 14 19:40:52 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Updated inventory for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 14 19:40:52 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Updating resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b generation from 0 to 1 during operation: update_inventory {{(pid=72782) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 14 19:40:52 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 19:40:52 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Updating resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b generation from 1 to 2 during operation: update_traits {{(pid=72782) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 14 19:40:52 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:40:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.612s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:40:52 user nova-compute[72782]: DEBUG nova.service [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Creating RPC server for service compute {{(pid=72782) start /opt/stack/nova/nova/service.py:182}}
Aug 14 19:40:52 user nova-compute[72782]: DEBUG nova.service [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Join ServiceGroup membership for this service compute {{(pid=72782) start /opt/stack/nova/nova/service.py:199}}
Aug 14 19:40:52 user nova-compute[72782]: DEBUG nova.servicegroup.drivers.db [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72782) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 14 19:41:28 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:41:28 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:41:43 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:41:43 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:41:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=10244MB free_disk=26.28728485107422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:41:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:42:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:42:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:42:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:42:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:42:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:42:44 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:42:44 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:42:44 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=10188MB free_disk=26.33395767211914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:42:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:43:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:43:44 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:43:44 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:43:45 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:43:45 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:43:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=10188MB free_disk=26.11764144897461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:43:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:43:46 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:43:46 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:43:46 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:44:45 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:44:45 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:44:45 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:44:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:44:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 19:44:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 19:44:45 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:44:45 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:44:46 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:44:46 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:44:46 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:44:46 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:44:47 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:44:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:44:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:44:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:44:47 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:44:47 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:44:47 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:44:47 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=9446MB free_disk=26.139942169189453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:44:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:44:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:44:47 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:44:47 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:44:47 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:44:47 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:44:47 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:44:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:44:48 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:44:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Acquiring lock "39039cef-13fa-4434-9edc-4628757cbc24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:44:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "39039cef-13fa-4434-9edc-4628757cbc24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:44:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:44:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:44:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:44:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:44:52 user nova-compute[72782]: INFO nova.compute.claims [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Claim successful on node user
Aug 14 19:44:52 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:44:52 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:44:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:44:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:44:53 user nova-compute[72782]: DEBUG nova.compute.manager [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:44:53 user nova-compute[72782]: DEBUG nova.network.neutron [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:44:53 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:44:53 user nova-compute[72782]: DEBUG nova.compute.manager [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:44:53 user nova-compute[72782]: DEBUG nova.compute.manager [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:44:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:44:53 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Creating image(s)
Aug 14 19:44:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Acquiring lock "/opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:44:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "/opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:44:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "/opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:44:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:44:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:44:53 user nova-compute[72782]: DEBUG nova.policy [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d8e2f0957cb4581919171aa327ec848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366424c997cd4beaa392f8a1f3cdfa63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:44:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7.part --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:44:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7.part --force-share --output=json" returned: 0 in 0.173s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:44:54 user nova-compute[72782]: DEBUG nova.virt.images [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] 450d2d82-4a73-4a35-bff3-71ddab4bfe0e was qcow2, converting to raw {{(pid=72782) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 19:44:54 user nova-compute[72782]: DEBUG nova.privsep.utils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72782) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 19:44:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7.part /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7.converted {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:44:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7.part /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7.converted" returned: 0 in 0.152s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:44:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7.converted --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:44:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:44:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.419s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:44:54 user nova-compute[72782]: INFO oslo.privsep.daemon [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpynofjdj0/privsep.sock']
Aug 14 19:44:54 user sudo[81997]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpynofjdj0/privsep.sock
Aug 14 19:44:54 user sudo[81997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 19:44:56 user nova-compute[72782]: DEBUG nova.network.neutron [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Successfully created port: 16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:44:56 user sudo[81997]: pam_unix(sudo:session): session closed for user root
Aug 14 19:44:56 user nova-compute[72782]: INFO oslo.privsep.daemon [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Spawned new privsep daemon via rootwrap
Aug 14 19:44:56 user nova-compute[72782]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 19:44:56 user nova-compute[72782]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 19:44:56 user nova-compute[72782]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 14 19:44:56 user nova-compute[72782]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82003
Aug 14 19:44:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.233s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.191s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/disk 1073741824" returned: 0 in 0.045s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.204s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Cannot resize image /opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG nova.objects.instance [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lazy-loading 'migration_context' on Instance uuid 39039cef-13fa-4434-9edc-4628757cbc24 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Ensure instance console log exists: /opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:44:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:44:58 user nova-compute[72782]: DEBUG nova.network.neutron [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Successfully updated port: 16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:44:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Acquiring lock "refresh_cache-39039cef-13fa-4434-9edc-4628757cbc24" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:44:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Acquired lock "refresh_cache-39039cef-13fa-4434-9edc-4628757cbc24" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:44:58 user nova-compute[72782]: DEBUG nova.network.neutron [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:44:58 user nova-compute[72782]: DEBUG nova.network.neutron [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:44:58 user nova-compute[72782]: DEBUG nova.compute.manager [req-211c8676-bd71-41d9-84fd-71db977d3561 req-deb715ce-4c7d-49c9-9bd7-f319049d2f5d service nova] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Received event network-changed-16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:44:58 user nova-compute[72782]: DEBUG nova.compute.manager [req-211c8676-bd71-41d9-84fd-71db977d3561 req-deb715ce-4c7d-49c9-9bd7-f319049d2f5d service nova] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Refreshing instance network info cache due to event network-changed-16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:44:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-211c8676-bd71-41d9-84fd-71db977d3561 req-deb715ce-4c7d-49c9-9bd7-f319049d2f5d service nova] Acquiring lock "refresh_cache-39039cef-13fa-4434-9edc-4628757cbc24" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.network.neutron [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Updating instance_info_cache with network_info: [{"id": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "address": "fa:16:3e:dc:6d:cf", "network": {"id": "8ddd71dc-2d52-406a-a27e-eaf3f8251435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-292261629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "366424c997cd4beaa392f8a1f3cdfa63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ab6ae5-2d", "ovs_interfaceid": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Releasing lock "refresh_cache-39039cef-13fa-4434-9edc-4628757cbc24" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Instance network_info: |[{"id": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "address": "fa:16:3e:dc:6d:cf", "network": {"id": "8ddd71dc-2d52-406a-a27e-eaf3f8251435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-292261629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "366424c997cd4beaa392f8a1f3cdfa63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ab6ae5-2d", "ovs_interfaceid": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-211c8676-bd71-41d9-84fd-71db977d3561 req-deb715ce-4c7d-49c9-9bd7-f319049d2f5d service nova] Acquired lock "refresh_cache-39039cef-13fa-4434-9edc-4628757cbc24" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.network.neutron [req-211c8676-bd71-41d9-84fd-71db977d3561 req-deb715ce-4c7d-49c9-9bd7-f319049d2f5d service nova] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Refreshing network info cache for port 16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Start _get_guest_xml network_info=[{"id": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "address": "fa:16:3e:dc:6d:cf", "network": {"id": "8ddd71dc-2d52-406a-a27e-eaf3f8251435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-292261629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "366424c997cd4beaa392f8a1f3cdfa63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ab6ae5-2d", "ovs_interfaceid": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:44:59 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:44:59 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.privsep.utils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72782) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:44:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-307741904',display_name='tempest-DeleteServersTestJSON-server-307741904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-307741904',id=1,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='366424c997cd4beaa392f8a1f3cdfa63',ramdisk_id='',reservation_id='r-j4hfoman',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-946815863',owner_user_name='tempest-DeleteServersTestJSON-946815863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:44:53Z,user_data=None,user_id='2d8e2f0957cb4581919171aa327ec848',uuid=39039cef-13fa-4434-9edc-4628757cbc24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "address": "fa:16:3e:dc:6d:cf", "network": {"id": "8ddd71dc-2d52-406a-a27e-eaf3f8251435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-292261629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "366424c997cd4beaa392f8a1f3cdfa63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ab6ae5-2d", "ovs_interfaceid": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Converting VIF {"id": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "address": "fa:16:3e:dc:6d:cf", "network": {"id": "8ddd71dc-2d52-406a-a27e-eaf3f8251435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-292261629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "366424c997cd4beaa392f8a1f3cdfa63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ab6ae5-2d", "ovs_interfaceid": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6d:cf,bridge_name='br-int',has_traffic_filtering=True,id=16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9,network=Network(8ddd71dc-2d52-406a-a27e-eaf3f8251435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ab6ae5-2d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.objects.instance [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lazy-loading 'pci_devices' on Instance uuid 39039cef-13fa-4434-9edc-4628757cbc24 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:44:59 user nova-compute[72782]:   <uuid>39039cef-13fa-4434-9edc-4628757cbc24</uuid>
Aug 14 19:44:59 user nova-compute[72782]:   <name>instance-00000001</name>
Aug 14 19:44:59 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:44:59 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:44:59 user nova-compute[72782]:   <metadata>
Aug 14 19:44:59 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:44:59 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:44:59 user nova-compute[72782]:       <nova:name>tempest-DeleteServersTestJSON-server-307741904</nova:name>
Aug 14 19:44:59 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:44:59</nova:creationTime>
Aug 14 19:44:59 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:44:59 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:44:59 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:44:59 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:44:59 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:44:59 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:44:59 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:44:59 user nova-compute[72782]:       <nova:owner>
Aug 14 19:44:59 user nova-compute[72782]:         <nova:user uuid="2d8e2f0957cb4581919171aa327ec848">tempest-DeleteServersTestJSON-946815863-project-member</nova:user>
Aug 14 19:44:59 user nova-compute[72782]:         <nova:project uuid="366424c997cd4beaa392f8a1f3cdfa63">tempest-DeleteServersTestJSON-946815863</nova:project>
Aug 14 19:44:59 user nova-compute[72782]:       </nova:owner>
Aug 14 19:44:59 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:44:59 user nova-compute[72782]:       <nova:ports>
Aug 14 19:44:59 user nova-compute[72782]:         <nova:port uuid="16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9">
Aug 14 19:44:59 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 19:44:59 user nova-compute[72782]:         </nova:port>
Aug 14 19:44:59 user nova-compute[72782]:       </nova:ports>
Aug 14 19:44:59 user nova-compute[72782]:     </nova:instance>
Aug 14 19:44:59 user nova-compute[72782]:   </metadata>
Aug 14 19:44:59 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:44:59 user nova-compute[72782]:     <system>
Aug 14 19:44:59 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:44:59 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:44:59 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:44:59 user nova-compute[72782]:       <entry name="serial">39039cef-13fa-4434-9edc-4628757cbc24</entry>
Aug 14 19:44:59 user nova-compute[72782]:       <entry name="uuid">39039cef-13fa-4434-9edc-4628757cbc24</entry>
Aug 14 19:44:59 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:44:59 user nova-compute[72782]:     </system>
Aug 14 19:44:59 user nova-compute[72782]:   </sysinfo>
Aug 14 19:44:59 user nova-compute[72782]:   <os>
Aug 14 19:44:59 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:44:59 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:44:59 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:44:59 user nova-compute[72782]:   </os>
Aug 14 19:44:59 user nova-compute[72782]:   <features>
Aug 14 19:44:59 user nova-compute[72782]:     <acpi/>
Aug 14 19:44:59 user nova-compute[72782]:     <apic/>
Aug 14 19:44:59 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:44:59 user nova-compute[72782]:   </features>
Aug 14 19:44:59 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:44:59 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:44:59 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:44:59 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:44:59 user nova-compute[72782]:   </clock>
Aug 14 19:44:59 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:44:59 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:44:59 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:44:59 user nova-compute[72782]:   </cpu>
Aug 14 19:44:59 user nova-compute[72782]:   <devices>
Aug 14 19:44:59 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:44:59 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:44:59 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/disk"/>
Aug 14 19:44:59 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:44:59 user nova-compute[72782]:     </disk>
Aug 14 19:44:59 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:44:59 user nova-compute[72782]:       <mac address="fa:16:3e:dc:6d:cf"/>
Aug 14 19:44:59 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:44:59 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:44:59 user nova-compute[72782]:       <target dev="tap16ab6ae5-2d"/>
Aug 14 19:44:59 user nova-compute[72782]:     </interface>
Aug 14 19:44:59 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:44:59 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/console.log" append="off"/>
Aug 14 19:44:59 user nova-compute[72782]:     </serial>
Aug 14 19:44:59 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:44:59 user nova-compute[72782]:     <video>
Aug 14 19:44:59 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:44:59 user nova-compute[72782]:     </video>
Aug 14 19:44:59 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:44:59 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:44:59 user nova-compute[72782]:     </rng>
Aug 14 19:44:59 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:44:59 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:44:59 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:44:59 user nova-compute[72782]:     </memballoon>
Aug 14 19:44:59 user nova-compute[72782]:   </devices>
Aug 14 19:44:59 user nova-compute[72782]: </domain>
Aug 14 19:44:59 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:44:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-307741904',display_name='tempest-DeleteServersTestJSON-server-307741904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-307741904',id=1,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='366424c997cd4beaa392f8a1f3cdfa63',ramdisk_id='',reservation_id='r-j4hfoman',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-946815863',owner_user_name='tempest-DeleteServersTestJSON-946815863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:44:53Z,user_data=None,user_id='2d8e2f0957cb4581919171aa327ec848',uuid=39039cef-13fa-4434-9edc-4628757cbc24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "address": "fa:16:3e:dc:6d:cf", "network": {"id": "8ddd71dc-2d52-406a-a27e-eaf3f8251435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-292261629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "366424c997cd4beaa392f8a1f3cdfa63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ab6ae5-2d", "ovs_interfaceid": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Converting VIF {"id": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "address": "fa:16:3e:dc:6d:cf", "network": {"id": "8ddd71dc-2d52-406a-a27e-eaf3f8251435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-292261629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "366424c997cd4beaa392f8a1f3cdfa63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ab6ae5-2d", "ovs_interfaceid": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6d:cf,bridge_name='br-int',has_traffic_filtering=True,id=16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9,network=Network(8ddd71dc-2d52-406a-a27e-eaf3f8251435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ab6ae5-2d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG os_vif [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6d:cf,bridge_name='br-int',has_traffic_filtering=True,id=16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9,network=Network(8ddd71dc-2d52-406a-a27e-eaf3f8251435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ab6ae5-2d') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Created schema index Interface.name {{(pid=72782) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Created schema index Port.name {{(pid=72782) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Created schema index Bridge.name {{(pid=72782) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [POLLOUT] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:44:59 user nova-compute[72782]: INFO oslo.privsep.daemon [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpc4xh3lzt/privsep.sock']
Aug 14 19:44:59 user sudo[82070]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpc4xh3lzt/privsep.sock
Aug 14 19:44:59 user sudo[82070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 19:44:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.network.neutron [req-211c8676-bd71-41d9-84fd-71db977d3561 req-deb715ce-4c7d-49c9-9bd7-f319049d2f5d service nova] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Updated VIF entry in instance network info cache for port 16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG nova.network.neutron [req-211c8676-bd71-41d9-84fd-71db977d3561 req-deb715ce-4c7d-49c9-9bd7-f319049d2f5d service nova] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Updating instance_info_cache with network_info: [{"id": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "address": "fa:16:3e:dc:6d:cf", "network": {"id": "8ddd71dc-2d52-406a-a27e-eaf3f8251435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-292261629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "366424c997cd4beaa392f8a1f3cdfa63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ab6ae5-2d", "ovs_interfaceid": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:44:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-211c8676-bd71-41d9-84fd-71db977d3561 req-deb715ce-4c7d-49c9-9bd7-f319049d2f5d service nova] Releasing lock "refresh_cache-39039cef-13fa-4434-9edc-4628757cbc24" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:45:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:01 user sudo[82070]: pam_unix(sudo:session): session closed for user root
Aug 14 19:45:01 user nova-compute[72782]: INFO oslo.privsep.daemon [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Spawned new privsep daemon via rootwrap
Aug 14 19:45:01 user nova-compute[72782]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 19:45:01 user nova-compute[72782]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 19:45:01 user nova-compute[72782]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 14 19:45:01 user nova-compute[72782]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82080
Aug 14 19:45:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:45:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:01 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:45:01 user nova-compute[72782]: INFO nova.compute.claims [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Claim successful on node user
Aug 14 19:45:01 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:45:01 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:45:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:45:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:45:01 user nova-compute[72782]: DEBUG nova.network.neutron [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:45:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:01 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:45:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:45:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16ab6ae5-2d, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap16ab6ae5-2d, col_values=(('external_ids', {'iface-id': '16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:6d:cf', 'vm-uuid': '39039cef-13fa-4434-9edc-4628757cbc24'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG nova.policy [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0cada11ffdb4ebc8d9e80218818ec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c26e0199de48ee8c48dde8177bc519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:45:02 user nova-compute[72782]: INFO os_vif [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6d:cf,bridge_name='br-int',has_traffic_filtering=True,id=16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9,network=Network(8ddd71dc-2d52-406a-a27e-eaf3f8251435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ab6ae5-2d')
Aug 14 19:45:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:45:02 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Creating image(s)
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "/opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "/opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] No VIF found with MAC fa:16:3e:dc:6d:cf, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.208s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk 1073741824" returned: 0 in 0.048s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.164s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Cannot resize image /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG nova.objects.instance [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'migration_context' on Instance uuid 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Ensure instance console log exists: /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Successfully created port: 935f7dd0-e151-47aa-bcaf-a214f5854759 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:45:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-b9f0c1de-45c0-499e-9493-b09ddeb13a2b req-7457c622-6be2-4562-8cc7-2c7c1c565837 service nova] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Received event network-vif-plugged-16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b9f0c1de-45c0-499e-9493-b09ddeb13a2b req-7457c622-6be2-4562-8cc7-2c7c1c565837 service nova] Acquiring lock "39039cef-13fa-4434-9edc-4628757cbc24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b9f0c1de-45c0-499e-9493-b09ddeb13a2b req-7457c622-6be2-4562-8cc7-2c7c1c565837 service nova] Lock "39039cef-13fa-4434-9edc-4628757cbc24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b9f0c1de-45c0-499e-9493-b09ddeb13a2b req-7457c622-6be2-4562-8cc7-2c7c1c565837 service nova] Lock "39039cef-13fa-4434-9edc-4628757cbc24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-b9f0c1de-45c0-499e-9493-b09ddeb13a2b req-7457c622-6be2-4562-8cc7-2c7c1c565837 service nova] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] No waiting events found dispatching network-vif-plugged-16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:45:05 user nova-compute[72782]: WARNING nova.compute.manager [req-b9f0c1de-45c0-499e-9493-b09ddeb13a2b req-7457c622-6be2-4562-8cc7-2c7c1c565837 service nova] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Received unexpected event network-vif-plugged-16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9 for instance with vm_state building and task_state spawning.
Aug 14 19:45:05 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042305.437663, 39039cef-13fa-4434-9edc-4628757cbc24 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:45:05 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] VM Resumed (Lifecycle Event)
Aug 14 19:45:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:45:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:45:05 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Instance spawned successfully.
Aug 14 19:45:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:45:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:45:05 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:45:05 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042305.4406285, 39039cef-13fa-4434-9edc-4628757cbc24 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:45:05 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] VM Started (Lifecycle Event)
Aug 14 19:45:05 user nova-compute[72782]: INFO nova.compute.manager [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Took 12.32 seconds to spawn the instance on the hypervisor.
Aug 14 19:45:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:45:05 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:45:05 user nova-compute[72782]: INFO nova.compute.manager [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Took 13.26 seconds to build instance.
Aug 14 19:45:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89a801bf-a85e-4737-a976-0d6eb51325dd tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "39039cef-13fa-4434-9edc-4628757cbc24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.456s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:06 user nova-compute[72782]: DEBUG nova.network.neutron [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Successfully updated port: 935f7dd0-e151-47aa-bcaf-a214f5854759 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:45:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "refresh_cache-4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:45:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquired lock "refresh_cache-4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:45:06 user nova-compute[72782]: DEBUG nova.network.neutron [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:45:06 user nova-compute[72782]: DEBUG nova.compute.manager [req-5e7e6b20-be17-451b-a31a-370834488a58 req-8f84f702-f289-4a7e-ab79-d276149df696 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Received event network-changed-935f7dd0-e151-47aa-bcaf-a214f5854759 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:06 user nova-compute[72782]: DEBUG nova.compute.manager [req-5e7e6b20-be17-451b-a31a-370834488a58 req-8f84f702-f289-4a7e-ab79-d276149df696 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Refreshing instance network info cache due to event network-changed-935f7dd0-e151-47aa-bcaf-a214f5854759. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:45:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5e7e6b20-be17-451b-a31a-370834488a58 req-8f84f702-f289-4a7e-ab79-d276149df696 service nova] Acquiring lock "refresh_cache-4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:45:06 user nova-compute[72782]: DEBUG nova.network.neutron [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:45:06 user nova-compute[72782]: DEBUG nova.network.neutron [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Updating instance_info_cache with network_info: [{"id": "935f7dd0-e151-47aa-bcaf-a214f5854759", "address": "fa:16:3e:9a:a4:fc", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935f7dd0-e1", "ovs_interfaceid": "935f7dd0-e151-47aa-bcaf-a214f5854759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:45:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Releasing lock "refresh_cache-4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Instance network_info: |[{"id": "935f7dd0-e151-47aa-bcaf-a214f5854759", "address": "fa:16:3e:9a:a4:fc", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935f7dd0-e1", "ovs_interfaceid": "935f7dd0-e151-47aa-bcaf-a214f5854759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5e7e6b20-be17-451b-a31a-370834488a58 req-8f84f702-f289-4a7e-ab79-d276149df696 service nova] Acquired lock "refresh_cache-4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.network.neutron [req-5e7e6b20-be17-451b-a31a-370834488a58 req-8f84f702-f289-4a7e-ab79-d276149df696 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Refreshing network info cache for port 935f7dd0-e151-47aa-bcaf-a214f5854759 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Start _get_guest_xml network_info=[{"id": "935f7dd0-e151-47aa-bcaf-a214f5854759", "address": "fa:16:3e:9a:a4:fc", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935f7dd0-e1", "ovs_interfaceid": "935f7dd0-e151-47aa-bcaf-a214f5854759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:45:07 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:45:07 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:45:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-168865067',display_name='tempest-AttachVolumeNegativeTest-server-168865067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-168865067',id=2,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGh4ojufnQPtfxM4eGHoOyR4Gmec06h5XIWvIXJ8DsC40VCmaPCvr47+LOsm285pVn7sdaeXqtpIcJXo9028QHIC9FfOmwcdvmu+9tbuh3bQ/uiuOGZB3tzM5eg+hpSn+A==',key_name='tempest-keypair-1491984689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2c26e0199de48ee8c48dde8177bc519',ramdisk_id='',reservation_id='r-z5z2jft3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1229463629',owner_user_name='tempest-AttachVolumeNegativeTest-1229463629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:45:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0cada11ffdb4ebc8d9e80218818ec3b',uuid=4d18b2a3-0561-4dec-8a43-ef2c3d9673a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "935f7dd0-e151-47aa-bcaf-a214f5854759", "address": "fa:16:3e:9a:a4:fc", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935f7dd0-e1", "ovs_interfaceid": "935f7dd0-e151-47aa-bcaf-a214f5854759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converting VIF {"id": "935f7dd0-e151-47aa-bcaf-a214f5854759", "address": "fa:16:3e:9a:a4:fc", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935f7dd0-e1", "ovs_interfaceid": "935f7dd0-e151-47aa-bcaf-a214f5854759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:a4:fc,bridge_name='br-int',has_traffic_filtering=True,id=935f7dd0-e151-47aa-bcaf-a214f5854759,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935f7dd0-e1') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.objects.instance [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:45:07 user nova-compute[72782]:   <uuid>4d18b2a3-0561-4dec-8a43-ef2c3d9673a5</uuid>
Aug 14 19:45:07 user nova-compute[72782]:   <name>instance-00000002</name>
Aug 14 19:45:07 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:45:07 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:45:07 user nova-compute[72782]:   <metadata>
Aug 14 19:45:07 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:45:07 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:45:07 user nova-compute[72782]:       <nova:name>tempest-AttachVolumeNegativeTest-server-168865067</nova:name>
Aug 14 19:45:07 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:45:07</nova:creationTime>
Aug 14 19:45:07 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:45:07 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:45:07 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:45:07 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:45:07 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:45:07 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:45:07 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:45:07 user nova-compute[72782]:       <nova:owner>
Aug 14 19:45:07 user nova-compute[72782]:         <nova:user uuid="b0cada11ffdb4ebc8d9e80218818ec3b">tempest-AttachVolumeNegativeTest-1229463629-project-member</nova:user>
Aug 14 19:45:07 user nova-compute[72782]:         <nova:project uuid="f2c26e0199de48ee8c48dde8177bc519">tempest-AttachVolumeNegativeTest-1229463629</nova:project>
Aug 14 19:45:07 user nova-compute[72782]:       </nova:owner>
Aug 14 19:45:07 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:45:07 user nova-compute[72782]:       <nova:ports>
Aug 14 19:45:07 user nova-compute[72782]:         <nova:port uuid="935f7dd0-e151-47aa-bcaf-a214f5854759">
Aug 14 19:45:07 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 19:45:07 user nova-compute[72782]:         </nova:port>
Aug 14 19:45:07 user nova-compute[72782]:       </nova:ports>
Aug 14 19:45:07 user nova-compute[72782]:     </nova:instance>
Aug 14 19:45:07 user nova-compute[72782]:   </metadata>
Aug 14 19:45:07 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:45:07 user nova-compute[72782]:     <system>
Aug 14 19:45:07 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:45:07 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:45:07 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:45:07 user nova-compute[72782]:       <entry name="serial">4d18b2a3-0561-4dec-8a43-ef2c3d9673a5</entry>
Aug 14 19:45:07 user nova-compute[72782]:       <entry name="uuid">4d18b2a3-0561-4dec-8a43-ef2c3d9673a5</entry>
Aug 14 19:45:07 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:45:07 user nova-compute[72782]:     </system>
Aug 14 19:45:07 user nova-compute[72782]:   </sysinfo>
Aug 14 19:45:07 user nova-compute[72782]:   <os>
Aug 14 19:45:07 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:45:07 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:45:07 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:45:07 user nova-compute[72782]:   </os>
Aug 14 19:45:07 user nova-compute[72782]:   <features>
Aug 14 19:45:07 user nova-compute[72782]:     <acpi/>
Aug 14 19:45:07 user nova-compute[72782]:     <apic/>
Aug 14 19:45:07 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:45:07 user nova-compute[72782]:   </features>
Aug 14 19:45:07 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:45:07 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:45:07 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:45:07 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:45:07 user nova-compute[72782]:   </clock>
Aug 14 19:45:07 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:45:07 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:45:07 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:45:07 user nova-compute[72782]:   </cpu>
Aug 14 19:45:07 user nova-compute[72782]:   <devices>
Aug 14 19:45:07 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:45:07 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:45:07 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk"/>
Aug 14 19:45:07 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:45:07 user nova-compute[72782]:     </disk>
Aug 14 19:45:07 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:45:07 user nova-compute[72782]:       <mac address="fa:16:3e:9a:a4:fc"/>
Aug 14 19:45:07 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:45:07 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:45:07 user nova-compute[72782]:       <target dev="tap935f7dd0-e1"/>
Aug 14 19:45:07 user nova-compute[72782]:     </interface>
Aug 14 19:45:07 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:45:07 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/console.log" append="off"/>
Aug 14 19:45:07 user nova-compute[72782]:     </serial>
Aug 14 19:45:07 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:45:07 user nova-compute[72782]:     <video>
Aug 14 19:45:07 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:45:07 user nova-compute[72782]:     </video>
Aug 14 19:45:07 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:45:07 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:45:07 user nova-compute[72782]:     </rng>
Aug 14 19:45:07 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:45:07 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:45:07 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:45:07 user nova-compute[72782]:     </memballoon>
Aug 14 19:45:07 user nova-compute[72782]:   </devices>
Aug 14 19:45:07 user nova-compute[72782]: </domain>
Aug 14 19:45:07 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:45:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-168865067',display_name='tempest-AttachVolumeNegativeTest-server-168865067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-168865067',id=2,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGh4ojufnQPtfxM4eGHoOyR4Gmec06h5XIWvIXJ8DsC40VCmaPCvr47+LOsm285pVn7sdaeXqtpIcJXo9028QHIC9FfOmwcdvmu+9tbuh3bQ/uiuOGZB3tzM5eg+hpSn+A==',key_name='tempest-keypair-1491984689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2c26e0199de48ee8c48dde8177bc519',ramdisk_id='',reservation_id='r-z5z2jft3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1229463629',owner_user_name='tempest-AttachVolumeNegativeTest-1229463629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:45:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0cada11ffdb4ebc8d9e80218818ec3b',uuid=4d18b2a3-0561-4dec-8a43-ef2c3d9673a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "935f7dd0-e151-47aa-bcaf-a214f5854759", "address": "fa:16:3e:9a:a4:fc", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935f7dd0-e1", "ovs_interfaceid": "935f7dd0-e151-47aa-bcaf-a214f5854759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converting VIF {"id": "935f7dd0-e151-47aa-bcaf-a214f5854759", "address": "fa:16:3e:9a:a4:fc", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935f7dd0-e1", "ovs_interfaceid": "935f7dd0-e151-47aa-bcaf-a214f5854759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:a4:fc,bridge_name='br-int',has_traffic_filtering=True,id=935f7dd0-e151-47aa-bcaf-a214f5854759,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935f7dd0-e1') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG os_vif [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:a4:fc,bridge_name='br-int',has_traffic_filtering=True,id=935f7dd0-e151-47aa-bcaf-a214f5854759,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935f7dd0-e1') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap935f7dd0-e1, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap935f7dd0-e1, col_values=(('external_ids', {'iface-id': '935f7dd0-e151-47aa-bcaf-a214f5854759', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:a4:fc', 'vm-uuid': '4d18b2a3-0561-4dec-8a43-ef2c3d9673a5'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:07 user nova-compute[72782]: INFO os_vif [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:a4:fc,bridge_name='br-int',has_traffic_filtering=True,id=935f7dd0-e151-47aa-bcaf-a214f5854759,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935f7dd0-e1')
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] No VIF found with MAC fa:16:3e:9a:a4:fc, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.compute.manager [req-9335dd9b-4241-453b-b43b-88024a5f566d req-62175a30-de95-4aba-a96e-9ac26d51ed47 service nova] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Received event network-vif-plugged-16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9335dd9b-4241-453b-b43b-88024a5f566d req-62175a30-de95-4aba-a96e-9ac26d51ed47 service nova] Acquiring lock "39039cef-13fa-4434-9edc-4628757cbc24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9335dd9b-4241-453b-b43b-88024a5f566d req-62175a30-de95-4aba-a96e-9ac26d51ed47 service nova] Lock "39039cef-13fa-4434-9edc-4628757cbc24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9335dd9b-4241-453b-b43b-88024a5f566d req-62175a30-de95-4aba-a96e-9ac26d51ed47 service nova] Lock "39039cef-13fa-4434-9edc-4628757cbc24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.compute.manager [req-9335dd9b-4241-453b-b43b-88024a5f566d req-62175a30-de95-4aba-a96e-9ac26d51ed47 service nova] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] No waiting events found dispatching network-vif-plugged-16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:45:07 user nova-compute[72782]: WARNING nova.compute.manager [req-9335dd9b-4241-453b-b43b-88024a5f566d req-62175a30-de95-4aba-a96e-9ac26d51ed47 service nova] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Received unexpected event network-vif-plugged-16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9 for instance with vm_state active and task_state None.
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.network.neutron [req-5e7e6b20-be17-451b-a31a-370834488a58 req-8f84f702-f289-4a7e-ab79-d276149df696 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Updated VIF entry in instance network info cache for port 935f7dd0-e151-47aa-bcaf-a214f5854759. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG nova.network.neutron [req-5e7e6b20-be17-451b-a31a-370834488a58 req-8f84f702-f289-4a7e-ab79-d276149df696 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Updating instance_info_cache with network_info: [{"id": "935f7dd0-e151-47aa-bcaf-a214f5854759", "address": "fa:16:3e:9a:a4:fc", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935f7dd0-e1", "ovs_interfaceid": "935f7dd0-e151-47aa-bcaf-a214f5854759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:45:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5e7e6b20-be17-451b-a31a-370834488a58 req-8f84f702-f289-4a7e-ab79-d276149df696 service nova] Releasing lock "refresh_cache-4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:45:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:11 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042311.6698701, 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:45:11 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] VM Resumed (Lifecycle Event)
Aug 14 19:45:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:45:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:45:11 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Instance spawned successfully.
Aug 14 19:45:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:45:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:45:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:11 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:45:11 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042311.6794379, 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:45:11 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] VM Started (Lifecycle Event)
Aug 14 19:45:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:11 user nova-compute[72782]: INFO nova.compute.manager [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Took 9.83 seconds to spawn the instance on the hypervisor.
Aug 14 19:45:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:45:11 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:45:12 user nova-compute[72782]: INFO nova.compute.manager [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Took 10.61 seconds to build instance.
Aug 14 19:45:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b070da00-49e5-4427-b7f9-31a72dff6c31 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.802s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Acquiring lock "03fc42b1-f33d-4930-ba65-22540584b7fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:18 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:45:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:18 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:45:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:45:18 user nova-compute[72782]: INFO nova.compute.claims [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Claim successful on node user
Aug 14 19:45:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:19 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:45:19 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:45:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:19 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:45:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.373s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:19 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:45:19 user nova-compute[72782]: INFO nova.compute.claims [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Claim successful on node user
Aug 14 19:45:19 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:45:19 user nova-compute[72782]: DEBUG nova.network.neutron [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:45:19 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 14 19:45:19 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:45:19 user nova-compute[72782]: DEBUG nova.policy [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f115dc3b880454c9261803ea3832e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259cfb8159bd4a3bb97eafcd7ddbfa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:45:19 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:45:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:45:19 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Creating image(s)
Aug 14 19:45:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Acquiring lock "/opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "/opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "/opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Acquiring lock "793afb69c72aa4ff9ed612867f10698cbb92a719" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "793afb69c72aa4ff9ed612867f10698cbb92a719" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:19 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:45:19 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:45:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719.part --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.181s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:45:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:45:20 user nova-compute[72782]: DEBUG nova.network.neutron [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:45:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719.part --force-share --output=json" returned: 0 in 0.232s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:20 user nova-compute[72782]: DEBUG nova.virt.images [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] 4c69f568-4fcd-4cbd-91de-5de7506d4e45 was qcow2, converting to raw {{(pid=72782) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 19:45:20 user nova-compute[72782]: DEBUG nova.privsep.utils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72782) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 19:45:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719.part /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719.converted {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:20 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:45:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:45:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719.part /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719.converted" returned: 0 in 0.378s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719.converted --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:45:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:45:20 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Creating image(s)
Aug 14 19:45:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "/opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "/opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:20 user nova-compute[72782]: DEBUG nova.policy [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01da439b977447d9acd627af965122bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294f11708224e9a9a69ae37139b4d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:45:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "793afb69c72aa4ff9ed612867f10698cbb92a719" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.546s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.252s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719 --force-share --output=json" returned: 0 in 0.238s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Acquiring lock "793afb69c72aa4ff9ed612867f10698cbb92a719" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "793afb69c72aa4ff9ed612867f10698cbb92a719" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.267s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719 --force-share --output=json" returned: 0 in 0.225s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719,backing_fmt=raw /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk 1073741824" returned: 0 in 0.101s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.377s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719,backing_fmt=raw /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk 1073741824" returned: 0 in 0.084s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "793afb69c72aa4ff9ed612867f10698cbb92a719" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.315s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:45:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719 --force-share --output=json" returned: 0 in 0.340s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Cannot resize image /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG nova.objects.instance [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lazy-loading 'migration_context' on Instance uuid b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Ensure instance console log exists: /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Cannot resize image /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG nova.objects.instance [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lazy-loading 'migration_context' on Instance uuid 03fc42b1-f33d-4930-ba65-22540584b7fe {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Ensure instance console log exists: /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG nova.network.neutron [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Successfully created port: 888a72be-5707-4d58-98e1-b472c928de22 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:45:22 user nova-compute[72782]: DEBUG nova.network.neutron [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Successfully created port: f11177e3-e8db-464f-b8be-971cb3afcdf8 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:45:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-31874581-9be2-4676-9749-bdba1e96a0aa req-8de144cc-430e-4403-907f-52aa9193a8d2 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Received event network-vif-plugged-935f7dd0-e151-47aa-bcaf-a214f5854759 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-31874581-9be2-4676-9749-bdba1e96a0aa req-8de144cc-430e-4403-907f-52aa9193a8d2 service nova] Acquiring lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-31874581-9be2-4676-9749-bdba1e96a0aa req-8de144cc-430e-4403-907f-52aa9193a8d2 service nova] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-31874581-9be2-4676-9749-bdba1e96a0aa req-8de144cc-430e-4403-907f-52aa9193a8d2 service nova] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-31874581-9be2-4676-9749-bdba1e96a0aa req-8de144cc-430e-4403-907f-52aa9193a8d2 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] No waiting events found dispatching network-vif-plugged-935f7dd0-e151-47aa-bcaf-a214f5854759 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:45:23 user nova-compute[72782]: WARNING nova.compute.manager [req-31874581-9be2-4676-9749-bdba1e96a0aa req-8de144cc-430e-4403-907f-52aa9193a8d2 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Received unexpected event network-vif-plugged-935f7dd0-e151-47aa-bcaf-a214f5854759 for instance with vm_state active and task_state None.
Aug 14 19:45:23 user nova-compute[72782]: DEBUG nova.network.neutron [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Successfully updated port: 888a72be-5707-4d58-98e1-b472c928de22 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:45:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "refresh_cache-b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:45:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquired lock "refresh_cache-b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:45:23 user nova-compute[72782]: DEBUG nova.network.neutron [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:45:24 user nova-compute[72782]: DEBUG nova.network.neutron [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:45:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "5d532038-555f-42d3-b35a-9e6f0350b023" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "5d532038-555f-42d3-b35a-9e6f0350b023" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-bad55d59-7461-4d63-84b0-aeebcc14bb1b req-3e6570d3-6d1a-4f6e-bad8-bd1d9892fbc0 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Received event network-changed-888a72be-5707-4d58-98e1-b472c928de22 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-bad55d59-7461-4d63-84b0-aeebcc14bb1b req-3e6570d3-6d1a-4f6e-bad8-bd1d9892fbc0 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Refreshing instance network info cache due to event network-changed-888a72be-5707-4d58-98e1-b472c928de22. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:45:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bad55d59-7461-4d63-84b0-aeebcc14bb1b req-3e6570d3-6d1a-4f6e-bad8-bd1d9892fbc0 service nova] Acquiring lock "refresh_cache-b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:45:24 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:45:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:45:24 user nova-compute[72782]: INFO nova.compute.claims [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Claim successful on node user
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.network.neutron [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Successfully updated port: f11177e3-e8db-464f-b8be-971cb3afcdf8 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Acquiring lock "refresh_cache-03fc42b1-f33d-4930-ba65-22540584b7fe" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Acquired lock "refresh_cache-03fc42b1-f33d-4930-ba65-22540584b7fe" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.network.neutron [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-4f96bfab-43ab-4037-a21b-071571eaca48 req-74a4ba72-df83-4b7b-ab85-ae70598325b9 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Received event network-vif-plugged-935f7dd0-e151-47aa-bcaf-a214f5854759 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4f96bfab-43ab-4037-a21b-071571eaca48 req-74a4ba72-df83-4b7b-ab85-ae70598325b9 service nova] Acquiring lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4f96bfab-43ab-4037-a21b-071571eaca48 req-74a4ba72-df83-4b7b-ab85-ae70598325b9 service nova] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4f96bfab-43ab-4037-a21b-071571eaca48 req-74a4ba72-df83-4b7b-ab85-ae70598325b9 service nova] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-4f96bfab-43ab-4037-a21b-071571eaca48 req-74a4ba72-df83-4b7b-ab85-ae70598325b9 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] No waiting events found dispatching network-vif-plugged-935f7dd0-e151-47aa-bcaf-a214f5854759 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:45:25 user nova-compute[72782]: WARNING nova.compute.manager [req-4f96bfab-43ab-4037-a21b-071571eaca48 req-74a4ba72-df83-4b7b-ab85-ae70598325b9 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Received unexpected event network-vif-plugged-935f7dd0-e151-47aa-bcaf-a214f5854759 for instance with vm_state active and task_state None.
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-4f96bfab-43ab-4037-a21b-071571eaca48 req-74a4ba72-df83-4b7b-ab85-ae70598325b9 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Received event network-changed-f11177e3-e8db-464f-b8be-971cb3afcdf8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-4f96bfab-43ab-4037-a21b-071571eaca48 req-74a4ba72-df83-4b7b-ab85-ae70598325b9 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Refreshing instance network info cache due to event network-changed-f11177e3-e8db-464f-b8be-971cb3afcdf8. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4f96bfab-43ab-4037-a21b-071571eaca48 req-74a4ba72-df83-4b7b-ab85-ae70598325b9 service nova] Acquiring lock "refresh_cache-03fc42b1-f33d-4930-ba65-22540584b7fe" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.network.neutron [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:45:25 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.network.neutron [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Updating instance_info_cache with network_info: [{"id": "888a72be-5707-4d58-98e1-b472c928de22", "address": "fa:16:3e:83:d0:33", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888a72be-57", "ovs_interfaceid": "888a72be-5707-4d58-98e1-b472c928de22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Releasing lock "refresh_cache-b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Instance network_info: |[{"id": "888a72be-5707-4d58-98e1-b472c928de22", "address": "fa:16:3e:83:d0:33", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888a72be-57", "ovs_interfaceid": "888a72be-5707-4d58-98e1-b472c928de22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bad55d59-7461-4d63-84b0-aeebcc14bb1b req-3e6570d3-6d1a-4f6e-bad8-bd1d9892fbc0 service nova] Acquired lock "refresh_cache-b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.network.neutron [req-bad55d59-7461-4d63-84b0-aeebcc14bb1b req-3e6570d3-6d1a-4f6e-bad8-bd1d9892fbc0 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Refreshing network info cache for port 888a72be-5707-4d58-98e1-b472c928de22 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Start _get_guest_xml network_info=[{"id": "888a72be-5707-4d58-98e1-b472c928de22", "address": "fa:16:3e:83:d0:33", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888a72be-57", "ovs_interfaceid": "888a72be-5707-4d58-98e1-b472c928de22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.policy [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5283c6441c04ba497e3c89403bb2d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de6c5ad7cf54432b6e2704cd3c0201c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Acquiring lock "04969095-d5d4-4581-bb3e-df44e21d33d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:25 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:45:25 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1177120667',display_name='tempest-VolumesAdminNegativeTest-server-1177120667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1177120667',id=4,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH00Mhm4BdUQ/WKnJrAbE4oMdBwmMvak2fIgW/fa64RGW+K6Tw9nYvgT7rt9GMHrdE0UJc2ad9A6656U8CO7+xu8xj+cJ4fdOwb9EXiw/9YkDO3dKIrlmyKbHaK+Q5nGNA==',key_name='tempest-keypair-783314842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c294f11708224e9a9a69ae37139b4d06',ramdisk_id='',reservation_id='r-b1xmkvvx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-468605289',owner_user_name='tempest-VolumesAdminNegativeTest-468605289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01da439b977447d9acd627af965122bd',uuid=b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "888a72be-5707-4d58-98e1-b472c928de22", "address": "fa:16:3e:83:d0:33", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888a72be-57", "ovs_interfaceid": "888a72be-5707-4d58-98e1-b472c928de22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Converting VIF {"id": "888a72be-5707-4d58-98e1-b472c928de22", "address": "fa:16:3e:83:d0:33", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888a72be-57", "ovs_interfaceid": "888a72be-5707-4d58-98e1-b472c928de22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:d0:33,bridge_name='br-int',has_traffic_filtering=True,id=888a72be-5707-4d58-98e1-b472c928de22,network=Network(f55b2a79-f0a6-4b3f-991b-a93ae0ded8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888a72be-57') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.objects.instance [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lazy-loading 'pci_devices' on Instance uuid b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:45:25 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Creating image(s)
Aug 14 19:45:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:45:25 user nova-compute[72782]:   <uuid>b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6</uuid>
Aug 14 19:45:25 user nova-compute[72782]:   <name>instance-00000004</name>
Aug 14 19:45:25 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:45:25 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:45:25 user nova-compute[72782]:   <metadata>
Aug 14 19:45:25 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:45:25 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:45:25 user nova-compute[72782]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1177120667</nova:name>
Aug 14 19:45:25 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:45:25</nova:creationTime>
Aug 14 19:45:25 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:45:25 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:45:25 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:45:25 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:45:25 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:45:25 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:45:25 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:45:25 user nova-compute[72782]:       <nova:owner>
Aug 14 19:45:25 user nova-compute[72782]:         <nova:user uuid="01da439b977447d9acd627af965122bd">tempest-VolumesAdminNegativeTest-468605289-project-member</nova:user>
Aug 14 19:45:25 user nova-compute[72782]:         <nova:project uuid="c294f11708224e9a9a69ae37139b4d06">tempest-VolumesAdminNegativeTest-468605289</nova:project>
Aug 14 19:45:25 user nova-compute[72782]:       </nova:owner>
Aug 14 19:45:25 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:45:25 user nova-compute[72782]:       <nova:ports>
Aug 14 19:45:25 user nova-compute[72782]:         <nova:port uuid="888a72be-5707-4d58-98e1-b472c928de22">
Aug 14 19:45:25 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 19:45:25 user nova-compute[72782]:         </nova:port>
Aug 14 19:45:25 user nova-compute[72782]:       </nova:ports>
Aug 14 19:45:25 user nova-compute[72782]:     </nova:instance>
Aug 14 19:45:25 user nova-compute[72782]:   </metadata>
Aug 14 19:45:25 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:45:25 user nova-compute[72782]:     <system>
Aug 14 19:45:25 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:45:25 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:45:25 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:45:25 user nova-compute[72782]:       <entry name="serial">b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6</entry>
Aug 14 19:45:25 user nova-compute[72782]:       <entry name="uuid">b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6</entry>
Aug 14 19:45:25 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:45:25 user nova-compute[72782]:     </system>
Aug 14 19:45:25 user nova-compute[72782]:   </sysinfo>
Aug 14 19:45:25 user nova-compute[72782]:   <os>
Aug 14 19:45:25 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:45:25 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:45:25 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:45:25 user nova-compute[72782]:   </os>
Aug 14 19:45:25 user nova-compute[72782]:   <features>
Aug 14 19:45:25 user nova-compute[72782]:     <acpi/>
Aug 14 19:45:25 user nova-compute[72782]:     <apic/>
Aug 14 19:45:25 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:45:25 user nova-compute[72782]:   </features>
Aug 14 19:45:25 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:45:25 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:45:25 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:45:25 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:45:25 user nova-compute[72782]:   </clock>
Aug 14 19:45:25 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:45:25 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:45:25 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:45:25 user nova-compute[72782]:   </cpu>
Aug 14 19:45:25 user nova-compute[72782]:   <devices>
Aug 14 19:45:25 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:45:25 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:45:25 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk"/>
Aug 14 19:45:25 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:45:25 user nova-compute[72782]:     </disk>
Aug 14 19:45:25 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:45:25 user nova-compute[72782]:       <mac address="fa:16:3e:83:d0:33"/>
Aug 14 19:45:25 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:45:25 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:45:25 user nova-compute[72782]:       <target dev="tap888a72be-57"/>
Aug 14 19:45:25 user nova-compute[72782]:     </interface>
Aug 14 19:45:25 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:45:25 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/console.log" append="off"/>
Aug 14 19:45:25 user nova-compute[72782]:     </serial>
Aug 14 19:45:25 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:45:25 user nova-compute[72782]:     <video>
Aug 14 19:45:25 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:45:25 user nova-compute[72782]:     </video>
Aug 14 19:45:25 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:45:25 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:45:25 user nova-compute[72782]:     </rng>
Aug 14 19:45:25 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:45:25 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:45:25 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:45:25 user nova-compute[72782]:     </memballoon>
Aug 14 19:45:25 user nova-compute[72782]:   </devices>
Aug 14 19:45:25 user nova-compute[72782]: </domain>
Aug 14 19:45:25 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1177120667',display_name='tempest-VolumesAdminNegativeTest-server-1177120667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1177120667',id=4,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH00Mhm4BdUQ/WKnJrAbE4oMdBwmMvak2fIgW/fa64RGW+K6Tw9nYvgT7rt9GMHrdE0UJc2ad9A6656U8CO7+xu8xj+cJ4fdOwb9EXiw/9YkDO3dKIrlmyKbHaK+Q5nGNA==',key_name='tempest-keypair-783314842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c294f11708224e9a9a69ae37139b4d06',ramdisk_id='',reservation_id='r-b1xmkvvx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-468605289',owner_user_name='tempest-VolumesAdminNegativeTest-468605289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01da439b977447d9acd627af965122bd',uuid=b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "888a72be-5707-4d58-98e1-b472c928de22", "address": "fa:16:3e:83:d0:33", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888a72be-57", "ovs_interfaceid": "888a72be-5707-4d58-98e1-b472c928de22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Converting VIF {"id": "888a72be-5707-4d58-98e1-b472c928de22", "address": "fa:16:3e:83:d0:33", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888a72be-57", "ovs_interfaceid": "888a72be-5707-4d58-98e1-b472c928de22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:d0:33,bridge_name='br-int',has_traffic_filtering=True,id=888a72be-5707-4d58-98e1-b472c928de22,network=Network(f55b2a79-f0a6-4b3f-991b-a93ae0ded8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888a72be-57') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG os_vif [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:d0:33,bridge_name='br-int',has_traffic_filtering=True,id=888a72be-5707-4d58-98e1-b472c928de22,network=Network(f55b2a79-f0a6-4b3f-991b-a93ae0ded8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888a72be-57') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap888a72be-57, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap888a72be-57, col_values=(('external_ids', {'iface-id': '888a72be-5707-4d58-98e1-b472c928de22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:d0:33', 'vm-uuid': 'b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:45:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:25 user nova-compute[72782]: INFO os_vif [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:d0:33,bridge_name='br-int',has_traffic_filtering=True,id=888a72be-5707-4d58-98e1-b472c928de22,network=Network(f55b2a79-f0a6-4b3f-991b-a93ae0ded8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888a72be-57')
Aug 14 19:45:25 user nova-compute[72782]: DEBUG nova.network.neutron [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Updating instance_info_cache with network_info: [{"id": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "address": "fa:16:3e:ae:6b:5f", "network": {"id": "f9f76ffd-5958-4a0b-b374-47e53fc2c74c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-415651663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259cfb8159bd4a3bb97eafcd7ddbfa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11177e3-e8", "ovs_interfaceid": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:45:26 user nova-compute[72782]: INFO nova.compute.claims [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Claim successful on node user
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Releasing lock "refresh_cache-03fc42b1-f33d-4930-ba65-22540584b7fe" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Instance network_info: |[{"id": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "address": "fa:16:3e:ae:6b:5f", "network": {"id": "f9f76ffd-5958-4a0b-b374-47e53fc2c74c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-415651663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259cfb8159bd4a3bb97eafcd7ddbfa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11177e3-e8", "ovs_interfaceid": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4f96bfab-43ab-4037-a21b-071571eaca48 req-74a4ba72-df83-4b7b-ab85-ae70598325b9 service nova] Acquired lock "refresh_cache-03fc42b1-f33d-4930-ba65-22540584b7fe" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.network.neutron [req-4f96bfab-43ab-4037-a21b-071571eaca48 req-74a4ba72-df83-4b7b-ab85-ae70598325b9 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Refreshing network info cache for port f11177e3-e8db-464f-b8be-971cb3afcdf8 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Start _get_guest_xml network_info=[{"id": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "address": "fa:16:3e:ae:6b:5f", "network": {"id": "f9f76ffd-5958-4a0b-b374-47e53fc2c74c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-415651663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259cfb8159bd4a3bb97eafcd7ddbfa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11177e3-e8", "ovs_interfaceid": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:45:10Z,direct_url=<?>,disk_format='qcow2',id=4c69f568-4fcd-4cbd-91de-5de7506d4e45,min_disk=0,min_ram=0,name='',owner='95489250f7f04abc88782c23d16784df',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:45:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/sda', 'encrypted': False, 'encryption_format': None, 'image_id': '4c69f568-4fcd-4cbd-91de-5de7506d4e45'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:45:26 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:45:26 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.210s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] No VIF found with MAC fa:16:3e:83:d0:33, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:45:10Z,direct_url=<?>,disk_format='qcow2',id=4c69f568-4fcd-4cbd-91de-5de7506d4e45,min_disk=0,min_ram=0,name='',owner='95489250f7f04abc88782c23d16784df',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:45:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-120544087',display_name='tempest-AttachSCSIVolumeTestJSON-server-120544087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-120544087',id=3,image_ref='4c69f568-4fcd-4cbd-91de-5de7506d4e45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKaLehSH9hVxHcAYqtw2ruweM2okxfxi1ysC+IfTtUqa1RmtHJItept+V0x0jPvVR+LmxMTmlO+qhtBdolBFw9K0DvbmFwwZogTJdnTHx40sXaPZKLeQE32vn2w8ebRCw==',key_name='tempest-keypair-1801166116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='259cfb8159bd4a3bb97eafcd7ddbfa29',ramdisk_id='',reservation_id='r-50y9m384',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4c69f568-4fcd-4cbd-91de-5de7506d4e45',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1734207431',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1734207431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:45:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f115dc3b880454c9261803ea3832e23',uuid=03fc42b1-f33d-4930-ba65-22540584b7fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "address": "fa:16:3e:ae:6b:5f", "network": {"id": "f9f76ffd-5958-4a0b-b374-47e53fc2c74c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-415651663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259cfb8159bd4a3bb97eafcd7ddbfa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11177e3-e8", "ovs_interfaceid": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Converting VIF {"id": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "address": "fa:16:3e:ae:6b:5f", "network": {"id": "f9f76ffd-5958-4a0b-b374-47e53fc2c74c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-415651663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259cfb8159bd4a3bb97eafcd7ddbfa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11177e3-e8", "ovs_interfaceid": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:6b:5f,bridge_name='br-int',has_traffic_filtering=True,id=f11177e3-e8db-464f-b8be-971cb3afcdf8,network=Network(f9f76ffd-5958-4a0b-b374-47e53fc2c74c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11177e3-e8') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.objects.instance [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lazy-loading 'pci_devices' on Instance uuid 03fc42b1-f33d-4930-ba65-22540584b7fe {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:45:26 user nova-compute[72782]:   <uuid>03fc42b1-f33d-4930-ba65-22540584b7fe</uuid>
Aug 14 19:45:26 user nova-compute[72782]:   <name>instance-00000003</name>
Aug 14 19:45:26 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:45:26 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:45:26 user nova-compute[72782]:   <metadata>
Aug 14 19:45:26 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:45:26 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:45:26 user nova-compute[72782]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-120544087</nova:name>
Aug 14 19:45:26 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:45:26</nova:creationTime>
Aug 14 19:45:26 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:45:26 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:45:26 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:45:26 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:45:26 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:45:26 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:45:26 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:45:26 user nova-compute[72782]:       <nova:owner>
Aug 14 19:45:26 user nova-compute[72782]:         <nova:user uuid="1f115dc3b880454c9261803ea3832e23">tempest-AttachSCSIVolumeTestJSON-1734207431-project-member</nova:user>
Aug 14 19:45:26 user nova-compute[72782]:         <nova:project uuid="259cfb8159bd4a3bb97eafcd7ddbfa29">tempest-AttachSCSIVolumeTestJSON-1734207431</nova:project>
Aug 14 19:45:26 user nova-compute[72782]:       </nova:owner>
Aug 14 19:45:26 user nova-compute[72782]:       <nova:root type="image" uuid="4c69f568-4fcd-4cbd-91de-5de7506d4e45"/>
Aug 14 19:45:26 user nova-compute[72782]:       <nova:ports>
Aug 14 19:45:26 user nova-compute[72782]:         <nova:port uuid="f11177e3-e8db-464f-b8be-971cb3afcdf8">
Aug 14 19:45:26 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 19:45:26 user nova-compute[72782]:         </nova:port>
Aug 14 19:45:26 user nova-compute[72782]:       </nova:ports>
Aug 14 19:45:26 user nova-compute[72782]:     </nova:instance>
Aug 14 19:45:26 user nova-compute[72782]:   </metadata>
Aug 14 19:45:26 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:45:26 user nova-compute[72782]:     <system>
Aug 14 19:45:26 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:45:26 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:45:26 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:45:26 user nova-compute[72782]:       <entry name="serial">03fc42b1-f33d-4930-ba65-22540584b7fe</entry>
Aug 14 19:45:26 user nova-compute[72782]:       <entry name="uuid">03fc42b1-f33d-4930-ba65-22540584b7fe</entry>
Aug 14 19:45:26 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:45:26 user nova-compute[72782]:     </system>
Aug 14 19:45:26 user nova-compute[72782]:   </sysinfo>
Aug 14 19:45:26 user nova-compute[72782]:   <os>
Aug 14 19:45:26 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:45:26 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:45:26 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:45:26 user nova-compute[72782]:   </os>
Aug 14 19:45:26 user nova-compute[72782]:   <features>
Aug 14 19:45:26 user nova-compute[72782]:     <acpi/>
Aug 14 19:45:26 user nova-compute[72782]:     <apic/>
Aug 14 19:45:26 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:45:26 user nova-compute[72782]:   </features>
Aug 14 19:45:26 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:45:26 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:45:26 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:45:26 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:45:26 user nova-compute[72782]:   </clock>
Aug 14 19:45:26 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:45:26 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:45:26 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:45:26 user nova-compute[72782]:   </cpu>
Aug 14 19:45:26 user nova-compute[72782]:   <devices>
Aug 14 19:45:26 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:45:26 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:45:26 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk"/>
Aug 14 19:45:26 user nova-compute[72782]:       <target dev="sda" bus="scsi"/>
Aug 14 19:45:26 user nova-compute[72782]:       <address type="drive" controller="0" unit="0"/>
Aug 14 19:45:26 user nova-compute[72782]:     </disk>
Aug 14 19:45:26 user nova-compute[72782]:     <disk type="file" device="cdrom">
Aug 14 19:45:26 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 19:45:26 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk.config"/>
Aug 14 19:45:26 user nova-compute[72782]:       <target dev="sdb" bus="scsi"/>
Aug 14 19:45:26 user nova-compute[72782]:       <address type="drive" controller="0" unit="1"/>
Aug 14 19:45:26 user nova-compute[72782]:     </disk>
Aug 14 19:45:26 user nova-compute[72782]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 14 19:45:26 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:45:26 user nova-compute[72782]:       <mac address="fa:16:3e:ae:6b:5f"/>
Aug 14 19:45:26 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:45:26 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:45:26 user nova-compute[72782]:       <target dev="tapf11177e3-e8"/>
Aug 14 19:45:26 user nova-compute[72782]:     </interface>
Aug 14 19:45:26 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:45:26 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/console.log" append="off"/>
Aug 14 19:45:26 user nova-compute[72782]:     </serial>
Aug 14 19:45:26 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:45:26 user nova-compute[72782]:     <video>
Aug 14 19:45:26 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:45:26 user nova-compute[72782]:     </video>
Aug 14 19:45:26 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:45:26 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:45:26 user nova-compute[72782]:     </rng>
Aug 14 19:45:26 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:45:26 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:45:26 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:45:26 user nova-compute[72782]:     </memballoon>
Aug 14 19:45:26 user nova-compute[72782]:   </devices>
Aug 14 19:45:26 user nova-compute[72782]: </domain>
Aug 14 19:45:26 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-120544087',display_name='tempest-AttachSCSIVolumeTestJSON-server-120544087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-120544087',id=3,image_ref='4c69f568-4fcd-4cbd-91de-5de7506d4e45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKaLehSH9hVxHcAYqtw2ruweM2okxfxi1ysC+IfTtUqa1RmtHJItept+V0x0jPvVR+LmxMTmlO+qhtBdolBFw9K0DvbmFwwZogTJdnTHx40sXaPZKLeQE32vn2w8ebRCw==',key_name='tempest-keypair-1801166116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='259cfb8159bd4a3bb97eafcd7ddbfa29',ramdisk_id='',reservation_id='r-50y9m384',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4c69f568-4fcd-4cbd-91de-5de7506d4e45',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1734207431',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1734207431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:45:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f115dc3b880454c9261803ea3832e23',uuid=03fc42b1-f33d-4930-ba65-22540584b7fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "address": "fa:16:3e:ae:6b:5f", "network": {"id": "f9f76ffd-5958-4a0b-b374-47e53fc2c74c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-415651663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259cfb8159bd4a3bb97eafcd7ddbfa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11177e3-e8", "ovs_interfaceid": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Converting VIF {"id": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "address": "fa:16:3e:ae:6b:5f", "network": {"id": "f9f76ffd-5958-4a0b-b374-47e53fc2c74c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-415651663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259cfb8159bd4a3bb97eafcd7ddbfa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11177e3-e8", "ovs_interfaceid": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:6b:5f,bridge_name='br-int',has_traffic_filtering=True,id=f11177e3-e8db-464f-b8be-971cb3afcdf8,network=Network(f9f76ffd-5958-4a0b-b374-47e53fc2c74c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11177e3-e8') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG os_vif [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:6b:5f,bridge_name='br-int',has_traffic_filtering=True,id=f11177e3-e8db-464f-b8be-971cb3afcdf8,network=Network(f9f76ffd-5958-4a0b-b374-47e53fc2c74c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11177e3-e8') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf11177e3-e8, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf11177e3-e8, col_values=(('external_ids', {'iface-id': 'f11177e3-e8db-464f-b8be-971cb3afcdf8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:6b:5f', 'vm-uuid': '03fc42b1-f33d-4930-ba65-22540584b7fe'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:26 user nova-compute[72782]: INFO os_vif [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:6b:5f,bridge_name='br-int',has_traffic_filtering=True,id=f11177e3-e8db-464f-b8be-971cb3afcdf8,network=Network(f9f76ffd-5958-4a0b-b374-47e53fc2c74c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11177e3-e8')
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.209s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk 1073741824" returned: 0 in 0.074s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] No BDM found with device name sda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] No VIF found with MAC fa:16:3e:ae:6b:5f, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:45:26 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Using config drive
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.209s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.830s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Cannot resize image /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lazy-loading 'migration_context' on Instance uuid 5d532038-555f-42d3-b35a-9e6f0350b023 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Ensure instance console log exists: /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:45:27 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:45:27 user nova-compute[72782]: DEBUG nova.network.neutron [req-4f96bfab-43ab-4037-a21b-071571eaca48 req-74a4ba72-df83-4b7b-ab85-ae70598325b9 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Updated VIF entry in instance network info cache for port f11177e3-e8db-464f-b8be-971cb3afcdf8. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG nova.network.neutron [req-4f96bfab-43ab-4037-a21b-071571eaca48 req-74a4ba72-df83-4b7b-ab85-ae70598325b9 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Updating instance_info_cache with network_info: [{"id": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "address": "fa:16:3e:ae:6b:5f", "network": {"id": "f9f76ffd-5958-4a0b-b374-47e53fc2c74c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-415651663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259cfb8159bd4a3bb97eafcd7ddbfa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11177e3-e8", "ovs_interfaceid": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:45:27 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Creating config drive at /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk.config
Aug 14 19:45:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9l5ucuqv {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4f96bfab-43ab-4037-a21b-071571eaca48 req-74a4ba72-df83-4b7b-ab85-ae70598325b9 service nova] Releasing lock "refresh_cache-03fc42b1-f33d-4930-ba65-22540584b7fe" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9l5ucuqv" returned: 0 in 0.062s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Successfully created port: 1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG nova.policy [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56e463c57d63481ca33d5b9a94362ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a94fb20b4e2489987bc77c5e1e5bb00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:45:27 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Creating image(s)
Aug 14 19:45:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Acquiring lock "/opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lock "/opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lock "/opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG nova.network.neutron [req-bad55d59-7461-4d63-84b0-aeebcc14bb1b req-3e6570d3-6d1a-4f6e-bad8-bd1d9892fbc0 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Updated VIF entry in instance network info cache for port 888a72be-5707-4d58-98e1-b472c928de22. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG nova.network.neutron [req-bad55d59-7461-4d63-84b0-aeebcc14bb1b req-3e6570d3-6d1a-4f6e-bad8-bd1d9892fbc0 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Updating instance_info_cache with network_info: [{"id": "888a72be-5707-4d58-98e1-b472c928de22", "address": "fa:16:3e:83:d0:33", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888a72be-57", "ovs_interfaceid": "888a72be-5707-4d58-98e1-b472c928de22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bad55d59-7461-4d63-84b0-aeebcc14bb1b req-3e6570d3-6d1a-4f6e-bad8-bd1d9892fbc0 service nova] Releasing lock "refresh_cache-b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.197s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.203s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk 1073741824" returned: 0 in 0.059s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.209s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Cannot resize image /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG nova.objects.instance [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lazy-loading 'migration_context' on Instance uuid 04969095-d5d4-4581-bb3e-df44e21d33d6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Ensure instance console log exists: /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG nova.compute.manager [req-e273c6cf-6a31-4fd7-b8e5-f0f46f7fdcc3 req-df06a23e-adb0-422c-ae49-473887105ff9 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Received event network-vif-plugged-888a72be-5707-4d58-98e1-b472c928de22 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e273c6cf-6a31-4fd7-b8e5-f0f46f7fdcc3 req-df06a23e-adb0-422c-ae49-473887105ff9 service nova] Acquiring lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e273c6cf-6a31-4fd7-b8e5-f0f46f7fdcc3 req-df06a23e-adb0-422c-ae49-473887105ff9 service nova] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e273c6cf-6a31-4fd7-b8e5-f0f46f7fdcc3 req-df06a23e-adb0-422c-ae49-473887105ff9 service nova] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG nova.compute.manager [req-e273c6cf-6a31-4fd7-b8e5-f0f46f7fdcc3 req-df06a23e-adb0-422c-ae49-473887105ff9 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] No waiting events found dispatching network-vif-plugged-888a72be-5707-4d58-98e1-b472c928de22 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:45:28 user nova-compute[72782]: WARNING nova.compute.manager [req-e273c6cf-6a31-4fd7-b8e5-f0f46f7fdcc3 req-df06a23e-adb0-422c-ae49-473887105ff9 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Received unexpected event network-vif-plugged-888a72be-5707-4d58-98e1-b472c928de22 for instance with vm_state building and task_state spawning.
Aug 14 19:45:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:29 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Successfully created port: 4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:45:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:29 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Successfully updated port: 1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:45:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "refresh_cache-5d532038-555f-42d3-b35a-9e6f0350b023" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:45:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquired lock "refresh_cache-5d532038-555f-42d3-b35a-9e6f0350b023" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:45:29 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:45:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-c56821a9-368c-40ce-a382-bf70aa8db282 req-16aab1fa-a00d-48c1-b6a0-b28366162b25 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received event network-changed-1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-c56821a9-368c-40ce-a382-bf70aa8db282 req-16aab1fa-a00d-48c1-b6a0-b28366162b25 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Refreshing instance network info cache due to event network-changed-1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:45:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c56821a9-368c-40ce-a382-bf70aa8db282 req-16aab1fa-a00d-48c1-b6a0-b28366162b25 service nova] Acquiring lock "refresh_cache-5d532038-555f-42d3-b35a-9e6f0350b023" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.compute.manager [req-f24507c8-0fcc-47c3-9f42-a21854177731 req-23cd07d8-2ba0-4225-b96a-426a336fc4e0 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Received event network-vif-plugged-888a72be-5707-4d58-98e1-b472c928de22 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f24507c8-0fcc-47c3-9f42-a21854177731 req-23cd07d8-2ba0-4225-b96a-426a336fc4e0 service nova] Acquiring lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f24507c8-0fcc-47c3-9f42-a21854177731 req-23cd07d8-2ba0-4225-b96a-426a336fc4e0 service nova] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f24507c8-0fcc-47c3-9f42-a21854177731 req-23cd07d8-2ba0-4225-b96a-426a336fc4e0 service nova] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.compute.manager [req-f24507c8-0fcc-47c3-9f42-a21854177731 req-23cd07d8-2ba0-4225-b96a-426a336fc4e0 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] No waiting events found dispatching network-vif-plugged-888a72be-5707-4d58-98e1-b472c928de22 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:45:30 user nova-compute[72782]: WARNING nova.compute.manager [req-f24507c8-0fcc-47c3-9f42-a21854177731 req-23cd07d8-2ba0-4225-b96a-426a336fc4e0 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Received unexpected event network-vif-plugged-888a72be-5707-4d58-98e1-b472c928de22 for instance with vm_state building and task_state spawning.
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.compute.manager [req-f24507c8-0fcc-47c3-9f42-a21854177731 req-23cd07d8-2ba0-4225-b96a-426a336fc4e0 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Received event network-vif-plugged-f11177e3-e8db-464f-b8be-971cb3afcdf8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f24507c8-0fcc-47c3-9f42-a21854177731 req-23cd07d8-2ba0-4225-b96a-426a336fc4e0 service nova] Acquiring lock "03fc42b1-f33d-4930-ba65-22540584b7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f24507c8-0fcc-47c3-9f42-a21854177731 req-23cd07d8-2ba0-4225-b96a-426a336fc4e0 service nova] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f24507c8-0fcc-47c3-9f42-a21854177731 req-23cd07d8-2ba0-4225-b96a-426a336fc4e0 service nova] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.compute.manager [req-f24507c8-0fcc-47c3-9f42-a21854177731 req-23cd07d8-2ba0-4225-b96a-426a336fc4e0 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] No waiting events found dispatching network-vif-plugged-f11177e3-e8db-464f-b8be-971cb3afcdf8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:45:30 user nova-compute[72782]: WARNING nova.compute.manager [req-f24507c8-0fcc-47c3-9f42-a21854177731 req-23cd07d8-2ba0-4225-b96a-426a336fc4e0 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Received unexpected event network-vif-plugged-f11177e3-e8db-464f-b8be-971cb3afcdf8 for instance with vm_state building and task_state spawning.
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.compute.manager [req-f24507c8-0fcc-47c3-9f42-a21854177731 req-23cd07d8-2ba0-4225-b96a-426a336fc4e0 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Received event network-vif-plugged-f11177e3-e8db-464f-b8be-971cb3afcdf8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f24507c8-0fcc-47c3-9f42-a21854177731 req-23cd07d8-2ba0-4225-b96a-426a336fc4e0 service nova] Acquiring lock "03fc42b1-f33d-4930-ba65-22540584b7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f24507c8-0fcc-47c3-9f42-a21854177731 req-23cd07d8-2ba0-4225-b96a-426a336fc4e0 service nova] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f24507c8-0fcc-47c3-9f42-a21854177731 req-23cd07d8-2ba0-4225-b96a-426a336fc4e0 service nova] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.compute.manager [req-f24507c8-0fcc-47c3-9f42-a21854177731 req-23cd07d8-2ba0-4225-b96a-426a336fc4e0 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] No waiting events found dispatching network-vif-plugged-f11177e3-e8db-464f-b8be-971cb3afcdf8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:45:30 user nova-compute[72782]: WARNING nova.compute.manager [req-f24507c8-0fcc-47c3-9f42-a21854177731 req-23cd07d8-2ba0-4225-b96a-426a336fc4e0 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Received unexpected event network-vif-plugged-f11177e3-e8db-464f-b8be-971cb3afcdf8 for instance with vm_state building and task_state spawning.
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Updating instance_info_cache with network_info: [{"id": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "address": "fa:16:3e:0c:34:c8", "network": {"id": "6e75566e-5f3a-4d09-97c7-580d9c7c8db1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2064496785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec76c6a-a5", "ovs_interfaceid": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Releasing lock "refresh_cache-5d532038-555f-42d3-b35a-9e6f0350b023" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Instance network_info: |[{"id": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "address": "fa:16:3e:0c:34:c8", "network": {"id": "6e75566e-5f3a-4d09-97c7-580d9c7c8db1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2064496785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec76c6a-a5", "ovs_interfaceid": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c56821a9-368c-40ce-a382-bf70aa8db282 req-16aab1fa-a00d-48c1-b6a0-b28366162b25 service nova] Acquired lock "refresh_cache-5d532038-555f-42d3-b35a-9e6f0350b023" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.network.neutron [req-c56821a9-368c-40ce-a382-bf70aa8db282 req-16aab1fa-a00d-48c1-b6a0-b28366162b25 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Refreshing network info cache for port 1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Start _get_guest_xml network_info=[{"id": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "address": "fa:16:3e:0c:34:c8", "network": {"id": "6e75566e-5f3a-4d09-97c7-580d9c7c8db1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2064496785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec76c6a-a5", "ovs_interfaceid": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:45:30 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:45:30 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205293026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205293026',id=5,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBUAZVMa4gIP2YmvcmOx5iou8wFV659Y2z9FXeRWhphzcOnzkYKBYpe1JczET+ExPwbJu9nwpHcQhAkzlPTFrALtNgdc28pKtERMGb/9tfusWIUd9XgIsvq2vJiC3QUAw==',key_name='tempest-keypair-190172691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4de6c5ad7cf54432b6e2704cd3c0201c',ramdisk_id='',reservation_id='r-py4qploq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2072296078',owner_user_name='tempest-TaggedAttachmentsTest-2072296078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:45:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5283c6441c04ba497e3c89403bb2d87',uuid=5d532038-555f-42d3-b35a-9e6f0350b023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "address": "fa:16:3e:0c:34:c8", "network": {"id": "6e75566e-5f3a-4d09-97c7-580d9c7c8db1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2064496785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec76c6a-a5", "ovs_interfaceid": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Converting VIF {"id": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "address": "fa:16:3e:0c:34:c8", "network": {"id": "6e75566e-5f3a-4d09-97c7-580d9c7c8db1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2064496785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec76c6a-a5", "ovs_interfaceid": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:34:c8,bridge_name='br-int',has_traffic_filtering=True,id=1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e,network=Network(6e75566e-5f3a-4d09-97c7-580d9c7c8db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec76c6a-a5') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d532038-555f-42d3-b35a-9e6f0350b023 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:45:30 user nova-compute[72782]:   <uuid>5d532038-555f-42d3-b35a-9e6f0350b023</uuid>
Aug 14 19:45:30 user nova-compute[72782]:   <name>instance-00000005</name>
Aug 14 19:45:30 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:45:30 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:45:30 user nova-compute[72782]:   <metadata>
Aug 14 19:45:30 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:45:30 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:45:30 user nova-compute[72782]:       <nova:name>tempest-device-tagging-server-205293026</nova:name>
Aug 14 19:45:30 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:45:30</nova:creationTime>
Aug 14 19:45:30 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:45:30 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:45:30 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:45:30 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:45:30 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:45:30 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:45:30 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:45:30 user nova-compute[72782]:       <nova:owner>
Aug 14 19:45:30 user nova-compute[72782]:         <nova:user uuid="c5283c6441c04ba497e3c89403bb2d87">tempest-TaggedAttachmentsTest-2072296078-project-member</nova:user>
Aug 14 19:45:30 user nova-compute[72782]:         <nova:project uuid="4de6c5ad7cf54432b6e2704cd3c0201c">tempest-TaggedAttachmentsTest-2072296078</nova:project>
Aug 14 19:45:30 user nova-compute[72782]:       </nova:owner>
Aug 14 19:45:30 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:45:30 user nova-compute[72782]:       <nova:ports>
Aug 14 19:45:30 user nova-compute[72782]:         <nova:port uuid="1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e">
Aug 14 19:45:30 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 19:45:30 user nova-compute[72782]:         </nova:port>
Aug 14 19:45:30 user nova-compute[72782]:       </nova:ports>
Aug 14 19:45:30 user nova-compute[72782]:     </nova:instance>
Aug 14 19:45:30 user nova-compute[72782]:   </metadata>
Aug 14 19:45:30 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:45:30 user nova-compute[72782]:     <system>
Aug 14 19:45:30 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:45:30 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:45:30 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:45:30 user nova-compute[72782]:       <entry name="serial">5d532038-555f-42d3-b35a-9e6f0350b023</entry>
Aug 14 19:45:30 user nova-compute[72782]:       <entry name="uuid">5d532038-555f-42d3-b35a-9e6f0350b023</entry>
Aug 14 19:45:30 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:45:30 user nova-compute[72782]:     </system>
Aug 14 19:45:30 user nova-compute[72782]:   </sysinfo>
Aug 14 19:45:30 user nova-compute[72782]:   <os>
Aug 14 19:45:30 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:45:30 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:45:30 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:45:30 user nova-compute[72782]:   </os>
Aug 14 19:45:30 user nova-compute[72782]:   <features>
Aug 14 19:45:30 user nova-compute[72782]:     <acpi/>
Aug 14 19:45:30 user nova-compute[72782]:     <apic/>
Aug 14 19:45:30 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:45:30 user nova-compute[72782]:   </features>
Aug 14 19:45:30 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:45:30 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:45:30 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:45:30 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:45:30 user nova-compute[72782]:   </clock>
Aug 14 19:45:30 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:45:30 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:45:30 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:45:30 user nova-compute[72782]:   </cpu>
Aug 14 19:45:30 user nova-compute[72782]:   <devices>
Aug 14 19:45:30 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:45:30 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:45:30 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk"/>
Aug 14 19:45:30 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:45:30 user nova-compute[72782]:     </disk>
Aug 14 19:45:30 user nova-compute[72782]:     <disk type="file" device="cdrom">
Aug 14 19:45:30 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 19:45:30 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk.config"/>
Aug 14 19:45:30 user nova-compute[72782]:       <target dev="hda" bus="ide"/>
Aug 14 19:45:30 user nova-compute[72782]:     </disk>
Aug 14 19:45:30 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:45:30 user nova-compute[72782]:       <mac address="fa:16:3e:0c:34:c8"/>
Aug 14 19:45:30 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:45:30 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:45:30 user nova-compute[72782]:       <target dev="tap1ec76c6a-a5"/>
Aug 14 19:45:30 user nova-compute[72782]:     </interface>
Aug 14 19:45:30 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:45:30 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/console.log" append="off"/>
Aug 14 19:45:30 user nova-compute[72782]:     </serial>
Aug 14 19:45:30 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:45:30 user nova-compute[72782]:     <video>
Aug 14 19:45:30 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:45:30 user nova-compute[72782]:     </video>
Aug 14 19:45:30 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:45:30 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:45:30 user nova-compute[72782]:     </rng>
Aug 14 19:45:30 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:45:30 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:45:30 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:45:30 user nova-compute[72782]:     </memballoon>
Aug 14 19:45:30 user nova-compute[72782]:   </devices>
Aug 14 19:45:30 user nova-compute[72782]: </domain>
Aug 14 19:45:30 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205293026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205293026',id=5,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBUAZVMa4gIP2YmvcmOx5iou8wFV659Y2z9FXeRWhphzcOnzkYKBYpe1JczET+ExPwbJu9nwpHcQhAkzlPTFrALtNgdc28pKtERMGb/9tfusWIUd9XgIsvq2vJiC3QUAw==',key_name='tempest-keypair-190172691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4de6c5ad7cf54432b6e2704cd3c0201c',ramdisk_id='',reservation_id='r-py4qploq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2072296078',owner_user_name='tempest-TaggedAttachmentsTest-2072296078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:45:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5283c6441c04ba497e3c89403bb2d87',uuid=5d532038-555f-42d3-b35a-9e6f0350b023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "address": "fa:16:3e:0c:34:c8", "network": {"id": "6e75566e-5f3a-4d09-97c7-580d9c7c8db1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2064496785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec76c6a-a5", "ovs_interfaceid": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Converting VIF {"id": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "address": "fa:16:3e:0c:34:c8", "network": {"id": "6e75566e-5f3a-4d09-97c7-580d9c7c8db1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2064496785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec76c6a-a5", "ovs_interfaceid": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:34:c8,bridge_name='br-int',has_traffic_filtering=True,id=1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e,network=Network(6e75566e-5f3a-4d09-97c7-580d9c7c8db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec76c6a-a5') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG os_vif [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:34:c8,bridge_name='br-int',has_traffic_filtering=True,id=1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e,network=Network(6e75566e-5f3a-4d09-97c7-580d9c7c8db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec76c6a-a5') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ec76c6a-a5, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ec76c6a-a5, col_values=(('external_ids', {'iface-id': '1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:34:c8', 'vm-uuid': '5d532038-555f-42d3-b35a-9e6f0350b023'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:45:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:30 user nova-compute[72782]: INFO os_vif [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:34:c8,bridge_name='br-int',has_traffic_filtering=True,id=1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e,network=Network(6e75566e-5f3a-4d09-97c7-580d9c7c8db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec76c6a-a5')
Aug 14 19:45:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:45:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] No BDM found with device name hda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:45:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] No VIF found with MAC fa:16:3e:0c:34:c8, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:45:31 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Using config drive
Aug 14 19:45:31 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Creating config drive at /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk.config
Aug 14 19:45:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp91javxw4 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp91javxw4" returned: 0 in 0.057s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Successfully updated port: 4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Acquiring lock "refresh_cache-04969095-d5d4-4581-bb3e-df44e21d33d6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Acquired lock "refresh_cache-04969095-d5d4-4581-bb3e-df44e21d33d6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.compute.manager [req-4e1828f4-9735-4d70-9f86-85713337f4e8 req-b122ce85-9aed-4ab3-9aa6-a477fd150d0d service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Received event network-changed-4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.compute.manager [req-4e1828f4-9735-4d70-9f86-85713337f4e8 req-b122ce85-9aed-4ab3-9aa6-a477fd150d0d service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Refreshing instance network info cache due to event network-changed-4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4e1828f4-9735-4d70-9f86-85713337f4e8 req-b122ce85-9aed-4ab3-9aa6-a477fd150d0d service nova] Acquiring lock "refresh_cache-04969095-d5d4-4581-bb3e-df44e21d33d6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042332.2429826, 03fc42b1-f33d-4930-ba65-22540584b7fe => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:45:32 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] VM Resumed (Lifecycle Event)
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:32 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Instance spawned successfully.
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:45:32 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Instance spawned successfully.
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:32 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042332.2518263, 03fc42b1-f33d-4930-ba65-22540584b7fe => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:45:32 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] VM Started (Lifecycle Event)
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:45:32 user nova-compute[72782]: INFO nova.compute.manager [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Took 12.99 seconds to spawn the instance on the hypervisor.
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:32 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042332.2576048, b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:45:32 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] VM Resumed (Lifecycle Event)
Aug 14 19:45:32 user nova-compute[72782]: INFO nova.compute.manager [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Took 11.60 seconds to spawn the instance on the hypervisor.
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:45:32 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042332.2576847, b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:45:32 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] VM Started (Lifecycle Event)
Aug 14 19:45:32 user nova-compute[72782]: INFO nova.compute.manager [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Took 13.94 seconds to build instance.
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:32 user nova-compute[72782]: INFO nova.compute.manager [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Took 14.10 seconds to build instance.
Aug 14 19:45:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8ce0010b-7b2a-4156-9cee-c645bb04f20b tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.357s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7758fe24-19ef-4e9a-ac00-5161d18d26eb tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.252s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.network.neutron [req-c56821a9-368c-40ce-a382-bf70aa8db282 req-16aab1fa-a00d-48c1-b6a0-b28366162b25 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Updated VIF entry in instance network info cache for port 1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.network.neutron [req-c56821a9-368c-40ce-a382-bf70aa8db282 req-16aab1fa-a00d-48c1-b6a0-b28366162b25 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Updating instance_info_cache with network_info: [{"id": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "address": "fa:16:3e:0c:34:c8", "network": {"id": "6e75566e-5f3a-4d09-97c7-580d9c7c8db1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2064496785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec76c6a-a5", "ovs_interfaceid": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c56821a9-368c-40ce-a382-bf70aa8db282 req-16aab1fa-a00d-48c1-b6a0-b28366162b25 service nova] Releasing lock "refresh_cache-5d532038-555f-42d3-b35a-9e6f0350b023" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.compute.manager [req-7086a6e0-edaa-4940-bfc0-7224593233d6 req-d230cc7f-fd1b-4bcc-a434-f7888d6288e6 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received event network-vif-plugged-1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7086a6e0-edaa-4940-bfc0-7224593233d6 req-d230cc7f-fd1b-4bcc-a434-f7888d6288e6 service nova] Acquiring lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7086a6e0-edaa-4940-bfc0-7224593233d6 req-d230cc7f-fd1b-4bcc-a434-f7888d6288e6 service nova] Lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7086a6e0-edaa-4940-bfc0-7224593233d6 req-d230cc7f-fd1b-4bcc-a434-f7888d6288e6 service nova] Lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.compute.manager [req-7086a6e0-edaa-4940-bfc0-7224593233d6 req-d230cc7f-fd1b-4bcc-a434-f7888d6288e6 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] No waiting events found dispatching network-vif-plugged-1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:45:33 user nova-compute[72782]: WARNING nova.compute.manager [req-7086a6e0-edaa-4940-bfc0-7224593233d6 req-d230cc7f-fd1b-4bcc-a434-f7888d6288e6 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received unexpected event network-vif-plugged-1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e for instance with vm_state building and task_state spawning.
Aug 14 19:45:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Updating instance_info_cache with network_info: [{"id": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "address": "fa:16:3e:ac:8b:14", "network": {"id": "b106d629-341a-464c-abfc-c9d9fbd4105f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-208648938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a94fb20b4e2489987bc77c5e1e5bb00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccbc9f5-29", "ovs_interfaceid": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Releasing lock "refresh_cache-04969095-d5d4-4581-bb3e-df44e21d33d6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Instance network_info: |[{"id": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "address": "fa:16:3e:ac:8b:14", "network": {"id": "b106d629-341a-464c-abfc-c9d9fbd4105f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-208648938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a94fb20b4e2489987bc77c5e1e5bb00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccbc9f5-29", "ovs_interfaceid": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4e1828f4-9735-4d70-9f86-85713337f4e8 req-b122ce85-9aed-4ab3-9aa6-a477fd150d0d service nova] Acquired lock "refresh_cache-04969095-d5d4-4581-bb3e-df44e21d33d6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.network.neutron [req-4e1828f4-9735-4d70-9f86-85713337f4e8 req-b122ce85-9aed-4ab3-9aa6-a477fd150d0d service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Refreshing network info cache for port 4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Start _get_guest_xml network_info=[{"id": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "address": "fa:16:3e:ac:8b:14", "network": {"id": "b106d629-341a-464c-abfc-c9d9fbd4105f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-208648938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a94fb20b4e2489987bc77c5e1e5bb00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccbc9f5-29", "ovs_interfaceid": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:33 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:45:33 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-569501847',display_name='tempest-VolumesAssistedSnapshotsTest-server-569501847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-569501847',id=6,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1V7dhIA/ejhdC/cA3Eqkg9ufttwNTvIY8TNM3tVem9xv9msNzew8DlaAbAfZWENqaowec7lkjIxMcgNA/QJpl3IcV40NN3J25SO7w89D19ziCBktXSj6JAcHVfGqonLQ==',key_name='tempest-keypair-883895863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a94fb20b4e2489987bc77c5e1e5bb00',ramdisk_id='',reservation_id='r-3trfk3s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1508355202',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1508355202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56e463c57d63481ca33d5b9a94362ae5',uuid=04969095-d5d4-4581-bb3e-df44e21d33d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "address": "fa:16:3e:ac:8b:14", "network": {"id": "b106d629-341a-464c-abfc-c9d9fbd4105f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-208648938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a94fb20b4e2489987bc77c5e1e5bb00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccbc9f5-29", "ovs_interfaceid": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:45:33 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Converting VIF {"id": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "address": "fa:16:3e:ac:8b:14", "network": {"id": "b106d629-341a-464c-abfc-c9d9fbd4105f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-208648938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a94fb20b4e2489987bc77c5e1e5bb00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccbc9f5-29", "ovs_interfaceid": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:8b:14,bridge_name='br-int',has_traffic_filtering=True,id=4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226,network=Network(b106d629-341a-464c-abfc-c9d9fbd4105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccbc9f5-29') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG nova.objects.instance [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lazy-loading 'pci_devices' on Instance uuid 04969095-d5d4-4581-bb3e-df44e21d33d6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:45:34 user nova-compute[72782]:   <uuid>04969095-d5d4-4581-bb3e-df44e21d33d6</uuid>
Aug 14 19:45:34 user nova-compute[72782]:   <name>instance-00000006</name>
Aug 14 19:45:34 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:45:34 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:45:34 user nova-compute[72782]:   <metadata>
Aug 14 19:45:34 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:45:34 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:45:34 user nova-compute[72782]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-569501847</nova:name>
Aug 14 19:45:34 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:45:33</nova:creationTime>
Aug 14 19:45:34 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:45:34 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:45:34 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:45:34 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:45:34 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:45:34 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:45:34 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:45:34 user nova-compute[72782]:       <nova:owner>
Aug 14 19:45:34 user nova-compute[72782]:         <nova:user uuid="56e463c57d63481ca33d5b9a94362ae5">tempest-VolumesAssistedSnapshotsTest-1508355202-project-member</nova:user>
Aug 14 19:45:34 user nova-compute[72782]:         <nova:project uuid="0a94fb20b4e2489987bc77c5e1e5bb00">tempest-VolumesAssistedSnapshotsTest-1508355202</nova:project>
Aug 14 19:45:34 user nova-compute[72782]:       </nova:owner>
Aug 14 19:45:34 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:45:34 user nova-compute[72782]:       <nova:ports>
Aug 14 19:45:34 user nova-compute[72782]:         <nova:port uuid="4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226">
Aug 14 19:45:34 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 19:45:34 user nova-compute[72782]:         </nova:port>
Aug 14 19:45:34 user nova-compute[72782]:       </nova:ports>
Aug 14 19:45:34 user nova-compute[72782]:     </nova:instance>
Aug 14 19:45:34 user nova-compute[72782]:   </metadata>
Aug 14 19:45:34 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:45:34 user nova-compute[72782]:     <system>
Aug 14 19:45:34 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:45:34 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:45:34 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:45:34 user nova-compute[72782]:       <entry name="serial">04969095-d5d4-4581-bb3e-df44e21d33d6</entry>
Aug 14 19:45:34 user nova-compute[72782]:       <entry name="uuid">04969095-d5d4-4581-bb3e-df44e21d33d6</entry>
Aug 14 19:45:34 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:45:34 user nova-compute[72782]:     </system>
Aug 14 19:45:34 user nova-compute[72782]:   </sysinfo>
Aug 14 19:45:34 user nova-compute[72782]:   <os>
Aug 14 19:45:34 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:45:34 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:45:34 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:45:34 user nova-compute[72782]:   </os>
Aug 14 19:45:34 user nova-compute[72782]:   <features>
Aug 14 19:45:34 user nova-compute[72782]:     <acpi/>
Aug 14 19:45:34 user nova-compute[72782]:     <apic/>
Aug 14 19:45:34 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:45:34 user nova-compute[72782]:   </features>
Aug 14 19:45:34 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:45:34 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:45:34 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:45:34 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:45:34 user nova-compute[72782]:   </clock>
Aug 14 19:45:34 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:45:34 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:45:34 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:45:34 user nova-compute[72782]:   </cpu>
Aug 14 19:45:34 user nova-compute[72782]:   <devices>
Aug 14 19:45:34 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:45:34 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:45:34 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk"/>
Aug 14 19:45:34 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:45:34 user nova-compute[72782]:     </disk>
Aug 14 19:45:34 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:45:34 user nova-compute[72782]:       <mac address="fa:16:3e:ac:8b:14"/>
Aug 14 19:45:34 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:45:34 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:45:34 user nova-compute[72782]:       <target dev="tap4ccbc9f5-29"/>
Aug 14 19:45:34 user nova-compute[72782]:     </interface>
Aug 14 19:45:34 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:45:34 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/console.log" append="off"/>
Aug 14 19:45:34 user nova-compute[72782]:     </serial>
Aug 14 19:45:34 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:45:34 user nova-compute[72782]:     <video>
Aug 14 19:45:34 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:45:34 user nova-compute[72782]:     </video>
Aug 14 19:45:34 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:45:34 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:45:34 user nova-compute[72782]:     </rng>
Aug 14 19:45:34 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:45:34 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:45:34 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:45:34 user nova-compute[72782]:     </memballoon>
Aug 14 19:45:34 user nova-compute[72782]:   </devices>
Aug 14 19:45:34 user nova-compute[72782]: </domain>
Aug 14 19:45:34 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-569501847',display_name='tempest-VolumesAssistedSnapshotsTest-server-569501847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-569501847',id=6,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1V7dhIA/ejhdC/cA3Eqkg9ufttwNTvIY8TNM3tVem9xv9msNzew8DlaAbAfZWENqaowec7lkjIxMcgNA/QJpl3IcV40NN3J25SO7w89D19ziCBktXSj6JAcHVfGqonLQ==',key_name='tempest-keypair-883895863',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a94fb20b4e2489987bc77c5e1e5bb00',ramdisk_id='',reservation_id='r-3trfk3s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1508355202',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1508355202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56e463c57d63481ca33d5b9a94362ae5',uuid=04969095-d5d4-4581-bb3e-df44e21d33d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "address": "fa:16:3e:ac:8b:14", "network": {"id": "b106d629-341a-464c-abfc-c9d9fbd4105f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-208648938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a94fb20b4e2489987bc77c5e1e5bb00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccbc9f5-29", "ovs_interfaceid": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Converting VIF {"id": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "address": "fa:16:3e:ac:8b:14", "network": {"id": "b106d629-341a-464c-abfc-c9d9fbd4105f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-208648938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a94fb20b4e2489987bc77c5e1e5bb00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccbc9f5-29", "ovs_interfaceid": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:8b:14,bridge_name='br-int',has_traffic_filtering=True,id=4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226,network=Network(b106d629-341a-464c-abfc-c9d9fbd4105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccbc9f5-29') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG os_vif [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:8b:14,bridge_name='br-int',has_traffic_filtering=True,id=4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226,network=Network(b106d629-341a-464c-abfc-c9d9fbd4105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccbc9f5-29') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ccbc9f5-29, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ccbc9f5-29, col_values=(('external_ids', {'iface-id': '4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:8b:14', 'vm-uuid': '04969095-d5d4-4581-bb3e-df44e21d33d6'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:34 user nova-compute[72782]: INFO os_vif [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:8b:14,bridge_name='br-int',has_traffic_filtering=True,id=4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226,network=Network(b106d629-341a-464c-abfc-c9d9fbd4105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccbc9f5-29')
Aug 14 19:45:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] No VIF found with MAC fa:16:3e:ac:8b:14, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG nova.network.neutron [req-4e1828f4-9735-4d70-9f86-85713337f4e8 req-b122ce85-9aed-4ab3-9aa6-a477fd150d0d service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Updated VIF entry in instance network info cache for port 4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG nova.network.neutron [req-4e1828f4-9735-4d70-9f86-85713337f4e8 req-b122ce85-9aed-4ab3-9aa6-a477fd150d0d service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Updating instance_info_cache with network_info: [{"id": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "address": "fa:16:3e:ac:8b:14", "network": {"id": "b106d629-341a-464c-abfc-c9d9fbd4105f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-208648938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a94fb20b4e2489987bc77c5e1e5bb00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccbc9f5-29", "ovs_interfaceid": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:45:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4e1828f4-9735-4d70-9f86-85713337f4e8 req-b122ce85-9aed-4ab3-9aa6-a477fd150d0d service nova] Releasing lock "refresh_cache-04969095-d5d4-4581-bb3e-df44e21d33d6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:45:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-a176887d-343e-46a1-a2ef-1b2ae2f332b4 req-c371e538-dfe4-469e-a919-c44307245b7e service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received event network-vif-plugged-1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a176887d-343e-46a1-a2ef-1b2ae2f332b4 req-c371e538-dfe4-469e-a919-c44307245b7e service nova] Acquiring lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a176887d-343e-46a1-a2ef-1b2ae2f332b4 req-c371e538-dfe4-469e-a919-c44307245b7e service nova] Lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a176887d-343e-46a1-a2ef-1b2ae2f332b4 req-c371e538-dfe4-469e-a919-c44307245b7e service nova] Lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-a176887d-343e-46a1-a2ef-1b2ae2f332b4 req-c371e538-dfe4-469e-a919-c44307245b7e service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] No waiting events found dispatching network-vif-plugged-1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:45:35 user nova-compute[72782]: WARNING nova.compute.manager [req-a176887d-343e-46a1-a2ef-1b2ae2f332b4 req-c371e538-dfe4-469e-a919-c44307245b7e service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received unexpected event network-vif-plugged-1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e for instance with vm_state building and task_state spawning.
Aug 14 19:45:35 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:45:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:45:35 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042335.696872, 5d532038-555f-42d3-b35a-9e6f0350b023 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:45:35 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] VM Resumed (Lifecycle Event)
Aug 14 19:45:35 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Instance spawned successfully.
Aug 14 19:45:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:45:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:35 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:35 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:45:35 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:45:35 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042335.6969712, 5d532038-555f-42d3-b35a-9e6f0350b023 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:45:35 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] VM Started (Lifecycle Event)
Aug 14 19:45:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:36 user nova-compute[72782]: INFO nova.compute.manager [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Took 10.25 seconds to spawn the instance on the hypervisor.
Aug 14 19:45:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:45:36 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:45:36 user nova-compute[72782]: INFO nova.compute.manager [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Took 11.40 seconds to build instance.
Aug 14 19:45:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c50ce33-f3ab-4e99-a8a8-7046c48b35f0 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "5d532038-555f-42d3-b35a-9e6f0350b023" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.618s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:38 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:45:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:45:38 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042338.9305792, 04969095-d5d4-4581-bb3e-df44e21d33d6 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:45:38 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] VM Resumed (Lifecycle Event)
Aug 14 19:45:38 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Instance spawned successfully.
Aug 14 19:45:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:45:38 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:38 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:45:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:39 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:45:39 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042338.9306881, 04969095-d5d4-4581-bb3e-df44e21d33d6 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:45:39 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] VM Started (Lifecycle Event)
Aug 14 19:45:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:45:39 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:45:39 user nova-compute[72782]: INFO nova.compute.manager [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Took 11.88 seconds to spawn the instance on the hypervisor.
Aug 14 19:45:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-1b6da4ea-0c4b-4822-832e-946943797981 req-956d3aab-5371-4344-bca6-37a4483c79f2 service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Received event network-vif-plugged-4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1b6da4ea-0c4b-4822-832e-946943797981 req-956d3aab-5371-4344-bca6-37a4483c79f2 service nova] Acquiring lock "04969095-d5d4-4581-bb3e-df44e21d33d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1b6da4ea-0c4b-4822-832e-946943797981 req-956d3aab-5371-4344-bca6-37a4483c79f2 service nova] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1b6da4ea-0c4b-4822-832e-946943797981 req-956d3aab-5371-4344-bca6-37a4483c79f2 service nova] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-1b6da4ea-0c4b-4822-832e-946943797981 req-956d3aab-5371-4344-bca6-37a4483c79f2 service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] No waiting events found dispatching network-vif-plugged-4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:45:39 user nova-compute[72782]: WARNING nova.compute.manager [req-1b6da4ea-0c4b-4822-832e-946943797981 req-956d3aab-5371-4344-bca6-37a4483c79f2 service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Received unexpected event network-vif-plugged-4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 for instance with vm_state building and task_state spawning.
Aug 14 19:45:39 user nova-compute[72782]: INFO nova.compute.manager [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Took 13.41 seconds to build instance.
Aug 14 19:45:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a9bd6823-201a-4e63-9563-c7bf8daebe06 tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.728s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Acquiring lock "d51b224a-5167-40bf-8d3c-8426b420458c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "d51b224a-5167-40bf-8d3c-8426b420458c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:45:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:40 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:45:40 user nova-compute[72782]: INFO nova.compute.claims [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Claim successful on node user
Aug 14 19:45:41 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.717s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG nova.network.neutron [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:45:41 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:45:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG nova.compute.manager [req-c3b702d7-072c-48b2-b6dd-ebae6af1f05b req-c8095e38-4b7e-4abe-8d1a-a2b2fbc0e5b3 service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Received event network-vif-plugged-4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c3b702d7-072c-48b2-b6dd-ebae6af1f05b req-c8095e38-4b7e-4abe-8d1a-a2b2fbc0e5b3 service nova] Acquiring lock "04969095-d5d4-4581-bb3e-df44e21d33d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c3b702d7-072c-48b2-b6dd-ebae6af1f05b req-c8095e38-4b7e-4abe-8d1a-a2b2fbc0e5b3 service nova] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c3b702d7-072c-48b2-b6dd-ebae6af1f05b req-c8095e38-4b7e-4abe-8d1a-a2b2fbc0e5b3 service nova] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG nova.compute.manager [req-c3b702d7-072c-48b2-b6dd-ebae6af1f05b req-c8095e38-4b7e-4abe-8d1a-a2b2fbc0e5b3 service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] No waiting events found dispatching network-vif-plugged-4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:45:41 user nova-compute[72782]: WARNING nova.compute.manager [req-c3b702d7-072c-48b2-b6dd-ebae6af1f05b req-c8095e38-4b7e-4abe-8d1a-a2b2fbc0e5b3 service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Received unexpected event network-vif-plugged-4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 for instance with vm_state active and task_state None.
Aug 14 19:45:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:45:41 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Creating image(s)
Aug 14 19:45:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Acquiring lock "/opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "/opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "/opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG nova.policy [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '823e33d164fc4ba48769ac612971f1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0351b1b7deb4c9da4ad0a4021ca4b4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.247s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.251s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk 1073741824" returned: 0 in 0.058s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.203s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:42 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:45:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:42 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Cannot resize image /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:45:42 user nova-compute[72782]: DEBUG nova.objects.instance [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lazy-loading 'migration_context' on Instance uuid d51b224a-5167-40bf-8d3c-8426b420458c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:45:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:45:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Ensure instance console log exists: /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:45:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:42 user nova-compute[72782]: DEBUG nova.network.neutron [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Successfully created port: 028b6a27-22aa-41b4-887c-984dc24826be {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:45:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:45:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 19:45:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] There are 0 instances to clean {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 19:45:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:45:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72782) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 19:45:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:45:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Acquiring lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:45:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:45:43 user nova-compute[72782]: INFO nova.compute.claims [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Claim successful on node user
Aug 14 19:45:43 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:45:43 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:45:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG nova.network.neutron [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:44 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:45:44 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:45:44 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Creating image(s)
Aug 14 19:45:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lock "/opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lock "/opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG nova.policy [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '309d1190683d42d5b09677deeaa0b03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a39356dc3b40e68fc1f8c2adfe31bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG nova.network.neutron [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Successfully updated port: 028b6a27-22aa-41b4-887c-984dc24826be {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Acquiring lock "refresh_cache-d51b224a-5167-40bf-8d3c-8426b420458c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Acquired lock "refresh_cache-d51b224a-5167-40bf-8d3c-8426b420458c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG nova.network.neutron [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG nova.compute.manager [req-ccf2d42c-5127-415e-9d7f-d7ca5fe9c110 req-faf796a8-c91e-45f7-82d7-05baf147418d service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Received event network-changed-028b6a27-22aa-41b4-887c-984dc24826be {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG nova.compute.manager [req-ccf2d42c-5127-415e-9d7f-d7ca5fe9c110 req-faf796a8-c91e-45f7-82d7-05baf147418d service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Refreshing instance network info cache due to event network-changed-028b6a27-22aa-41b4-887c-984dc24826be. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ccf2d42c-5127-415e-9d7f-d7ca5fe9c110 req-faf796a8-c91e-45f7-82d7-05baf147418d service nova] Acquiring lock "refresh_cache-d51b224a-5167-40bf-8d3c-8426b420458c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.267s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG nova.network.neutron [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.219s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk 1073741824" returned: 0 in 0.076s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.network.neutron [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Updating instance_info_cache with network_info: [{"id": "028b6a27-22aa-41b4-887c-984dc24826be", "address": "fa:16:3e:ac:9b:7b", "network": {"id": "05421250-9ad9-4d5a-97c0-3bcd1d423709", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1416606760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0351b1b7deb4c9da4ad0a4021ca4b4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028b6a27-22", "ovs_interfaceid": "028b6a27-22aa-41b4-887c-984dc24826be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.253s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Releasing lock "refresh_cache-d51b224a-5167-40bf-8d3c-8426b420458c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Instance network_info: |[{"id": "028b6a27-22aa-41b4-887c-984dc24826be", "address": "fa:16:3e:ac:9b:7b", "network": {"id": "05421250-9ad9-4d5a-97c0-3bcd1d423709", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1416606760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0351b1b7deb4c9da4ad0a4021ca4b4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028b6a27-22", "ovs_interfaceid": "028b6a27-22aa-41b4-887c-984dc24826be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ccf2d42c-5127-415e-9d7f-d7ca5fe9c110 req-faf796a8-c91e-45f7-82d7-05baf147418d service nova] Acquired lock "refresh_cache-d51b224a-5167-40bf-8d3c-8426b420458c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.network.neutron [req-ccf2d42c-5127-415e-9d7f-d7ca5fe9c110 req-faf796a8-c91e-45f7-82d7-05baf147418d service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Refreshing network info cache for port 028b6a27-22aa-41b4-887c-984dc24826be {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Start _get_guest_xml network_info=[{"id": "028b6a27-22aa-41b4-887c-984dc24826be", "address": "fa:16:3e:ac:9b:7b", "network": {"id": "05421250-9ad9-4d5a-97c0-3bcd1d423709", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1416606760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0351b1b7deb4c9da4ad0a4021ca4b4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028b6a27-22", "ovs_interfaceid": "028b6a27-22aa-41b4-887c-984dc24826be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 19:45:45 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:45:45 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1066984814',display_name='tempest-TestVolumeSwap-server-1066984814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1066984814',id=7,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYDWtxtIuspPTg040UMvo53oL7TfWErkeKKYI2KRNxTBRRa3TSxh9ow15Ufk4/RWPb2qaVUaeptJBcIE/gVDHdb8Yak2izUDSk626w88oFM+iuuYGaoXfDJeJAperLwEQ==',key_name='tempest-keypair-1291533056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0351b1b7deb4c9da4ad0a4021ca4b4b',ramdisk_id='',reservation_id='r-1x7s504c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1118217115',owner_user_name='tempest-TestVolumeSwap-1118217115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:45:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='823e33d164fc4ba48769ac612971f1a2',uuid=d51b224a-5167-40bf-8d3c-8426b420458c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "028b6a27-22aa-41b4-887c-984dc24826be", "address": "fa:16:3e:ac:9b:7b", "network": {"id": "05421250-9ad9-4d5a-97c0-3bcd1d423709", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1416606760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0351b1b7deb4c9da4ad0a4021ca4b4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028b6a27-22", "ovs_interfaceid": "028b6a27-22aa-41b4-887c-984dc24826be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Converting VIF {"id": "028b6a27-22aa-41b4-887c-984dc24826be", "address": "fa:16:3e:ac:9b:7b", "network": {"id": "05421250-9ad9-4d5a-97c0-3bcd1d423709", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1416606760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0351b1b7deb4c9da4ad0a4021ca4b4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028b6a27-22", "ovs_interfaceid": "028b6a27-22aa-41b4-887c-984dc24826be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=028b6a27-22aa-41b4-887c-984dc24826be,network=Network(05421250-9ad9-4d5a-97c0-3bcd1d423709),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap028b6a27-22') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.objects.instance [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lazy-loading 'pci_devices' on Instance uuid d51b224a-5167-40bf-8d3c-8426b420458c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Skipping network cache update for instance because it is Building. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Skipping network cache update for instance because it is Building. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.network.neutron [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Successfully created port: 3efffdad-bcfc-4f5d-8d72-75656b5cba62 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Cannot resize image /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.objects.instance [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lazy-loading 'migration_context' on Instance uuid ea26c664-91cb-4824-a66b-c8fe216c6ba4 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:45:45 user nova-compute[72782]:   <uuid>d51b224a-5167-40bf-8d3c-8426b420458c</uuid>
Aug 14 19:45:45 user nova-compute[72782]:   <name>instance-00000007</name>
Aug 14 19:45:45 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:45:45 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:45:45 user nova-compute[72782]:   <metadata>
Aug 14 19:45:45 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:45:45 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:45:45 user nova-compute[72782]:       <nova:name>tempest-TestVolumeSwap-server-1066984814</nova:name>
Aug 14 19:45:45 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:45:45</nova:creationTime>
Aug 14 19:45:45 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:45:45 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:45:45 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:45:45 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:45:45 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:45:45 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:45:45 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:45:45 user nova-compute[72782]:       <nova:owner>
Aug 14 19:45:45 user nova-compute[72782]:         <nova:user uuid="823e33d164fc4ba48769ac612971f1a2">tempest-TestVolumeSwap-1118217115-project-member</nova:user>
Aug 14 19:45:45 user nova-compute[72782]:         <nova:project uuid="d0351b1b7deb4c9da4ad0a4021ca4b4b">tempest-TestVolumeSwap-1118217115</nova:project>
Aug 14 19:45:45 user nova-compute[72782]:       </nova:owner>
Aug 14 19:45:45 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:45:45 user nova-compute[72782]:       <nova:ports>
Aug 14 19:45:45 user nova-compute[72782]:         <nova:port uuid="028b6a27-22aa-41b4-887c-984dc24826be">
Aug 14 19:45:45 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 19:45:45 user nova-compute[72782]:         </nova:port>
Aug 14 19:45:45 user nova-compute[72782]:       </nova:ports>
Aug 14 19:45:45 user nova-compute[72782]:     </nova:instance>
Aug 14 19:45:45 user nova-compute[72782]:   </metadata>
Aug 14 19:45:45 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:45:45 user nova-compute[72782]:     <system>
Aug 14 19:45:45 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:45:45 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:45:45 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:45:45 user nova-compute[72782]:       <entry name="serial">d51b224a-5167-40bf-8d3c-8426b420458c</entry>
Aug 14 19:45:45 user nova-compute[72782]:       <entry name="uuid">d51b224a-5167-40bf-8d3c-8426b420458c</entry>
Aug 14 19:45:45 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:45:45 user nova-compute[72782]:     </system>
Aug 14 19:45:45 user nova-compute[72782]:   </sysinfo>
Aug 14 19:45:45 user nova-compute[72782]:   <os>
Aug 14 19:45:45 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:45:45 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:45:45 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:45:45 user nova-compute[72782]:   </os>
Aug 14 19:45:45 user nova-compute[72782]:   <features>
Aug 14 19:45:45 user nova-compute[72782]:     <acpi/>
Aug 14 19:45:45 user nova-compute[72782]:     <apic/>
Aug 14 19:45:45 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:45:45 user nova-compute[72782]:   </features>
Aug 14 19:45:45 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:45:45 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:45:45 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:45:45 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:45:45 user nova-compute[72782]:   </clock>
Aug 14 19:45:45 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:45:45 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:45:45 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:45:45 user nova-compute[72782]:   </cpu>
Aug 14 19:45:45 user nova-compute[72782]:   <devices>
Aug 14 19:45:45 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:45:45 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:45:45 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk"/>
Aug 14 19:45:45 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:45:45 user nova-compute[72782]:     </disk>
Aug 14 19:45:45 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:45:45 user nova-compute[72782]:       <mac address="fa:16:3e:ac:9b:7b"/>
Aug 14 19:45:45 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:45:45 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:45:45 user nova-compute[72782]:       <target dev="tap028b6a27-22"/>
Aug 14 19:45:45 user nova-compute[72782]:     </interface>
Aug 14 19:45:45 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:45:45 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/console.log" append="off"/>
Aug 14 19:45:45 user nova-compute[72782]:     </serial>
Aug 14 19:45:45 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:45:45 user nova-compute[72782]:     <video>
Aug 14 19:45:45 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:45:45 user nova-compute[72782]:     </video>
Aug 14 19:45:45 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:45:45 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:45:45 user nova-compute[72782]:     </rng>
Aug 14 19:45:45 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:45:45 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:45:45 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:45:45 user nova-compute[72782]:     </memballoon>
Aug 14 19:45:45 user nova-compute[72782]:   </devices>
Aug 14 19:45:45 user nova-compute[72782]: </domain>
Aug 14 19:45:45 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1066984814',display_name='tempest-TestVolumeSwap-server-1066984814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1066984814',id=7,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYDWtxtIuspPTg040UMvo53oL7TfWErkeKKYI2KRNxTBRRa3TSxh9ow15Ufk4/RWPb2qaVUaeptJBcIE/gVDHdb8Yak2izUDSk626w88oFM+iuuYGaoXfDJeJAperLwEQ==',key_name='tempest-keypair-1291533056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0351b1b7deb4c9da4ad0a4021ca4b4b',ramdisk_id='',reservation_id='r-1x7s504c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1118217115',owner_user_name='tempest-TestVolumeSwap-1118217115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:45:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='823e33d164fc4ba48769ac612971f1a2',uuid=d51b224a-5167-40bf-8d3c-8426b420458c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "028b6a27-22aa-41b4-887c-984dc24826be", "address": "fa:16:3e:ac:9b:7b", "network": {"id": "05421250-9ad9-4d5a-97c0-3bcd1d423709", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1416606760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0351b1b7deb4c9da4ad0a4021ca4b4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028b6a27-22", "ovs_interfaceid": "028b6a27-22aa-41b4-887c-984dc24826be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Converting VIF {"id": "028b6a27-22aa-41b4-887c-984dc24826be", "address": "fa:16:3e:ac:9b:7b", "network": {"id": "05421250-9ad9-4d5a-97c0-3bcd1d423709", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1416606760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0351b1b7deb4c9da4ad0a4021ca4b4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028b6a27-22", "ovs_interfaceid": "028b6a27-22aa-41b4-887c-984dc24826be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=028b6a27-22aa-41b4-887c-984dc24826be,network=Network(05421250-9ad9-4d5a-97c0-3bcd1d423709),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap028b6a27-22') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG os_vif [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=028b6a27-22aa-41b4-887c-984dc24826be,network=Network(05421250-9ad9-4d5a-97c0-3bcd1d423709),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap028b6a27-22') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Ensure instance console log exists: /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap028b6a27-22, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap028b6a27-22, col_values=(('external_ids', {'iface-id': '028b6a27-22aa-41b4-887c-984dc24826be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:9b:7b', 'vm-uuid': 'd51b224a-5167-40bf-8d3c-8426b420458c'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:45 user nova-compute[72782]: INFO os_vif [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=028b6a27-22aa-41b4-887c-984dc24826be,network=Network(05421250-9ad9-4d5a-97c0-3bcd1d423709),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap028b6a27-22')
Aug 14 19:45:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-39039cef-13fa-4434-9edc-4628757cbc24" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-39039cef-13fa-4434-9edc-4628757cbc24" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 39039cef-13fa-4434-9edc-4628757cbc24 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:45:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] No VIF found with MAC fa:16:3e:ac:9b:7b, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:45:46 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Updating instance_info_cache with network_info: [{"id": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "address": "fa:16:3e:dc:6d:cf", "network": {"id": "8ddd71dc-2d52-406a-a27e-eaf3f8251435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-292261629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "366424c997cd4beaa392f8a1f3cdfa63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ab6ae5-2d", "ovs_interfaceid": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:45:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-39039cef-13fa-4434-9edc-4628757cbc24" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:45:46 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:45:46 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:45:46 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:45:46 user nova-compute[72782]: DEBUG nova.network.neutron [req-ccf2d42c-5127-415e-9d7f-d7ca5fe9c110 req-faf796a8-c91e-45f7-82d7-05baf147418d service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Updated VIF entry in instance network info cache for port 028b6a27-22aa-41b4-887c-984dc24826be. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:45:46 user nova-compute[72782]: DEBUG nova.network.neutron [req-ccf2d42c-5127-415e-9d7f-d7ca5fe9c110 req-faf796a8-c91e-45f7-82d7-05baf147418d service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Updating instance_info_cache with network_info: [{"id": "028b6a27-22aa-41b4-887c-984dc24826be", "address": "fa:16:3e:ac:9b:7b", "network": {"id": "05421250-9ad9-4d5a-97c0-3bcd1d423709", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1416606760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0351b1b7deb4c9da4ad0a4021ca4b4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028b6a27-22", "ovs_interfaceid": "028b6a27-22aa-41b4-887c-984dc24826be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:45:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ccf2d42c-5127-415e-9d7f-d7ca5fe9c110 req-faf796a8-c91e-45f7-82d7-05baf147418d service nova] Releasing lock "refresh_cache-d51b224a-5167-40bf-8d3c-8426b420458c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:45:46 user nova-compute[72782]: DEBUG nova.network.neutron [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Successfully updated port: 3efffdad-bcfc-4f5d-8d72-75656b5cba62 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:45:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:46 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Acquiring lock "refresh_cache-ea26c664-91cb-4824-a66b-c8fe216c6ba4" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Acquired lock "refresh_cache-ea26c664-91cb-4824-a66b-c8fe216c6ba4" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.network.neutron [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.compute.manager [req-3b2ce319-bb80-4e04-951b-f46fc0e8a618 req-9e57beaa-32c3-4a40-b00d-998885d91b35 service nova] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Received event network-changed-3efffdad-bcfc-4f5d-8d72-75656b5cba62 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.compute.manager [req-3b2ce319-bb80-4e04-951b-f46fc0e8a618 req-9e57beaa-32c3-4a40-b00d-998885d91b35 service nova] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Refreshing instance network info cache due to event network-changed-3efffdad-bcfc-4f5d-8d72-75656b5cba62. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3b2ce319-bb80-4e04-951b-f46fc0e8a618 req-9e57beaa-32c3-4a40-b00d-998885d91b35 service nova] Acquiring lock "refresh_cache-ea26c664-91cb-4824-a66b-c8fe216c6ba4" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.network.neutron [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.compute.manager [req-baabd959-d34a-4c21-a12e-01c9aec5605f req-8e907cbf-75df-4a63-bb68-7ef41df6a75a service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Received event network-vif-plugged-028b6a27-22aa-41b4-887c-984dc24826be {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-baabd959-d34a-4c21-a12e-01c9aec5605f req-8e907cbf-75df-4a63-bb68-7ef41df6a75a service nova] Acquiring lock "d51b224a-5167-40bf-8d3c-8426b420458c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-baabd959-d34a-4c21-a12e-01c9aec5605f req-8e907cbf-75df-4a63-bb68-7ef41df6a75a service nova] Lock "d51b224a-5167-40bf-8d3c-8426b420458c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-baabd959-d34a-4c21-a12e-01c9aec5605f req-8e907cbf-75df-4a63-bb68-7ef41df6a75a service nova] Lock "d51b224a-5167-40bf-8d3c-8426b420458c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.compute.manager [req-baabd959-d34a-4c21-a12e-01c9aec5605f req-8e907cbf-75df-4a63-bb68-7ef41df6a75a service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] No waiting events found dispatching network-vif-plugged-028b6a27-22aa-41b4-887c-984dc24826be {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:45:47 user nova-compute[72782]: WARNING nova.compute.manager [req-baabd959-d34a-4c21-a12e-01c9aec5605f req-8e907cbf-75df-4a63-bb68-7ef41df6a75a service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Received unexpected event network-vif-plugged-028b6a27-22aa-41b4-887c-984dc24826be for instance with vm_state building and task_state spawning.
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.network.neutron [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Updating instance_info_cache with network_info: [{"id": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "address": "fa:16:3e:10:bd:b5", "network": {"id": "d2e9bc7d-c0d9-410d-9f21-3f617955f28d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1874761389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a39356dc3b40e68fc1f8c2adfe31bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efffdad-bc", "ovs_interfaceid": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Releasing lock "refresh_cache-ea26c664-91cb-4824-a66b-c8fe216c6ba4" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Instance network_info: |[{"id": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "address": "fa:16:3e:10:bd:b5", "network": {"id": "d2e9bc7d-c0d9-410d-9f21-3f617955f28d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1874761389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a39356dc3b40e68fc1f8c2adfe31bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efffdad-bc", "ovs_interfaceid": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3b2ce319-bb80-4e04-951b-f46fc0e8a618 req-9e57beaa-32c3-4a40-b00d-998885d91b35 service nova] Acquired lock "refresh_cache-ea26c664-91cb-4824-a66b-c8fe216c6ba4" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.network.neutron [req-3b2ce319-bb80-4e04-951b-f46fc0e8a618 req-9e57beaa-32c3-4a40-b00d-998885d91b35 service nova] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Refreshing network info cache for port 3efffdad-bcfc-4f5d-8d72-75656b5cba62 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Start _get_guest_xml network_info=[{"id": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "address": "fa:16:3e:10:bd:b5", "network": {"id": "d2e9bc7d-c0d9-410d-9f21-3f617955f28d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1874761389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a39356dc3b40e68fc1f8c2adfe31bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efffdad-bc", "ovs_interfaceid": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:45:47 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:45:47 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:45:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-824226313',display_name='tempest-VolumesActionsTest-instance-824226313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-824226313',id=8,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a39356dc3b40e68fc1f8c2adfe31bd',ramdisk_id='',reservation_id='r-lziyfzsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-252225685',owner_user_name='tempest-VolumesActionsTest-252225685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:45:44Z,user_data=None,user_id='309d1190683d42d5b09677deeaa0b03e',uuid=ea26c664-91cb-4824-a66b-c8fe216c6ba4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "address": "fa:16:3e:10:bd:b5", "network": {"id": "d2e9bc7d-c0d9-410d-9f21-3f617955f28d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1874761389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a39356dc3b40e68fc1f8c2adfe31bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efffdad-bc", "ovs_interfaceid": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Converting VIF {"id": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "address": "fa:16:3e:10:bd:b5", "network": {"id": "d2e9bc7d-c0d9-410d-9f21-3f617955f28d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1874761389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a39356dc3b40e68fc1f8c2adfe31bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efffdad-bc", "ovs_interfaceid": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:bd:b5,bridge_name='br-int',has_traffic_filtering=True,id=3efffdad-bcfc-4f5d-8d72-75656b5cba62,network=Network(d2e9bc7d-c0d9-410d-9f21-3f617955f28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efffdad-bc') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.objects.instance [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lazy-loading 'pci_devices' on Instance uuid ea26c664-91cb-4824-a66b-c8fe216c6ba4 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:45:47 user nova-compute[72782]:   <uuid>ea26c664-91cb-4824-a66b-c8fe216c6ba4</uuid>
Aug 14 19:45:47 user nova-compute[72782]:   <name>instance-00000008</name>
Aug 14 19:45:47 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:45:47 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:45:47 user nova-compute[72782]:   <metadata>
Aug 14 19:45:47 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:45:47 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:45:47 user nova-compute[72782]:       <nova:name>tempest-VolumesActionsTest-instance-824226313</nova:name>
Aug 14 19:45:47 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:45:47</nova:creationTime>
Aug 14 19:45:47 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:45:47 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:45:47 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:45:47 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:45:47 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:45:47 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:45:47 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:45:47 user nova-compute[72782]:       <nova:owner>
Aug 14 19:45:47 user nova-compute[72782]:         <nova:user uuid="309d1190683d42d5b09677deeaa0b03e">tempest-VolumesActionsTest-252225685-project-member</nova:user>
Aug 14 19:45:47 user nova-compute[72782]:         <nova:project uuid="e6a39356dc3b40e68fc1f8c2adfe31bd">tempest-VolumesActionsTest-252225685</nova:project>
Aug 14 19:45:47 user nova-compute[72782]:       </nova:owner>
Aug 14 19:45:47 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:45:47 user nova-compute[72782]:       <nova:ports>
Aug 14 19:45:47 user nova-compute[72782]:         <nova:port uuid="3efffdad-bcfc-4f5d-8d72-75656b5cba62">
Aug 14 19:45:47 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 19:45:47 user nova-compute[72782]:         </nova:port>
Aug 14 19:45:47 user nova-compute[72782]:       </nova:ports>
Aug 14 19:45:47 user nova-compute[72782]:     </nova:instance>
Aug 14 19:45:47 user nova-compute[72782]:   </metadata>
Aug 14 19:45:47 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:45:47 user nova-compute[72782]:     <system>
Aug 14 19:45:47 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:45:47 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:45:47 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:45:47 user nova-compute[72782]:       <entry name="serial">ea26c664-91cb-4824-a66b-c8fe216c6ba4</entry>
Aug 14 19:45:47 user nova-compute[72782]:       <entry name="uuid">ea26c664-91cb-4824-a66b-c8fe216c6ba4</entry>
Aug 14 19:45:47 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:45:47 user nova-compute[72782]:     </system>
Aug 14 19:45:47 user nova-compute[72782]:   </sysinfo>
Aug 14 19:45:47 user nova-compute[72782]:   <os>
Aug 14 19:45:47 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:45:47 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:45:47 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:45:47 user nova-compute[72782]:   </os>
Aug 14 19:45:47 user nova-compute[72782]:   <features>
Aug 14 19:45:47 user nova-compute[72782]:     <acpi/>
Aug 14 19:45:47 user nova-compute[72782]:     <apic/>
Aug 14 19:45:47 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:45:47 user nova-compute[72782]:   </features>
Aug 14 19:45:47 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:45:47 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:45:47 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:45:47 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:45:47 user nova-compute[72782]:   </clock>
Aug 14 19:45:47 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:45:47 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:45:47 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:45:47 user nova-compute[72782]:   </cpu>
Aug 14 19:45:47 user nova-compute[72782]:   <devices>
Aug 14 19:45:47 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:45:47 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:45:47 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk"/>
Aug 14 19:45:47 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:45:47 user nova-compute[72782]:     </disk>
Aug 14 19:45:47 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:45:47 user nova-compute[72782]:       <mac address="fa:16:3e:10:bd:b5"/>
Aug 14 19:45:47 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:45:47 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:45:47 user nova-compute[72782]:       <target dev="tap3efffdad-bc"/>
Aug 14 19:45:47 user nova-compute[72782]:     </interface>
Aug 14 19:45:47 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:45:47 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/console.log" append="off"/>
Aug 14 19:45:47 user nova-compute[72782]:     </serial>
Aug 14 19:45:47 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:45:47 user nova-compute[72782]:     <video>
Aug 14 19:45:47 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:45:47 user nova-compute[72782]:     </video>
Aug 14 19:45:47 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:45:47 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:45:47 user nova-compute[72782]:     </rng>
Aug 14 19:45:47 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:45:47 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:45:47 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:45:47 user nova-compute[72782]:     </memballoon>
Aug 14 19:45:47 user nova-compute[72782]:   </devices>
Aug 14 19:45:47 user nova-compute[72782]: </domain>
Aug 14 19:45:47 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:45:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-824226313',display_name='tempest-VolumesActionsTest-instance-824226313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-824226313',id=8,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a39356dc3b40e68fc1f8c2adfe31bd',ramdisk_id='',reservation_id='r-lziyfzsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-252225685',owner_user_name='tempest-VolumesActionsTest-252225685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:45:44Z,user_data=None,user_id='309d1190683d42d5b09677deeaa0b03e',uuid=ea26c664-91cb-4824-a66b-c8fe216c6ba4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "address": "fa:16:3e:10:bd:b5", "network": {"id": "d2e9bc7d-c0d9-410d-9f21-3f617955f28d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1874761389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a39356dc3b40e68fc1f8c2adfe31bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efffdad-bc", "ovs_interfaceid": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Converting VIF {"id": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "address": "fa:16:3e:10:bd:b5", "network": {"id": "d2e9bc7d-c0d9-410d-9f21-3f617955f28d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1874761389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a39356dc3b40e68fc1f8c2adfe31bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efffdad-bc", "ovs_interfaceid": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:bd:b5,bridge_name='br-int',has_traffic_filtering=True,id=3efffdad-bcfc-4f5d-8d72-75656b5cba62,network=Network(d2e9bc7d-c0d9-410d-9f21-3f617955f28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efffdad-bc') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG os_vif [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:bd:b5,bridge_name='br-int',has_traffic_filtering=True,id=3efffdad-bcfc-4f5d-8d72-75656b5cba62,network=Network(d2e9bc7d-c0d9-410d-9f21-3f617955f28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efffdad-bc') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3efffdad-bc, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3efffdad-bc, col_values=(('external_ids', {'iface-id': '3efffdad-bcfc-4f5d-8d72-75656b5cba62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:bd:b5', 'vm-uuid': 'ea26c664-91cb-4824-a66b-c8fe216c6ba4'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:47 user nova-compute[72782]: INFO os_vif [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:bd:b5,bridge_name='br-int',has_traffic_filtering=True,id=3efffdad-bcfc-4f5d-8d72-75656b5cba62,network=Network(d2e9bc7d-c0d9-410d-9f21-3f617955f28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efffdad-bc')
Aug 14 19:45:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:45:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] No VIF found with MAC fa:16:3e:10:bd:b5, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:45:48 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:45:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:45:48 user nova-compute[72782]: DEBUG nova.network.neutron [req-3b2ce319-bb80-4e04-951b-f46fc0e8a618 req-9e57beaa-32c3-4a40-b00d-998885d91b35 service nova] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Updated VIF entry in instance network info cache for port 3efffdad-bcfc-4f5d-8d72-75656b5cba62. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:45:48 user nova-compute[72782]: DEBUG nova.network.neutron [req-3b2ce319-bb80-4e04-951b-f46fc0e8a618 req-9e57beaa-32c3-4a40-b00d-998885d91b35 service nova] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Updating instance_info_cache with network_info: [{"id": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "address": "fa:16:3e:10:bd:b5", "network": {"id": "d2e9bc7d-c0d9-410d-9f21-3f617955f28d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1874761389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a39356dc3b40e68fc1f8c2adfe31bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efffdad-bc", "ovs_interfaceid": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:45:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3b2ce319-bb80-4e04-951b-f46fc0e8a618 req-9e57beaa-32c3-4a40-b00d-998885d91b35 service nova] Releasing lock "refresh_cache-ea26c664-91cb-4824-a66b-c8fe216c6ba4" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:45:49 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:45:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:49 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:45:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-0ff91584-09a4-44c5-9cf7-2a91f6e7fa0a req-c707876d-ab9c-46ad-ae2f-e3820de16676 service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Received event network-vif-plugged-028b6a27-22aa-41b4-887c-984dc24826be {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0ff91584-09a4-44c5-9cf7-2a91f6e7fa0a req-c707876d-ab9c-46ad-ae2f-e3820de16676 service nova] Acquiring lock "d51b224a-5167-40bf-8d3c-8426b420458c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0ff91584-09a4-44c5-9cf7-2a91f6e7fa0a req-c707876d-ab9c-46ad-ae2f-e3820de16676 service nova] Lock "d51b224a-5167-40bf-8d3c-8426b420458c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0ff91584-09a4-44c5-9cf7-2a91f6e7fa0a req-c707876d-ab9c-46ad-ae2f-e3820de16676 service nova] Lock "d51b224a-5167-40bf-8d3c-8426b420458c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-0ff91584-09a4-44c5-9cf7-2a91f6e7fa0a req-c707876d-ab9c-46ad-ae2f-e3820de16676 service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] No waiting events found dispatching network-vif-plugged-028b6a27-22aa-41b4-887c-984dc24826be {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:45:49 user nova-compute[72782]: WARNING nova.compute.manager [req-0ff91584-09a4-44c5-9cf7-2a91f6e7fa0a req-c707876d-ab9c-46ad-ae2f-e3820de16676 service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Received unexpected event network-vif-plugged-028b6a27-22aa-41b4-887c-984dc24826be for instance with vm_state building and task_state spawning.
Aug 14 19:45:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-3420b684-d035-4121-92fe-081f4ffe362c req-2c6f262b-6873-4bf8-895e-897541a8fcd7 service nova] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Received event network-vif-plugged-3efffdad-bcfc-4f5d-8d72-75656b5cba62 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3420b684-d035-4121-92fe-081f4ffe362c req-2c6f262b-6873-4bf8-895e-897541a8fcd7 service nova] Acquiring lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3420b684-d035-4121-92fe-081f4ffe362c req-2c6f262b-6873-4bf8-895e-897541a8fcd7 service nova] Lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3420b684-d035-4121-92fe-081f4ffe362c req-2c6f262b-6873-4bf8-895e-897541a8fcd7 service nova] Lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-3420b684-d035-4121-92fe-081f4ffe362c req-2c6f262b-6873-4bf8-895e-897541a8fcd7 service nova] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] No waiting events found dispatching network-vif-plugged-3efffdad-bcfc-4f5d-8d72-75656b5cba62 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:45:49 user nova-compute[72782]: WARNING nova.compute.manager [req-3420b684-d035-4121-92fe-081f4ffe362c req-2c6f262b-6873-4bf8-895e-897541a8fcd7 service nova] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Received unexpected event network-vif-plugged-3efffdad-bcfc-4f5d-8d72-75656b5cba62 for instance with vm_state building and task_state spawning.
Aug 14 19:45:50 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042350.2612934, d51b224a-5167-40bf-8d3c-8426b420458c => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:45:50 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] VM Resumed (Lifecycle Event)
Aug 14 19:45:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:45:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:45:50 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Instance spawned successfully.
Aug 14 19:45:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:45:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:45:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:50 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:45:50 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042350.2696805, d51b224a-5167-40bf-8d3c-8426b420458c => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:45:50 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] VM Started (Lifecycle Event)
Aug 14 19:45:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:45:50 user nova-compute[72782]: INFO nova.compute.manager [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Took 8.91 seconds to spawn the instance on the hypervisor.
Aug 14 19:45:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:50 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:45:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:50 user nova-compute[72782]: INFO nova.compute.manager [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Took 10.25 seconds to build instance.
Aug 14 19:45:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cb58d081-4909-41e1-9b07-b1486d9e9cd9 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "d51b224a-5167-40bf-8d3c-8426b420458c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.436s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:51 user nova-compute[72782]: DEBUG nova.compute.manager [req-ad8eedbb-c5c6-46f7-8789-35d9277d4d85 req-bffb09cd-c9c0-4c64-a03a-d2b229ee9a67 service nova] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Received event network-vif-plugged-3efffdad-bcfc-4f5d-8d72-75656b5cba62 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:45:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ad8eedbb-c5c6-46f7-8789-35d9277d4d85 req-bffb09cd-c9c0-4c64-a03a-d2b229ee9a67 service nova] Acquiring lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ad8eedbb-c5c6-46f7-8789-35d9277d4d85 req-bffb09cd-c9c0-4c64-a03a-d2b229ee9a67 service nova] Lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ad8eedbb-c5c6-46f7-8789-35d9277d4d85 req-bffb09cd-c9c0-4c64-a03a-d2b229ee9a67 service nova] Lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:51 user nova-compute[72782]: DEBUG nova.compute.manager [req-ad8eedbb-c5c6-46f7-8789-35d9277d4d85 req-bffb09cd-c9c0-4c64-a03a-d2b229ee9a67 service nova] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] No waiting events found dispatching network-vif-plugged-3efffdad-bcfc-4f5d-8d72-75656b5cba62 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:45:51 user nova-compute[72782]: WARNING nova.compute.manager [req-ad8eedbb-c5c6-46f7-8789-35d9277d4d85 req-bffb09cd-c9c0-4c64-a03a-d2b229ee9a67 service nova] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Received unexpected event network-vif-plugged-3efffdad-bcfc-4f5d-8d72-75656b5cba62 for instance with vm_state building and task_state spawning.
Aug 14 19:45:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042352.295673, ea26c664-91cb-4824-a66b-c8fe216c6ba4 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:45:52 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] VM Resumed (Lifecycle Event)
Aug 14 19:45:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:45:52 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Instance spawned successfully.
Aug 14 19:45:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:45:52 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:45:52 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042352.299838, ea26c664-91cb-4824-a66b-c8fe216c6ba4 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:45:52 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] VM Started (Lifecycle Event)
Aug 14 19:45:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:45:52 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:45:52 user nova-compute[72782]: INFO nova.compute.manager [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Took 8.27 seconds to spawn the instance on the hypervisor.
Aug 14 19:45:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:52 user nova-compute[72782]: INFO nova.compute.manager [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Took 9.30 seconds to build instance.
Aug 14 19:45:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1ebea4ea-ffcf-4af6-be4c-458bdd433a6c tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.459s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:45:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:45:55 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:45:55 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:45:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7606MB free_disk=25.901668548583984GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:45:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:45:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:45:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 39039cef-13fa-4434-9edc-4628757cbc24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:45:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:45:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 03fc42b1-f33d-4930-ba65-22540584b7fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:45:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:45:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 5d532038-555f-42d3-b35a-9e6f0350b023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:45:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 04969095-d5d4-4581-bb3e-df44e21d33d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:45:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance d51b224a-5167-40bf-8d3c-8426b420458c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:45:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ea26c664-91cb-4824-a66b-c8fe216c6ba4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:45:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:45:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:45:55 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing inventories for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 19:45:55 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating ProviderTree inventory for provider d26c9e3b-40e6-476e-9664-3119ebf5873b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 19:45:55 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 19:45:55 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing aggregate associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, aggregates: None {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 19:45:55 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing trait associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 19:45:56 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:45:56 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:45:56 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:45:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.914s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:45:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:45:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:45:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:46:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:46:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:46:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:46:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:46:29 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:46:29 user nova-compute[72782]: INFO nova.compute.claims [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Claim successful on node user
Aug 14 19:46:29 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:46:29 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:46:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:46:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:46:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:46:29 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:46:29 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:46:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:46:29 user nova-compute[72782]: INFO nova.virt.block_device [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Booting with volume 1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 at /dev/vda
Aug 14 19:46:29 user nova-compute[72782]: DEBUG nova.policy [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '624561a8bc094e8380135f5fbe91fb85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '833f54e960414f2d80ed0f069bcafba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:46:29 user nova-compute[72782]: DEBUG os_brick.utils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:46:29 user nova-compute[72782]: INFO oslo.privsep.daemon [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmps8bdowxw/privsep.sock']
Aug 14 19:46:29 user sudo[83757]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmps8bdowxw/privsep.sock
Aug 14 19:46:29 user sudo[83757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 19:46:30 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Successfully created port: 7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Successfully created port: 4e1deb99-9d04-4e8a-9436-a65820a2852b {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Successfully created port: 26080d32-4bd6-4320-b80a-200076d568d5 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:46:31 user sudo[83757]: pam_unix(sudo:session): session closed for user root
Aug 14 19:46:31 user nova-compute[72782]: INFO oslo.privsep.daemon [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Spawned new privsep daemon via rootwrap
Aug 14 19:46:31 user nova-compute[72782]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 19:46:31 user nova-compute[72782]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 19:46:31 user nova-compute[72782]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 14 19:46:31 user nova-compute[72782]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83776
Aug 14 19:46:31 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[466e5bc2-de91-42e5-af4d-b3d80b0181eb]: (2,) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[938c70e2-9788-4407-9d7a-74489d301e44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:31 user nova-compute[72782]: WARNING os_brick.initiator.connectors.nvmeof [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 14 19:46:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbb51ff-0b84-4e21-9956-3a85ac350686]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2930906-ae53-40b3-b423-fdbc37f0b5a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0043ed-628d-4a80-9036-34577cef8316]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:46:31 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:46:31 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e5df19-ebcf-4c45-bf77-869773338b8e]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG os_brick.utils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] <== get_connector_properties: return (2009ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:46:31 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Updating existing volume attachment record: a9203dd7-3254-4c99-a3a9-1d2eab67b6ad {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:46:32 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Successfully created port: 5dbbd012-f83b-4066-8bbc-70425d5a95de {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:46:32 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Successfully created port: 9302e1b4-e070-4dc6-afed-103549c16da0 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:46:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:46:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:46:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:46:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:46:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:33 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Successfully updated port: 7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:46:33 user nova-compute[72782]: DEBUG nova.compute.manager [req-769e75e9-f15f-4176-bc76-c85f4634ab29 req-2ec0b675-52cf-456d-964f-f892a48208b4 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-changed-7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:46:33 user nova-compute[72782]: DEBUG nova.compute.manager [req-769e75e9-f15f-4176-bc76-c85f4634ab29 req-2ec0b675-52cf-456d-964f-f892a48208b4 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Refreshing instance network info cache due to event network-changed-7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:46:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-769e75e9-f15f-4176-bc76-c85f4634ab29 req-2ec0b675-52cf-456d-964f-f892a48208b4 service nova] Acquiring lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:46:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-769e75e9-f15f-4176-bc76-c85f4634ab29 req-2ec0b675-52cf-456d-964f-f892a48208b4 service nova] Acquired lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:46:33 user nova-compute[72782]: DEBUG nova.network.neutron [req-769e75e9-f15f-4176-bc76-c85f4634ab29 req-2ec0b675-52cf-456d-964f-f892a48208b4 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Refreshing network info cache for port 7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:46:33 user nova-compute[72782]: DEBUG nova.network.neutron [req-769e75e9-f15f-4176-bc76-c85f4634ab29 req-2ec0b675-52cf-456d-964f-f892a48208b4 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:46:34 user nova-compute[72782]: DEBUG nova.network.neutron [req-769e75e9-f15f-4176-bc76-c85f4634ab29 req-2ec0b675-52cf-456d-964f-f892a48208b4 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:46:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-769e75e9-f15f-4176-bc76-c85f4634ab29 req-2ec0b675-52cf-456d-964f-f892a48208b4 service nova] Releasing lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:46:34 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Successfully updated port: ed05074c-e64e-4323-92de-d9594c044eb2 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:46:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-f6730273-8e37-4060-8abb-51a5610db2e6 req-927d66ec-58c1-4c46-abe8-8704ebe1d5ae service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-changed-ed05074c-e64e-4323-92de-d9594c044eb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:46:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-f6730273-8e37-4060-8abb-51a5610db2e6 req-927d66ec-58c1-4c46-abe8-8704ebe1d5ae service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Refreshing instance network info cache due to event network-changed-ed05074c-e64e-4323-92de-d9594c044eb2. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:46:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f6730273-8e37-4060-8abb-51a5610db2e6 req-927d66ec-58c1-4c46-abe8-8704ebe1d5ae service nova] Acquiring lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:46:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f6730273-8e37-4060-8abb-51a5610db2e6 req-927d66ec-58c1-4c46-abe8-8704ebe1d5ae service nova] Acquired lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:46:35 user nova-compute[72782]: DEBUG nova.network.neutron [req-f6730273-8e37-4060-8abb-51a5610db2e6 req-927d66ec-58c1-4c46-abe8-8704ebe1d5ae service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Refreshing network info cache for port ed05074c-e64e-4323-92de-d9594c044eb2 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:46:35 user nova-compute[72782]: DEBUG nova.network.neutron [req-f6730273-8e37-4060-8abb-51a5610db2e6 req-927d66ec-58c1-4c46-abe8-8704ebe1d5ae service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:46:35 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Successfully updated port: e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:46:36 user nova-compute[72782]: DEBUG nova.network.neutron [req-f6730273-8e37-4060-8abb-51a5610db2e6 req-927d66ec-58c1-4c46-abe8-8704ebe1d5ae service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:46:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f6730273-8e37-4060-8abb-51a5610db2e6 req-927d66ec-58c1-4c46-abe8-8704ebe1d5ae service nova] Releasing lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:46:36 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Successfully updated port: 4e1deb99-9d04-4e8a-9436-a65820a2852b {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:46:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-a558a6cf-1cec-455f-bcfc-6f728b8e0e5b req-7a668f37-e3e8-4b29-a8e5-bf0ca5394b84 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-changed-e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:46:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-a558a6cf-1cec-455f-bcfc-6f728b8e0e5b req-7a668f37-e3e8-4b29-a8e5-bf0ca5394b84 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Refreshing instance network info cache due to event network-changed-e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:46:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a558a6cf-1cec-455f-bcfc-6f728b8e0e5b req-7a668f37-e3e8-4b29-a8e5-bf0ca5394b84 service nova] Acquiring lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:46:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a558a6cf-1cec-455f-bcfc-6f728b8e0e5b req-7a668f37-e3e8-4b29-a8e5-bf0ca5394b84 service nova] Acquired lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:46:37 user nova-compute[72782]: DEBUG nova.network.neutron [req-a558a6cf-1cec-455f-bcfc-6f728b8e0e5b req-7a668f37-e3e8-4b29-a8e5-bf0ca5394b84 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Refreshing network info cache for port e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:46:37 user nova-compute[72782]: DEBUG nova.network.neutron [req-a558a6cf-1cec-455f-bcfc-6f728b8e0e5b req-7a668f37-e3e8-4b29-a8e5-bf0ca5394b84 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:46:37 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Successfully updated port: 26080d32-4bd6-4320-b80a-200076d568d5 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:46:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:38 user nova-compute[72782]: DEBUG nova.network.neutron [req-a558a6cf-1cec-455f-bcfc-6f728b8e0e5b req-7a668f37-e3e8-4b29-a8e5-bf0ca5394b84 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:46:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a558a6cf-1cec-455f-bcfc-6f728b8e0e5b req-7a668f37-e3e8-4b29-a8e5-bf0ca5394b84 service nova] Releasing lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:46:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-a558a6cf-1cec-455f-bcfc-6f728b8e0e5b req-7a668f37-e3e8-4b29-a8e5-bf0ca5394b84 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-changed-4e1deb99-9d04-4e8a-9436-a65820a2852b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:46:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-a558a6cf-1cec-455f-bcfc-6f728b8e0e5b req-7a668f37-e3e8-4b29-a8e5-bf0ca5394b84 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Refreshing instance network info cache due to event network-changed-4e1deb99-9d04-4e8a-9436-a65820a2852b. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:46:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a558a6cf-1cec-455f-bcfc-6f728b8e0e5b req-7a668f37-e3e8-4b29-a8e5-bf0ca5394b84 service nova] Acquiring lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:46:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a558a6cf-1cec-455f-bcfc-6f728b8e0e5b req-7a668f37-e3e8-4b29-a8e5-bf0ca5394b84 service nova] Acquired lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:46:38 user nova-compute[72782]: DEBUG nova.network.neutron [req-a558a6cf-1cec-455f-bcfc-6f728b8e0e5b req-7a668f37-e3e8-4b29-a8e5-bf0ca5394b84 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Refreshing network info cache for port 4e1deb99-9d04-4e8a-9436-a65820a2852b {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:46:38 user nova-compute[72782]: DEBUG nova.network.neutron [req-a558a6cf-1cec-455f-bcfc-6f728b8e0e5b req-7a668f37-e3e8-4b29-a8e5-bf0ca5394b84 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:46:38 user nova-compute[72782]: DEBUG nova.network.neutron [req-a558a6cf-1cec-455f-bcfc-6f728b8e0e5b req-7a668f37-e3e8-4b29-a8e5-bf0ca5394b84 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:46:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a558a6cf-1cec-455f-bcfc-6f728b8e0e5b req-7a668f37-e3e8-4b29-a8e5-bf0ca5394b84 service nova] Releasing lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:46:39 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Successfully updated port: 5dbbd012-f83b-4066-8bbc-70425d5a95de {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:46:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-61a315e8-d2d6-475c-9029-74d2d2da6c50 req-21e67f8d-4bb4-44b6-a477-fd2fec0b2956 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-changed-26080d32-4bd6-4320-b80a-200076d568d5 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:46:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-61a315e8-d2d6-475c-9029-74d2d2da6c50 req-21e67f8d-4bb4-44b6-a477-fd2fec0b2956 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Refreshing instance network info cache due to event network-changed-26080d32-4bd6-4320-b80a-200076d568d5. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:46:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-61a315e8-d2d6-475c-9029-74d2d2da6c50 req-21e67f8d-4bb4-44b6-a477-fd2fec0b2956 service nova] Acquiring lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:46:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-61a315e8-d2d6-475c-9029-74d2d2da6c50 req-21e67f8d-4bb4-44b6-a477-fd2fec0b2956 service nova] Acquired lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:46:39 user nova-compute[72782]: DEBUG nova.network.neutron [req-61a315e8-d2d6-475c-9029-74d2d2da6c50 req-21e67f8d-4bb4-44b6-a477-fd2fec0b2956 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Refreshing network info cache for port 26080d32-4bd6-4320-b80a-200076d568d5 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:46:39 user nova-compute[72782]: DEBUG nova.network.neutron [req-61a315e8-d2d6-475c-9029-74d2d2da6c50 req-21e67f8d-4bb4-44b6-a477-fd2fec0b2956 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:46:40 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Successfully updated port: 9302e1b4-e070-4dc6-afed-103549c16da0 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:46:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Acquiring lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:46:40 user nova-compute[72782]: DEBUG nova.network.neutron [req-61a315e8-d2d6-475c-9029-74d2d2da6c50 req-21e67f8d-4bb4-44b6-a477-fd2fec0b2956 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:46:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-61a315e8-d2d6-475c-9029-74d2d2da6c50 req-21e67f8d-4bb4-44b6-a477-fd2fec0b2956 service nova] Releasing lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:46:40 user nova-compute[72782]: DEBUG nova.compute.manager [req-61a315e8-d2d6-475c-9029-74d2d2da6c50 req-21e67f8d-4bb4-44b6-a477-fd2fec0b2956 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-changed-5dbbd012-f83b-4066-8bbc-70425d5a95de {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:46:40 user nova-compute[72782]: DEBUG nova.compute.manager [req-61a315e8-d2d6-475c-9029-74d2d2da6c50 req-21e67f8d-4bb4-44b6-a477-fd2fec0b2956 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Refreshing instance network info cache due to event network-changed-5dbbd012-f83b-4066-8bbc-70425d5a95de. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:46:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-61a315e8-d2d6-475c-9029-74d2d2da6c50 req-21e67f8d-4bb4-44b6-a477-fd2fec0b2956 service nova] Acquiring lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:46:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-61a315e8-d2d6-475c-9029-74d2d2da6c50 req-21e67f8d-4bb4-44b6-a477-fd2fec0b2956 service nova] Acquired lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:46:40 user nova-compute[72782]: DEBUG nova.network.neutron [req-61a315e8-d2d6-475c-9029-74d2d2da6c50 req-21e67f8d-4bb4-44b6-a477-fd2fec0b2956 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Refreshing network info cache for port 5dbbd012-f83b-4066-8bbc-70425d5a95de {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:46:40 user nova-compute[72782]: DEBUG nova.network.neutron [req-61a315e8-d2d6-475c-9029-74d2d2da6c50 req-21e67f8d-4bb4-44b6-a477-fd2fec0b2956 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:46:40 user nova-compute[72782]: DEBUG nova.network.neutron [req-61a315e8-d2d6-475c-9029-74d2d2da6c50 req-21e67f8d-4bb4-44b6-a477-fd2fec0b2956 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:46:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-61a315e8-d2d6-475c-9029-74d2d2da6c50 req-21e67f8d-4bb4-44b6-a477-fd2fec0b2956 service nova] Releasing lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:46:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Acquired lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:46:40 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:46:40 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:46:41 user nova-compute[72782]: INFO nova.virt.block_device [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Booting with volume 2520d4d3-9583-40a3-af3c-1e4eb5131950 at /dev/vdb
Aug 14 19:46:41 user nova-compute[72782]: DEBUG os_brick.utils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e62f96-4447-4ac7-9c1f-290bd46f5c51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG nova.compute.manager [req-b1583544-0caf-44ee-a7e6-9a8204100103 req-649f77ea-1839-4171-a8fe-ff86e14eafa4 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-changed-9302e1b4-e070-4dc6-afed-103549c16da0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG nova.compute.manager [req-b1583544-0caf-44ee-a7e6-9a8204100103 req-649f77ea-1839-4171-a8fe-ff86e14eafa4 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Refreshing instance network info cache due to event network-changed-9302e1b4-e070-4dc6-afed-103549c16da0. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b1583544-0caf-44ee-a7e6-9a8204100103 req-649f77ea-1839-4171-a8fe-ff86e14eafa4 service nova] Acquiring lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[accc14bd-2ac1-44bc-b51d-099779ac5487]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b4a656-6844-4e3c-a850-989983f91bb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b049675-c54d-41da-8afe-8495bd506bf4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:46:41 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:46:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d7f147-8ba6-4ff7-b7d0-6219356cd4fd]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG os_brick.utils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:46:41 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Updating existing volume attachment record: d620a274-3c0a-4d5e-a0e4-a02b4665efe3 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:46:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:43 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Updating instance_info_cache with network_info: [{"id": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "address": "fa:16:3e:7d:5e:0a", "network": {"id": "64006a4f-c433-4a4b-9eb1-9c01b1f92998", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-602656292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad9c25e-14", "ovs_interfaceid": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed05074c-e64e-4323-92de-d9594c044eb2", "address": "fa:16:3e:34:10:52", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped05074c-e6", "ovs_interfaceid": "ed05074c-e64e-4323-92de-d9594c044eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "address": "fa:16:3e:10:73:ae", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape703e10a-c7", "ovs_interfaceid": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "address": "fa:16:3e:3a:bb:18", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1deb99-9d", "ovs_interfaceid": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26080d32-4bd6-4320-b80a-200076d568d5", "address": "fa:16:3e:af:e3:b1", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26080d32-4b", "ovs_interfaceid": "26080d32-4bd6-4320-b80a-200076d568d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "address": "fa:16:3e:35:0e:71", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbbd012-f8", "ovs_interfaceid": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9302e1b4-e070-4dc6-afed-103549c16da0", "address": "fa:16:3e:41:db:4c", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9302e1b4-e0", "ovs_interfaceid": "9302e1b4-e070-4dc6-afed-103549c16da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:46:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Releasing lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:46:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Instance network_info: |[{"id": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "address": "fa:16:3e:7d:5e:0a", "network": {"id": "64006a4f-c433-4a4b-9eb1-9c01b1f92998", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-602656292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad9c25e-14", "ovs_interfaceid": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed05074c-e64e-4323-92de-d9594c044eb2", "address": "fa:16:3e:34:10:52", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped05074c-e6", "ovs_interfaceid": "ed05074c-e64e-4323-92de-d9594c044eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "address": "fa:16:3e:10:73:ae", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape703e10a-c7", "ovs_interfaceid": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "address": "fa:16:3e:3a:bb:18", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1deb99-9d", "ovs_interfaceid": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26080d32-4bd6-4320-b80a-200076d568d5", "address": "fa:16:3e:af:e3:b1", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26080d32-4b", "ovs_interfaceid": "26080d32-4bd6-4320-b80a-200076d568d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "address": "fa:16:3e:35:0e:71", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbbd012-f8", "ovs_interfaceid": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9302e1b4-e070-4dc6-afed-103549c16da0", "address": "fa:16:3e:41:db:4c", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9302e1b4-e0", "ovs_interfaceid": "9302e1b4-e070-4dc6-afed-103549c16da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:46:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b1583544-0caf-44ee-a7e6-9a8204100103 req-649f77ea-1839-4171-a8fe-ff86e14eafa4 service nova] Acquired lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:46:43 user nova-compute[72782]: DEBUG nova.network.neutron [req-b1583544-0caf-44ee-a7e6-9a8204100103 req-649f77ea-1839-4171-a8fe-ff86e14eafa4 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Refreshing network info cache for port 9302e1b4-e070-4dc6-afed-103549c16da0 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:46:43 user nova-compute[72782]: DEBUG nova.network.neutron [req-b1583544-0caf-44ee-a7e6-9a8204100103 req-649f77ea-1839-4171-a8fe-ff86e14eafa4 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Updated VIF entry in instance network info cache for port 9302e1b4-e070-4dc6-afed-103549c16da0. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:46:43 user nova-compute[72782]: DEBUG nova.network.neutron [req-b1583544-0caf-44ee-a7e6-9a8204100103 req-649f77ea-1839-4171-a8fe-ff86e14eafa4 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Updating instance_info_cache with network_info: [{"id": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "address": "fa:16:3e:7d:5e:0a", "network": {"id": "64006a4f-c433-4a4b-9eb1-9c01b1f92998", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-602656292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad9c25e-14", "ovs_interfaceid": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed05074c-e64e-4323-92de-d9594c044eb2", "address": "fa:16:3e:34:10:52", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped05074c-e6", "ovs_interfaceid": "ed05074c-e64e-4323-92de-d9594c044eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "address": "fa:16:3e:10:73:ae", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape703e10a-c7", "ovs_interfaceid": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "address": "fa:16:3e:3a:bb:18", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1deb99-9d", "ovs_interfaceid": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26080d32-4bd6-4320-b80a-200076d568d5", "address": "fa:16:3e:af:e3:b1", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26080d32-4b", "ovs_interfaceid": "26080d32-4bd6-4320-b80a-200076d568d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "address": "fa:16:3e:35:0e:71", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbbd012-f8", "ovs_interfaceid": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9302e1b4-e070-4dc6-afed-103549c16da0", "address": "fa:16:3e:41:db:4c", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9302e1b4-e0", "ovs_interfaceid": "9302e1b4-e070-4dc6-afed-103549c16da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:46:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b1583544-0caf-44ee-a7e6-9a8204100103 req-649f77ea-1839-4171-a8fe-ff86e14eafa4 service nova] Releasing lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:46:45 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:46:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:46:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:46:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:46:45 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:46:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Acquiring lock "39039cef-13fa-4434-9edc-4628757cbc24" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:46:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "39039cef-13fa-4434-9edc-4628757cbc24" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:46:45 user nova-compute[72782]: DEBUG nova.objects.instance [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lazy-loading 'flavor' on Instance uuid 39039cef-13fa-4434-9edc-4628757cbc24 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:46:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "39039cef-13fa-4434-9edc-4628757cbc24" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Updating instance_info_cache with network_info: [{"id": "935f7dd0-e151-47aa-bcaf-a214f5854759", "address": "fa:16:3e:9a:a4:fc", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935f7dd0-e1", "ovs_interfaceid": "935f7dd0-e151-47aa-bcaf-a214f5854759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Acquiring lock "39039cef-13fa-4434-9edc-4628757cbc24" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "39039cef-13fa-4434-9edc-4628757cbc24" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:46:46 user nova-compute[72782]: INFO nova.compute.manager [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Attaching volume de5f3286-1466-4fac-9bd5-65b692a35791 to /dev/vdb
Aug 14 19:46:46 user nova-compute[72782]: DEBUG os_brick.utils [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a550663-7c4d-4e2c-a781-5bf10074c8c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63e3d1b-119a-4b6a-bda3-32ab5c318f5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5446da-884a-4482-9290-55ee6e66a2c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6abf05-b132-4b8a-b770-a41767a83d28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:46:46 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:46:46 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cede44d1-c5b3-4be6-9a55-7320b72de991]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG os_brick.utils [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:46:46 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Updating existing volume attachment record: 649acb6b-82ad-4972-8e89-f2cd7cb5ad81 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:46:47 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:46:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:48 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:46:48 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:46:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:46:49 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:46:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:49 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:46:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:46:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:46:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:46:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:46:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:46:51 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:46:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:52 user nova-compute[72782]: INFO nova.virt.block_device [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Booting with volume f6556a3c-a0de-4a83-bc13-cefbae62165b at /dev/vdc
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG os_brick.utils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bb2bc3-81c4-441a-a9a5-c5cd5fd2a6be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae98e7d9-0e30-4fbd-8ea9-879991130c26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f4a08c-7844-4346-8e25-a7e5312d8b70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdef69a-d2f5-4c9c-bc56-03fd2e86d5c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:46:52 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4befc0-3bc9-47c8-88f5-81a255e78f88]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG os_brick.utils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Updating existing volume attachment record: 2b087172-dfb0-4e59-a8bf-a90671c5f845 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:53 user nova-compute[72782]: DEBUG nova.compute.manager [req-1dc2122b-c11e-4df1-9c98-28400f2b90f0 req-45f9b8f7-bf2e-4882-bd99-79a91328e238 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Received event network-changed-935f7dd0-e151-47aa-bcaf-a214f5854759 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:46:53 user nova-compute[72782]: DEBUG nova.compute.manager [req-1dc2122b-c11e-4df1-9c98-28400f2b90f0 req-45f9b8f7-bf2e-4882-bd99-79a91328e238 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Refreshing instance network info cache due to event network-changed-935f7dd0-e151-47aa-bcaf-a214f5854759. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:46:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1dc2122b-c11e-4df1-9c98-28400f2b90f0 req-45f9b8f7-bf2e-4882-bd99-79a91328e238 service nova] Acquiring lock "refresh_cache-4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:46:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1dc2122b-c11e-4df1-9c98-28400f2b90f0 req-45f9b8f7-bf2e-4882-bd99-79a91328e238 service nova] Acquired lock "refresh_cache-4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:46:53 user nova-compute[72782]: DEBUG nova.network.neutron [req-1dc2122b-c11e-4df1-9c98-28400f2b90f0 req-45f9b8f7-bf2e-4882-bd99-79a91328e238 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Refreshing network info cache for port 935f7dd0-e151-47aa-bcaf-a214f5854759 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:46:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:54 user nova-compute[72782]: DEBUG nova.network.neutron [req-1dc2122b-c11e-4df1-9c98-28400f2b90f0 req-45f9b8f7-bf2e-4882-bd99-79a91328e238 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Updated VIF entry in instance network info cache for port 935f7dd0-e151-47aa-bcaf-a214f5854759. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:46:54 user nova-compute[72782]: DEBUG nova.network.neutron [req-1dc2122b-c11e-4df1-9c98-28400f2b90f0 req-45f9b8f7-bf2e-4882-bd99-79a91328e238 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Updating instance_info_cache with network_info: [{"id": "935f7dd0-e151-47aa-bcaf-a214f5854759", "address": "fa:16:3e:9a:a4:fc", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935f7dd0-e1", "ovs_interfaceid": "935f7dd0-e151-47aa-bcaf-a214f5854759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:46:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1dc2122b-c11e-4df1-9c98-28400f2b90f0 req-45f9b8f7-bf2e-4882-bd99-79a91328e238 service nova] Releasing lock "refresh_cache-4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:46:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:55 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:46:55 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:46:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7247MB free_disk=25.765464782714844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 39039cef-13fa-4434-9edc-4628757cbc24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 03fc42b1-f33d-4930-ba65-22540584b7fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 5d532038-555f-42d3-b35a-9e6f0350b023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 04969095-d5d4-4581-bb3e-df44e21d33d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance d51b224a-5167-40bf-8d3c-8426b420458c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ea26c664-91cb-4824-a66b-c8fe216c6ba4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 00a09aca-9913-4fba-91c6-9702c0dc44bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.557s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG os_brick.initiator.connector [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Factory for ISCSI on None {{(pid=72782) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.009s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irSQgotW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:46:55 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:46:55 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:46:55 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:46:55 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:46:55 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:46:55 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[567ed209-d905-4504-8623-a3696b5281fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:46:56 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f5c586-737c-466f-9601-927736f35966]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791] added
Aug 14 19:46:56 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a325ed61-6da5-4e23-aca7-6a77b54382f4]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc52534-fb12-4504-b9db-cb68bdb77b11]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v irSQgotW {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v irSQgotW" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50537b0-fcfb-4c13-9997-882f566db85b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'irSQgotW'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9443463e-2239-46be-be37-3284b9207ac5]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c3e203-2c5c-42d8-9a62-58cd5b8b0fba]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 19:46:56 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 19:46:56 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:46:56 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 19:46:56 user nova-compute[72782]: 
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[61120ef7-115a-487c-aa05-595cf9dd5f28]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791, portal: 172.16.0.220,3260]
Aug 14 19:46:56 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791, portal: 172.16.0.220,3260] successful.
Aug 14 19:46:56 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cadbf0-fbf7-49d6-b0f6-564cc28fce48]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5ac6be-dd83-48ca-b074-25b8b89d0b2b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 (non-flash)
Aug 14 19:46:56 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 (non-flash)
Aug 14 19:46:56 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdb4008-9e28-4428-b0e8-fd8fa8dcf3a2]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:46:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irSQgotW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:46:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:46:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26531396165333538', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:46:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531396165333538', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:46:57 user nova-compute[72782]: DEBUG nova.objects.instance [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lazy-loading 'flavor' on Instance uuid 39039cef-13fa-4434-9edc-4628757cbc24 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:46:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:46:57 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:46:57 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 19:46:57 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:46:57 user nova-compute[72782]:   <serial>de5f3286-1466-4fac-9bd5-65b692a35791</serial>
Aug 14 19:46:57 user nova-compute[72782]: </disk>
Aug 14 19:46:57 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:46:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:46:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:46:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] No VIF found with MAC fa:16:3e:dc:6d:cf, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:46:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f9c5ce03-3e79-4c50-8588-34cdd69fcc82 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "39039cef-13fa-4434-9edc-4628757cbc24" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.897s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:46:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Acquiring lock "39039cef-13fa-4434-9edc-4628757cbc24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:46:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "39039cef-13fa-4434-9edc-4628757cbc24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:46:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Acquiring lock "39039cef-13fa-4434-9edc-4628757cbc24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:46:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "39039cef-13fa-4434-9edc-4628757cbc24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:46:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "39039cef-13fa-4434-9edc-4628757cbc24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:46:59 user nova-compute[72782]: INFO nova.compute.manager [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Terminating instance
Aug 14 19:46:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:46:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:46:59 user nova-compute[72782]: DEBUG nova.compute.manager [req-d7b99e45-fbdb-4723-88cd-058031dfa320 req-d323e2e3-ca6d-49c2-8699-188a713c9099 service nova] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Received event network-vif-unplugged-16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:46:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d7b99e45-fbdb-4723-88cd-058031dfa320 req-d323e2e3-ca6d-49c2-8699-188a713c9099 service nova] Acquiring lock "39039cef-13fa-4434-9edc-4628757cbc24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:46:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d7b99e45-fbdb-4723-88cd-058031dfa320 req-d323e2e3-ca6d-49c2-8699-188a713c9099 service nova] Lock "39039cef-13fa-4434-9edc-4628757cbc24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:46:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d7b99e45-fbdb-4723-88cd-058031dfa320 req-d323e2e3-ca6d-49c2-8699-188a713c9099 service nova] Lock "39039cef-13fa-4434-9edc-4628757cbc24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:46:59 user nova-compute[72782]: DEBUG nova.compute.manager [req-d7b99e45-fbdb-4723-88cd-058031dfa320 req-d323e2e3-ca6d-49c2-8699-188a713c9099 service nova] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] No waiting events found dispatching network-vif-unplugged-16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:46:59 user nova-compute[72782]: DEBUG nova.compute.manager [req-d7b99e45-fbdb-4723-88cd-058031dfa320 req-d323e2e3-ca6d-49c2-8699-188a713c9099 service nova] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Received event network-vif-unplugged-16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:46:59 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Instance destroyed successfully.
Aug 14 19:46:59 user nova-compute[72782]: DEBUG nova.objects.instance [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lazy-loading 'resources' on Instance uuid 39039cef-13fa-4434-9edc-4628757cbc24 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:46:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:44:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-307741904',display_name='tempest-DeleteServersTestJSON-server-307741904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-307741904',id=1,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:45:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='366424c997cd4beaa392f8a1f3cdfa63',ramdisk_id='',reservation_id='r-j4hfoman',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-946815863',owner_user_name='tempest-DeleteServersTestJSON-946815863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:45:06Z,user_data=None,user_id='2d8e2f0957cb4581919171aa327ec848',uuid=39039cef-13fa-4434-9edc-4628757cbc24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "address": "fa:16:3e:dc:6d:cf", "network": {"id": "8ddd71dc-2d52-406a-a27e-eaf3f8251435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-292261629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "366424c997cd4beaa392f8a1f3cdfa63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ab6ae5-2d", "ovs_interfaceid": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Converting VIF {"id": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "address": "fa:16:3e:dc:6d:cf", "network": {"id": "8ddd71dc-2d52-406a-a27e-eaf3f8251435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-292261629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "366424c997cd4beaa392f8a1f3cdfa63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ab6ae5-2d", "ovs_interfaceid": "16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:6d:cf,bridge_name='br-int',has_traffic_filtering=True,id=16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9,network=Network(8ddd71dc-2d52-406a-a27e-eaf3f8251435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ab6ae5-2d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_vif [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:6d:cf,bridge_name='br-int',has_traffic_filtering=True,id=16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9,network=Network(8ddd71dc-2d52-406a-a27e-eaf3f8251435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ab6ae5-2d') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16ab6ae5-2d, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:47:00 user nova-compute[72782]: INFO os_vif [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:6d:cf,bridge_name='br-int',has_traffic_filtering=True,id=16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9,network=Network(8ddd71dc-2d52-406a-a27e-eaf3f8251435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ab6ae5-2d')
Aug 14 19:47:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irSQgotW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:00 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43db28e-8777-4652-8edc-940984365fab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3715c19-b131-4285-950b-ae3b82292758]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 (non-flash)
Aug 14 19:47:00 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 (non-flash)
Aug 14 19:47:00 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f640854e9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9177ac2-6bab-4ba0-909d-12dede23c06d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80850ea-0b90-4a16-9e5d-baa9be2219ac]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffdb0d2-4582-45c6-9fbc-fa4da67939ad]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c92c15-2e27-4e44-b1fc-327b832e8156]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4b7ebb-2e18-4487-accf-2f525e47f8f3]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14dd3ce-3533-4d8b-b03b-517b3b773942]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791, portal: 172.16.0.220,3260]
Aug 14 19:47:00 user nova-compute[72782]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791, portal: 172.16.0.220,3260] successful.
Aug 14 19:47:00 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5f3286-1466-4fac-9bd5-65b692a35791 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06e0bd8-cb31-4c24-ac7d-b1dea60096c6]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] <== disconnect_volume: return (279ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:47:00 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Deleting instance files /opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24_del
Aug 14 19:47:00 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Deletion of /opt/stack/data/nova/instances/39039cef-13fa-4434-9edc-4628757cbc24_del complete
Aug 14 19:47:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72782) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 14 19:47:00 user nova-compute[72782]: INFO nova.virt.libvirt.host [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] UEFI support detected
Aug 14 19:47:00 user nova-compute[72782]: INFO nova.compute.manager [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:00 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:47:00 user nova-compute[72782]: INFO nova.compute.claims [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Claim successful on node user
Aug 14 19:47:00 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:47:01 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:47:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:47:01 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Creating image(s)
Aug 14 19:47:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "/opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "/opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "/opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG nova.policy [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b27442ebb5704123ad7c8f0f78660176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1bf9f154f641798504207c6db32799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:47:01 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Took 1.12 seconds to deallocate network for instance.
Aug 14 19:47:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-d982b3fe-378f-47bc-b854-fc1a3c553ff6 req-7d94753e-d383-4a8f-9e87-715eb20f2f8d service nova] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Received event network-vif-plugged-16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d982b3fe-378f-47bc-b854-fc1a3c553ff6 req-7d94753e-d383-4a8f-9e87-715eb20f2f8d service nova] Acquiring lock "39039cef-13fa-4434-9edc-4628757cbc24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d982b3fe-378f-47bc-b854-fc1a3c553ff6 req-7d94753e-d383-4a8f-9e87-715eb20f2f8d service nova] Lock "39039cef-13fa-4434-9edc-4628757cbc24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d982b3fe-378f-47bc-b854-fc1a3c553ff6 req-7d94753e-d383-4a8f-9e87-715eb20f2f8d service nova] Lock "39039cef-13fa-4434-9edc-4628757cbc24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-d982b3fe-378f-47bc-b854-fc1a3c553ff6 req-7d94753e-d383-4a8f-9e87-715eb20f2f8d service nova] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] No waiting events found dispatching network-vif-plugged-16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:01 user nova-compute[72782]: WARNING nova.compute.manager [req-d982b3fe-378f-47bc-b854-fc1a3c553ff6 req-7d94753e-d383-4a8f-9e87-715eb20f2f8d service nova] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Received unexpected event network-vif-plugged-16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9 for instance with vm_state active and task_state deleting.
Aug 14 19:47:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-d982b3fe-378f-47bc-b854-fc1a3c553ff6 req-7d94753e-d383-4a8f-9e87-715eb20f2f8d service nova] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Received event network-vif-deleted-16ab6ae5-2d22-4c8b-ad64-c8ab250e9dd9 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.296s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk 1073741824" returned: 0 in 0.122s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.426s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Successfully created port: 2dad6c60-4f31-4548-bfe7-31c85495c454 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Cannot resize image /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lazy-loading 'migration_context' on Instance uuid 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Ensure instance console log exists: /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:02 user nova-compute[72782]: INFO nova.compute.manager [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Took 0.86 seconds to detach 1 volumes for instance.
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:47:02 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Creating image(s)
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Did not create local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Ensure instance console log exists: /opt/stack/data/nova/instances/00a09aca-9913-4fba-91c6-9702c0dc44bd/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Start _get_guest_xml network_info=[{"id": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "address": "fa:16:3e:7d:5e:0a", "network": {"id": "64006a4f-c433-4a4b-9eb1-9c01b1f92998", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-602656292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad9c25e-14", "ovs_interfaceid": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed05074c-e64e-4323-92de-d9594c044eb2", "address": "fa:16:3e:34:10:52", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped05074c-e6", "ovs_interfaceid": "ed05074c-e64e-4323-92de-d9594c044eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "address": "fa:16:3e:10:73:ae", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape703e10a-c7", "ovs_interfaceid": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "address": "fa:16:3e:3a:bb:18", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1deb99-9d", "ovs_interfaceid": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26080d32-4bd6-4320-b80a-200076d568d5", "address": "fa:16:3e:af:e3:b1", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26080d32-4b", "ovs_interfaceid": "26080d32-4bd6-4320-b80a-200076d568d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "address": "fa:16:3e:35:0e:71", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbbd012-f8", "ovs_interfaceid": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9302e1b4-e070-4dc6-afed-103549c16da0", "address": "fa:16:3e:41:db:4c", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9302e1b4-e0", "ovs_interfaceid": "9302e1b4-e070-4dc6-afed-103549c16da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'a9203dd7-3254-4c99-a3a9-1d2eab67b6ad', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztLqrNsk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '00a09aca-9913-4fba-91c6-9702c0dc44bd', 'attached_at': '', 'detached_at': '', 'volume_id': '1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04', 'serial': '1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04'}, 'volume_type': None}, {'guest_format': None, 'attachment_id': 'd620a274-3c0a-4d5e-a0e4-a02b4665efe3', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': 1, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNyhpGvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '00a09aca-9913-4fba-91c6-9702c0dc44bd', 'attached_at': '', 'detached_at': '', 'volume_id': '2520d4d3-9583-40a3-af3c-1e4eb5131950', 'serial': '2520d4d3-9583-40a3-af3c-1e4eb5131950'}, 'volume_type': None}, {'guest_format': None, 'attachment_id': '2b087172-dfb0-4e59-a8bf-a90671c5f845', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'boot_index': 2, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vReGOZni', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '00a09aca-9913-4fba-91c6-9702c0dc44bd', 'attached_at': '', 'detached_at': '', 'volume_id': 'f6556a3c-a0de-4a83-bc13-cefbae62165b', 'serial': 'f6556a3c-a0de-4a83-bc13-cefbae62165b'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:47:02 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:47:02 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztLqrNsk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:02 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:02 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:02 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa810fe9-c746-49a6-b01c-f01c19203b23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:47:02 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[36350fef-1d39-4303-b80e-901020d3593c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04] added
Aug 14 19:47:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5798c6-a4a0-4eeb-8e14-79f0ec1df08c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7573299-2b6b-409f-bc20-1dcc0c3d51ac]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztLqrNsk {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztLqrNsk" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f6ddfa-4108-4018-8196-326d1a7b268d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ztLqrNsk'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bedae5-1262-4092-af25-c2f8e7dbbd46]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb331412-d1e7-4e1f-87cf-0c88196254a3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 19:47:02 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 19:47:02 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:02 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 19:47:02 user nova-compute[72782]: 
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3f60ee-f786-487b-9064-23f70bdbb363]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04, portal: 172.16.0.220,3260]
Aug 14 19:47:02 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04, portal: 172.16.0.220,3260] successful.
Aug 14 19:47:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c35f42-67b1-4d6e-80e4-acef7ce2d81a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd739bfb-ae5c-4d30-a463-03831a53d498]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d345810c-2464-445a-93e8-dd4d4b3855d8]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztLqrNsk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Successfully updated port: 2dad6c60-4f31-4548-bfe7-31c85495c454 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "refresh_cache-28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquired lock "refresh_cache-28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:47:02 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:47:03 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Deleted allocations for instance 39039cef-13fa-4434-9edc-4628757cbc24
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-863b8226-d184-453b-aedf-8ce914cbe9a4 tempest-DeleteServersTestJSON-946815863 tempest-DeleteServersTestJSON-946815863-project-member] Lock "39039cef-13fa-4434-9edc-4628757cbc24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.977s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Updating instance_info_cache with network_info: [{"id": "2dad6c60-4f31-4548-bfe7-31c85495c454", "address": "fa:16:3e:57:2a:1c", "network": {"id": "16825893-d7a0-4b45-8921-c96e6333c811", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1870839756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1bf9f154f641798504207c6db32799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad6c60-4f", "ovs_interfaceid": "2dad6c60-4f31-4548-bfe7-31c85495c454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Releasing lock "refresh_cache-28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Instance network_info: |[{"id": "2dad6c60-4f31-4548-bfe7-31c85495c454", "address": "fa:16:3e:57:2a:1c", "network": {"id": "16825893-d7a0-4b45-8921-c96e6333c811", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1870839756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1bf9f154f641798504207c6db32799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad6c60-4f", "ovs_interfaceid": "2dad6c60-4f31-4548-bfe7-31c85495c454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Start _get_guest_xml network_info=[{"id": "2dad6c60-4f31-4548-bfe7-31c85495c454", "address": "fa:16:3e:57:2a:1c", "network": {"id": "16825893-d7a0-4b45-8921-c96e6333c811", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1870839756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1bf9f154f641798504207c6db32799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad6c60-4f", "ovs_interfaceid": "2dad6c60-4f31-4548-bfe7-31c85495c454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:47:03 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:47:03 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:46:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-719660631',display_name='tempest-SnapshotDataIntegrityTests-server-719660631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-719660631',id=10,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVG52vwPdA4Czn3J9NeyppiWVKqNRObR1xG0c6JuI0HYUCS0yQzgQzgKEePv8osGDNHleJ31NaUmxVuJTOlD0W5/3w+P50jXPGzy8QSkjaGfttIMIb2afTfOhnjc8tWJg==',key_name='tempest-keypair-11702859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1bf9f154f641798504207c6db32799',ramdisk_id='',reservation_id='r-5g3537t8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1958576853',owner_user_name='tempest-SnapshotDataIntegrityTests-1958576853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b27442ebb5704123ad7c8f0f78660176',uuid=28cfad06-8232-4d29-9d06-4bd0f2ac3e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dad6c60-4f31-4548-bfe7-31c85495c454", "address": "fa:16:3e:57:2a:1c", "network": {"id": "16825893-d7a0-4b45-8921-c96e6333c811", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1870839756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1bf9f154f641798504207c6db32799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad6c60-4f", "ovs_interfaceid": "2dad6c60-4f31-4548-bfe7-31c85495c454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Converting VIF {"id": "2dad6c60-4f31-4548-bfe7-31c85495c454", "address": "fa:16:3e:57:2a:1c", "network": {"id": "16825893-d7a0-4b45-8921-c96e6333c811", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1870839756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1bf9f154f641798504207c6db32799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad6c60-4f", "ovs_interfaceid": "2dad6c60-4f31-4548-bfe7-31c85495c454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:2a:1c,bridge_name='br-int',has_traffic_filtering=True,id=2dad6c60-4f31-4548-bfe7-31c85495c454,network=Network(16825893-d7a0-4b45-8921-c96e6333c811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad6c60-4f') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lazy-loading 'pci_devices' on Instance uuid 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:47:03 user nova-compute[72782]:   <uuid>28cfad06-8232-4d29-9d06-4bd0f2ac3e1f</uuid>
Aug 14 19:47:03 user nova-compute[72782]:   <name>instance-0000000a</name>
Aug 14 19:47:03 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:47:03 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:47:03 user nova-compute[72782]:   <metadata>
Aug 14 19:47:03 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:47:03 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:47:03 user nova-compute[72782]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-719660631</nova:name>
Aug 14 19:47:03 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:47:03</nova:creationTime>
Aug 14 19:47:03 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:47:03 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:47:03 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:47:03 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:47:03 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:47:03 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:47:03 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:47:03 user nova-compute[72782]:       <nova:owner>
Aug 14 19:47:03 user nova-compute[72782]:         <nova:user uuid="b27442ebb5704123ad7c8f0f78660176">tempest-SnapshotDataIntegrityTests-1958576853-project-member</nova:user>
Aug 14 19:47:03 user nova-compute[72782]:         <nova:project uuid="3a1bf9f154f641798504207c6db32799">tempest-SnapshotDataIntegrityTests-1958576853</nova:project>
Aug 14 19:47:03 user nova-compute[72782]:       </nova:owner>
Aug 14 19:47:03 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:47:03 user nova-compute[72782]:       <nova:ports>
Aug 14 19:47:03 user nova-compute[72782]:         <nova:port uuid="2dad6c60-4f31-4548-bfe7-31c85495c454">
Aug 14 19:47:03 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 19:47:03 user nova-compute[72782]:         </nova:port>
Aug 14 19:47:03 user nova-compute[72782]:       </nova:ports>
Aug 14 19:47:03 user nova-compute[72782]:     </nova:instance>
Aug 14 19:47:03 user nova-compute[72782]:   </metadata>
Aug 14 19:47:03 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:47:03 user nova-compute[72782]:     <system>
Aug 14 19:47:03 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:47:03 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:47:03 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:47:03 user nova-compute[72782]:       <entry name="serial">28cfad06-8232-4d29-9d06-4bd0f2ac3e1f</entry>
Aug 14 19:47:03 user nova-compute[72782]:       <entry name="uuid">28cfad06-8232-4d29-9d06-4bd0f2ac3e1f</entry>
Aug 14 19:47:03 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:47:03 user nova-compute[72782]:     </system>
Aug 14 19:47:03 user nova-compute[72782]:   </sysinfo>
Aug 14 19:47:03 user nova-compute[72782]:   <os>
Aug 14 19:47:03 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:47:03 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:47:03 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:47:03 user nova-compute[72782]:   </os>
Aug 14 19:47:03 user nova-compute[72782]:   <features>
Aug 14 19:47:03 user nova-compute[72782]:     <acpi/>
Aug 14 19:47:03 user nova-compute[72782]:     <apic/>
Aug 14 19:47:03 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:47:03 user nova-compute[72782]:   </features>
Aug 14 19:47:03 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:47:03 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:47:03 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:47:03 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:47:03 user nova-compute[72782]:   </clock>
Aug 14 19:47:03 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:47:03 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:47:03 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:47:03 user nova-compute[72782]:   </cpu>
Aug 14 19:47:03 user nova-compute[72782]:   <devices>
Aug 14 19:47:03 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:47:03 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:47:03 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk"/>
Aug 14 19:47:03 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:47:03 user nova-compute[72782]:     </disk>
Aug 14 19:47:03 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:47:03 user nova-compute[72782]:       <mac address="fa:16:3e:57:2a:1c"/>
Aug 14 19:47:03 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:47:03 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:47:03 user nova-compute[72782]:       <target dev="tap2dad6c60-4f"/>
Aug 14 19:47:03 user nova-compute[72782]:     </interface>
Aug 14 19:47:03 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:47:03 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/console.log" append="off"/>
Aug 14 19:47:03 user nova-compute[72782]:     </serial>
Aug 14 19:47:03 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:47:03 user nova-compute[72782]:     <video>
Aug 14 19:47:03 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:47:03 user nova-compute[72782]:     </video>
Aug 14 19:47:03 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:47:03 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:47:03 user nova-compute[72782]:     </rng>
Aug 14 19:47:03 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:47:03 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:47:03 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:47:03 user nova-compute[72782]:     </memballoon>
Aug 14 19:47:03 user nova-compute[72782]:   </devices>
Aug 14 19:47:03 user nova-compute[72782]: </domain>
Aug 14 19:47:03 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:46:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-719660631',display_name='tempest-SnapshotDataIntegrityTests-server-719660631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-719660631',id=10,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVG52vwPdA4Czn3J9NeyppiWVKqNRObR1xG0c6JuI0HYUCS0yQzgQzgKEePv8osGDNHleJ31NaUmxVuJTOlD0W5/3w+P50jXPGzy8QSkjaGfttIMIb2afTfOhnjc8tWJg==',key_name='tempest-keypair-11702859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1bf9f154f641798504207c6db32799',ramdisk_id='',reservation_id='r-5g3537t8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1958576853',owner_user_name='tempest-SnapshotDataIntegrityTests-1958576853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b27442ebb5704123ad7c8f0f78660176',uuid=28cfad06-8232-4d29-9d06-4bd0f2ac3e1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dad6c60-4f31-4548-bfe7-31c85495c454", "address": "fa:16:3e:57:2a:1c", "network": {"id": "16825893-d7a0-4b45-8921-c96e6333c811", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1870839756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1bf9f154f641798504207c6db32799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad6c60-4f", "ovs_interfaceid": "2dad6c60-4f31-4548-bfe7-31c85495c454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Converting VIF {"id": "2dad6c60-4f31-4548-bfe7-31c85495c454", "address": "fa:16:3e:57:2a:1c", "network": {"id": "16825893-d7a0-4b45-8921-c96e6333c811", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1870839756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1bf9f154f641798504207c6db32799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad6c60-4f", "ovs_interfaceid": "2dad6c60-4f31-4548-bfe7-31c85495c454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:2a:1c,bridge_name='br-int',has_traffic_filtering=True,id=2dad6c60-4f31-4548-bfe7-31c85495c454,network=Network(16825893-d7a0-4b45-8921-c96e6333c811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad6c60-4f') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG os_vif [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:2a:1c,bridge_name='br-int',has_traffic_filtering=True,id=2dad6c60-4f31-4548-bfe7-31c85495c454,network=Network(16825893-d7a0-4b45-8921-c96e6333c811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad6c60-4f') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dad6c60-4f, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2dad6c60-4f, col_values=(('external_ids', {'iface-id': '2dad6c60-4f31-4548-bfe7-31c85495c454', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:2a:1c', 'vm-uuid': '28cfad06-8232-4d29-9d06-4bd0f2ac3e1f'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:03 user nova-compute[72782]: INFO os_vif [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:2a:1c,bridge_name='br-int',has_traffic_filtering=True,id=2dad6c60-4f31-4548-bfe7-31c85495c454,network=Network(16825893-d7a0-4b45-8921-c96e6333c811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad6c60-4f')
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] No VIF found with MAC fa:16:3e:57:2a:1c, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-f95633c9-4643-41e8-9524-51716e9a7e86 req-6c945972-c9f9-4485-9250-8450b3e3bfa9 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Received event network-changed-2dad6c60-4f31-4548-bfe7-31c85495c454 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-f95633c9-4643-41e8-9524-51716e9a7e86 req-6c945972-c9f9-4485-9250-8450b3e3bfa9 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Refreshing instance network info cache due to event network-changed-2dad6c60-4f31-4548-bfe7-31c85495c454. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f95633c9-4643-41e8-9524-51716e9a7e86 req-6c945972-c9f9-4485-9250-8450b3e3bfa9 service nova] Acquiring lock "refresh_cache-28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f95633c9-4643-41e8-9524-51716e9a7e86 req-6c945972-c9f9-4485-9250-8450b3e3bfa9 service nova] Acquired lock "refresh_cache-28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.network.neutron [req-f95633c9-4643-41e8-9524-51716e9a7e86 req-6c945972-c9f9-4485-9250-8450b3e3bfa9 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Refreshing network info cache for port 2dad6c60-4f31-4548-bfe7-31c85495c454 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23763666337353961', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763666337353961', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNyhpGvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:04 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:04 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:04 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ae826b-bce7-4d4f-8c6d-70a323a28a12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:47:04 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5e54c3-680f-4cb2-bb63-80af804278df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950] added
Aug 14 19:47:04 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[df07eac0-8c23-4a35-9129-0030593107b4]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b2325e-f8ac-4064-9c85-e70f85691900]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RNyhpGvC {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RNyhpGvC" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[35371e99-d9a1-493a-bbdf-ea6cdff0fce9]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RNyhpGvC'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG nova.network.neutron [req-f95633c9-4643-41e8-9524-51716e9a7e86 req-6c945972-c9f9-4485-9250-8450b3e3bfa9 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Updated VIF entry in instance network info cache for port 2dad6c60-4f31-4548-bfe7-31c85495c454. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG nova.network.neutron [req-f95633c9-4643-41e8-9524-51716e9a7e86 req-6c945972-c9f9-4485-9250-8450b3e3bfa9 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Updating instance_info_cache with network_info: [{"id": "2dad6c60-4f31-4548-bfe7-31c85495c454", "address": "fa:16:3e:57:2a:1c", "network": {"id": "16825893-d7a0-4b45-8921-c96e6333c811", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1870839756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1bf9f154f641798504207c6db32799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad6c60-4f", "ovs_interfaceid": "2dad6c60-4f31-4548-bfe7-31c85495c454", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfba32b-f603-4028-8ca1-dcaa6927d9df]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f95633c9-4643-41e8-9524-51716e9a7e86 req-6c945972-c9f9-4485-9250-8450b3e3bfa9 service nova] Releasing lock "refresh_cache-28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9babf09-4a7f-4bd8-9597-bdcfa93ac012]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:04 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:04 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10096ba-4edb-465c-833e-80f20be3b69b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950, portal: 172.16.0.220,3260]
Aug 14 19:47:04 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950, portal: 172.16.0.220,3260] successful.
Aug 14 19:47:04 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d28292-21ea-481c-a9b0-79368d9a4d2b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3d4836-e603-429c-823e-f219faf366f9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:04 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:04 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:04 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:04 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0cbbaa-e278-4df7-a989-7dbfd3790599]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNyhpGvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26139663065633466', 'path': '/dev/sdc'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139663065633466', 'path': '/dev/sdc'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vReGOZni', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:05 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:05 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:05 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[877ead4a-371f-4d0f-bd48-25320659bcdd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:47:05 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2821ceaa-2a86-43ad-a958-dec7b77e610e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b] added
Aug 14 19:47:05 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b68411e-3e03-41f1-9f14-3fa7fe4e94ba]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[be866743-688c-424a-b015-e0ed7f45dacc]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vReGOZni {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vReGOZni" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ff07e4-8e7c-45ca-a47f-ede9139cb1df]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vReGOZni'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4254e29a-198f-42d7-ac11-7fcce633a8d0]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dd846c-1e56-4774-bd86-86d2d40e7648]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3e7fd5f-1046-4873-a0ca-534455e08c4c (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:05 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:05 user nova-compute[72782]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3e7fd5f-1046-4873-a0ca-534455e08c4c (non-flash)
Aug 14 19:47:05 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:05 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:05 user nova-compute[72782]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3e7fd5f-1046-4873-a0ca-534455e08c4c (non-flash)
Aug 14 19:47:05 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7f59ac-2e16-4722-81ba-1217c7aa455a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b, portal: 172.16.0.220,3260]
Aug 14 19:47:05 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b, portal: 172.16.0.220,3260] successful.
Aug 14 19:47:05 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c04b1f2-28dc-418c-aeb8-d5c56320eff1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fcf7f9-7f07-47c4-aa80-6d42c82466da]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3e7fd5f-1046-4873-a0ca-534455e08c4c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:05 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:05 user nova-compute[72782]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3e7fd5f-1046-4873-a0ca-534455e08c4c (non-flash)
Aug 14 19:47:05 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:05 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:05 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:05 user nova-compute[72782]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3e7fd5f-1046-4873-a0ca-534455e08c4c (non-flash)
Aug 14 19:47:05 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:05 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3a8cd7-1e74-4d64-aedb-eae3951f9488]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vReGOZni', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-8e36b737-5e48-4078-b1a8-ba118e1901a4 req-915aeb23-5f10-4303-9ea3-23323e927095 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Received event network-vif-plugged-2dad6c60-4f31-4548-bfe7-31c85495c454 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8e36b737-5e48-4078-b1a8-ba118e1901a4 req-915aeb23-5f10-4303-9ea3-23323e927095 service nova] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8e36b737-5e48-4078-b1a8-ba118e1901a4 req-915aeb23-5f10-4303-9ea3-23323e927095 service nova] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8e36b737-5e48-4078-b1a8-ba118e1901a4 req-915aeb23-5f10-4303-9ea3-23323e927095 service nova] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-8e36b737-5e48-4078-b1a8-ba118e1901a4 req-915aeb23-5f10-4303-9ea3-23323e927095 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] No waiting events found dispatching network-vif-plugged-2dad6c60-4f31-4548-bfe7-31c85495c454 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:05 user nova-compute[72782]: WARNING nova.compute.manager [req-8e36b737-5e48-4078-b1a8-ba118e1901a4 req-915aeb23-5f10-4303-9ea3-23323e927095 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Received unexpected event network-vif-plugged-2dad6c60-4f31-4548-bfe7-31c85495c454 for instance with vm_state building and task_state spawning.
Aug 14 19:47:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-8e36b737-5e48-4078-b1a8-ba118e1901a4 req-915aeb23-5f10-4303-9ea3-23323e927095 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Received event network-vif-plugged-2dad6c60-4f31-4548-bfe7-31c85495c454 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8e36b737-5e48-4078-b1a8-ba118e1901a4 req-915aeb23-5f10-4303-9ea3-23323e927095 service nova] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8e36b737-5e48-4078-b1a8-ba118e1901a4 req-915aeb23-5f10-4303-9ea3-23323e927095 service nova] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8e36b737-5e48-4078-b1a8-ba118e1901a4 req-915aeb23-5f10-4303-9ea3-23323e927095 service nova] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-8e36b737-5e48-4078-b1a8-ba118e1901a4 req-915aeb23-5f10-4303-9ea3-23323e927095 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] No waiting events found dispatching network-vif-plugged-2dad6c60-4f31-4548-bfe7-31c85495c454 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:05 user nova-compute[72782]: WARNING nova.compute.manager [req-8e36b737-5e48-4078-b1a8-ba118e1901a4 req-915aeb23-5f10-4303-9ea3-23323e927095 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Received unexpected event network-vif-plugged-2dad6c60-4f31-4548-bfe7-31c85495c454 for instance with vm_state building and task_state spawning.
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG nova.objects.instance [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'flavor' on Instance uuid 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:06 user nova-compute[72782]: INFO nova.compute.manager [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Attaching volume 114e53d3-d652-4c90-9e16-2c52a44e1c96 to /dev/vdb
Aug 14 19:47:06 user nova-compute[72782]: DEBUG os_brick.utils [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6453141-d104-4e90-b925-4376fee534a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[408e1b29-a81d-40cc-870f-18127f19f4e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[034ab5d4-45cf-4ecd-8456-a1a2d4ca209e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa881c5-ff63-481e-b960-12c7a6d04b6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:47:06 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:47:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[632183db-86e0-43da-a25f-6cb51747cacd]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG os_brick.utils [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Updating existing volume attachment record: d4d2e2c3-267a-47f9-9250-bce6669cc811 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '26562353366333638', 'path': '/dev/sde'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562353366333638', 'path': '/dev/sde'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "address": "fa:16:3e:7d:5e:0a", "network": {"id": "64006a4f-c433-4a4b-9eb1-9c01b1f92998", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-602656292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad9c25e-14", "ovs_interfaceid": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "address": "fa:16:3e:7d:5e:0a", "network": {"id": "64006a4f-c433-4a4b-9eb1-9c01b1f92998", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-602656292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad9c25e-14", "ovs_interfaceid": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5e:0a,bridge_name='br-int',has_traffic_filtering=True,id=7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b,network=Network(64006a4f-c433-4a4b-9eb1-9c01b1f92998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ad9c25e-14') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed05074c-e64e-4323-92de-d9594c044eb2", "address": "fa:16:3e:34:10:52", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped05074c-e6", "ovs_interfaceid": "ed05074c-e64e-4323-92de-d9594c044eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "ed05074c-e64e-4323-92de-d9594c044eb2", "address": "fa:16:3e:34:10:52", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped05074c-e6", "ovs_interfaceid": "ed05074c-e64e-4323-92de-d9594c044eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:10:52,bridge_name='br-int',has_traffic_filtering=True,id=ed05074c-e64e-4323-92de-d9594c044eb2,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped05074c-e6') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "address": "fa:16:3e:10:73:ae", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape703e10a-c7", "ovs_interfaceid": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "address": "fa:16:3e:10:73:ae", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape703e10a-c7", "ovs_interfaceid": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:73:ae,bridge_name='br-int',has_traffic_filtering=True,id=e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape703e10a-c7') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "address": "fa:16:3e:3a:bb:18", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1deb99-9d", "ovs_interfaceid": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "address": "fa:16:3e:3a:bb:18", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1deb99-9d", "ovs_interfaceid": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:bb:18,bridge_name='br-int',has_traffic_filtering=True,id=4e1deb99-9d04-4e8a-9436-a65820a2852b,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e1deb99-9d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26080d32-4bd6-4320-b80a-200076d568d5", "address": "fa:16:3e:af:e3:b1", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26080d32-4b", "ovs_interfaceid": "26080d32-4bd6-4320-b80a-200076d568d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "26080d32-4bd6-4320-b80a-200076d568d5", "address": "fa:16:3e:af:e3:b1", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26080d32-4b", "ovs_interfaceid": "26080d32-4bd6-4320-b80a-200076d568d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:e3:b1,bridge_name='br-int',has_traffic_filtering=True,id=26080d32-4bd6-4320-b80a-200076d568d5,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26080d32-4b') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "address": "fa:16:3e:35:0e:71", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbbd012-f8", "ovs_interfaceid": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "address": "fa:16:3e:35:0e:71", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbbd012-f8", "ovs_interfaceid": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:0e:71,bridge_name='br-int',has_traffic_filtering=True,id=5dbbd012-f83b-4066-8bbc-70425d5a95de,network=Network(76799c51-fdd0-42b2-b336-78eccfb25062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dbbd012-f8') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9302e1b4-e070-4dc6-afed-103549c16da0", "address": "fa:16:3e:41:db:4c", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9302e1b4-e0", "ovs_interfaceid": "9302e1b4-e070-4dc6-afed-103549c16da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "9302e1b4-e070-4dc6-afed-103549c16da0", "address": "fa:16:3e:41:db:4c", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9302e1b4-e0", "ovs_interfaceid": "9302e1b4-e070-4dc6-afed-103549c16da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:db:4c,bridge_name='br-int',has_traffic_filtering=True,id=9302e1b4-e070-4dc6-afed-103549c16da0,network=Network(76799c51-fdd0-42b2-b336-78eccfb25062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9302e1b4-e0') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.objects.instance [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lazy-loading 'pci_devices' on Instance uuid 00a09aca-9913-4fba-91c6-9702c0dc44bd {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:47:06 user nova-compute[72782]:   <uuid>00a09aca-9913-4fba-91c6-9702c0dc44bd</uuid>
Aug 14 19:47:06 user nova-compute[72782]:   <name>instance-00000009</name>
Aug 14 19:47:06 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:47:06 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:47:06 user nova-compute[72782]:   <metadata>
Aug 14 19:47:06 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:47:06 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:47:06 user nova-compute[72782]:       <nova:name>tempest-device-tagging-server-1038532838</nova:name>
Aug 14 19:47:06 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:47:02</nova:creationTime>
Aug 14 19:47:06 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:47:06 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:47:06 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:47:06 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:47:06 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:47:06 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:47:06 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:47:06 user nova-compute[72782]:       <nova:owner>
Aug 14 19:47:06 user nova-compute[72782]:         <nova:user uuid="624561a8bc094e8380135f5fbe91fb85">tempest-TaggedBootDevicesTest_v242-2000979356-project-member</nova:user>
Aug 14 19:47:06 user nova-compute[72782]:         <nova:project uuid="833f54e960414f2d80ed0f069bcafba5">tempest-TaggedBootDevicesTest_v242-2000979356</nova:project>
Aug 14 19:47:06 user nova-compute[72782]:       </nova:owner>
Aug 14 19:47:06 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:47:06 user nova-compute[72782]:       <nova:ports>
Aug 14 19:47:06 user nova-compute[72782]:         <nova:port uuid="7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b">
Aug 14 19:47:06 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 19:47:06 user nova-compute[72782]:         </nova:port>
Aug 14 19:47:06 user nova-compute[72782]:         <nova:port uuid="ed05074c-e64e-4323-92de-d9594c044eb2">
Aug 14 19:47:06 user nova-compute[72782]:           <nova:ip type="fixed" address="10.1.1.121" ipVersion="4"/>
Aug 14 19:47:06 user nova-compute[72782]:         </nova:port>
Aug 14 19:47:06 user nova-compute[72782]:         <nova:port uuid="e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd">
Aug 14 19:47:06 user nova-compute[72782]:           <nova:ip type="fixed" address="10.1.1.243" ipVersion="4"/>
Aug 14 19:47:06 user nova-compute[72782]:         </nova:port>
Aug 14 19:47:06 user nova-compute[72782]:         <nova:port uuid="4e1deb99-9d04-4e8a-9436-a65820a2852b">
Aug 14 19:47:06 user nova-compute[72782]:           <nova:ip type="fixed" address="10.1.1.175" ipVersion="4"/>
Aug 14 19:47:06 user nova-compute[72782]:         </nova:port>
Aug 14 19:47:06 user nova-compute[72782]:         <nova:port uuid="26080d32-4bd6-4320-b80a-200076d568d5">
Aug 14 19:47:06 user nova-compute[72782]:           <nova:ip type="fixed" address="10.1.1.109" ipVersion="4"/>
Aug 14 19:47:06 user nova-compute[72782]:         </nova:port>
Aug 14 19:47:06 user nova-compute[72782]:         <nova:port uuid="5dbbd012-f83b-4066-8bbc-70425d5a95de">
Aug 14 19:47:06 user nova-compute[72782]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 14 19:47:06 user nova-compute[72782]:         </nova:port>
Aug 14 19:47:06 user nova-compute[72782]:         <nova:port uuid="9302e1b4-e070-4dc6-afed-103549c16da0">
Aug 14 19:47:06 user nova-compute[72782]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 14 19:47:06 user nova-compute[72782]:         </nova:port>
Aug 14 19:47:06 user nova-compute[72782]:       </nova:ports>
Aug 14 19:47:06 user nova-compute[72782]:     </nova:instance>
Aug 14 19:47:06 user nova-compute[72782]:   </metadata>
Aug 14 19:47:06 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:47:06 user nova-compute[72782]:     <system>
Aug 14 19:47:06 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:47:06 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:47:06 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:47:06 user nova-compute[72782]:       <entry name="serial">00a09aca-9913-4fba-91c6-9702c0dc44bd</entry>
Aug 14 19:47:06 user nova-compute[72782]:       <entry name="uuid">00a09aca-9913-4fba-91c6-9702c0dc44bd</entry>
Aug 14 19:47:06 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:47:06 user nova-compute[72782]:     </system>
Aug 14 19:47:06 user nova-compute[72782]:   </sysinfo>
Aug 14 19:47:06 user nova-compute[72782]:   <os>
Aug 14 19:47:06 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:47:06 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:47:06 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:47:06 user nova-compute[72782]:   </os>
Aug 14 19:47:06 user nova-compute[72782]:   <features>
Aug 14 19:47:06 user nova-compute[72782]:     <acpi/>
Aug 14 19:47:06 user nova-compute[72782]:     <apic/>
Aug 14 19:47:06 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:47:06 user nova-compute[72782]:   </features>
Aug 14 19:47:06 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:47:06 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:47:06 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:47:06 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:47:06 user nova-compute[72782]:   </clock>
Aug 14 19:47:06 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:47:06 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:47:06 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:47:06 user nova-compute[72782]:   </cpu>
Aug 14 19:47:06 user nova-compute[72782]:   <devices>
Aug 14 19:47:06 user nova-compute[72782]:     <disk type="file" device="cdrom">
Aug 14 19:47:06 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 19:47:06 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/00a09aca-9913-4fba-91c6-9702c0dc44bd/disk.config"/>
Aug 14 19:47:06 user nova-compute[72782]:       <target dev="hda" bus="ide"/>
Aug 14 19:47:06 user nova-compute[72782]:     </disk>
Aug 14 19:47:06 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 19:47:06 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:47:06 user nova-compute[72782]:       <source dev="/dev/sdb"/>
Aug 14 19:47:06 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:47:06 user nova-compute[72782]:       <serial>1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04</serial>
Aug 14 19:47:06 user nova-compute[72782]:     </disk>
Aug 14 19:47:06 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 19:47:06 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:47:06 user nova-compute[72782]:       <source dev="/dev/sdc"/>
Aug 14 19:47:06 user nova-compute[72782]:       <target dev="vdb" bus="virtio"/>
Aug 14 19:47:06 user nova-compute[72782]:       <serial>2520d4d3-9583-40a3-af3c-1e4eb5131950</serial>
Aug 14 19:47:06 user nova-compute[72782]:     </disk>
Aug 14 19:47:06 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 19:47:06 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:47:06 user nova-compute[72782]:       <source dev="/dev/sde"/>
Aug 14 19:47:06 user nova-compute[72782]:       <target dev="vdc" bus="virtio"/>
Aug 14 19:47:06 user nova-compute[72782]:       <serial>f6556a3c-a0de-4a83-bc13-cefbae62165b</serial>
Aug 14 19:47:06 user nova-compute[72782]:     </disk>
Aug 14 19:47:06 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:47:06 user nova-compute[72782]:       <mac address="fa:16:3e:7d:5e:0a"/>
Aug 14 19:47:06 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:47:06 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:47:06 user nova-compute[72782]:       <target dev="tap7ad9c25e-14"/>
Aug 14 19:47:06 user nova-compute[72782]:     </interface>
Aug 14 19:47:06 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:47:06 user nova-compute[72782]:       <mac address="fa:16:3e:34:10:52"/>
Aug 14 19:47:06 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:47:06 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:47:06 user nova-compute[72782]:       <target dev="taped05074c-e6"/>
Aug 14 19:47:06 user nova-compute[72782]:     </interface>
Aug 14 19:47:06 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:47:06 user nova-compute[72782]:       <mac address="fa:16:3e:10:73:ae"/>
Aug 14 19:47:06 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:47:06 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:47:06 user nova-compute[72782]:       <target dev="tape703e10a-c7"/>
Aug 14 19:47:06 user nova-compute[72782]:     </interface>
Aug 14 19:47:06 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:47:06 user nova-compute[72782]:       <mac address="fa:16:3e:3a:bb:18"/>
Aug 14 19:47:06 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:47:06 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:47:06 user nova-compute[72782]:       <target dev="tap4e1deb99-9d"/>
Aug 14 19:47:06 user nova-compute[72782]:     </interface>
Aug 14 19:47:06 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:47:06 user nova-compute[72782]:       <mac address="fa:16:3e:af:e3:b1"/>
Aug 14 19:47:06 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:47:06 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:47:06 user nova-compute[72782]:       <target dev="tap26080d32-4b"/>
Aug 14 19:47:06 user nova-compute[72782]:     </interface>
Aug 14 19:47:06 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:47:06 user nova-compute[72782]:       <mac address="fa:16:3e:35:0e:71"/>
Aug 14 19:47:06 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:47:06 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:47:06 user nova-compute[72782]:       <target dev="tap5dbbd012-f8"/>
Aug 14 19:47:06 user nova-compute[72782]:     </interface>
Aug 14 19:47:06 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:47:06 user nova-compute[72782]:       <mac address="fa:16:3e:41:db:4c"/>
Aug 14 19:47:06 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:47:06 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:47:06 user nova-compute[72782]:       <target dev="tap9302e1b4-e0"/>
Aug 14 19:47:06 user nova-compute[72782]:     </interface>
Aug 14 19:47:06 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:47:06 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/00a09aca-9913-4fba-91c6-9702c0dc44bd/console.log" append="off"/>
Aug 14 19:47:06 user nova-compute[72782]:     </serial>
Aug 14 19:47:06 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:47:06 user nova-compute[72782]:     <video>
Aug 14 19:47:06 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:47:06 user nova-compute[72782]:     </video>
Aug 14 19:47:06 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:47:06 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:47:06 user nova-compute[72782]:     </rng>
Aug 14 19:47:06 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:47:06 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:47:06 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:47:06 user nova-compute[72782]:     </memballoon>
Aug 14 19:47:06 user nova-compute[72782]:   </devices>
Aug 14 19:47:06 user nova-compute[72782]: </domain>
Aug 14 19:47:06 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "address": "fa:16:3e:7d:5e:0a", "network": {"id": "64006a4f-c433-4a4b-9eb1-9c01b1f92998", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-602656292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad9c25e-14", "ovs_interfaceid": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "address": "fa:16:3e:7d:5e:0a", "network": {"id": "64006a4f-c433-4a4b-9eb1-9c01b1f92998", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-602656292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad9c25e-14", "ovs_interfaceid": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5e:0a,bridge_name='br-int',has_traffic_filtering=True,id=7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b,network=Network(64006a4f-c433-4a4b-9eb1-9c01b1f92998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ad9c25e-14') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG os_vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5e:0a,bridge_name='br-int',has_traffic_filtering=True,id=7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b,network=Network(64006a4f-c433-4a4b-9eb1-9c01b1f92998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ad9c25e-14') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ad9c25e-14, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ad9c25e-14, col_values=(('external_ids', {'iface-id': '7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:5e:0a', 'vm-uuid': '00a09aca-9913-4fba-91c6-9702c0dc44bd'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:06 user nova-compute[72782]: INFO os_vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5e:0a,bridge_name='br-int',has_traffic_filtering=True,id=7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b,network=Network(64006a4f-c433-4a4b-9eb1-9c01b1f92998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ad9c25e-14')
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed05074c-e64e-4323-92de-d9594c044eb2", "address": "fa:16:3e:34:10:52", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped05074c-e6", "ovs_interfaceid": "ed05074c-e64e-4323-92de-d9594c044eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "ed05074c-e64e-4323-92de-d9594c044eb2", "address": "fa:16:3e:34:10:52", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped05074c-e6", "ovs_interfaceid": "ed05074c-e64e-4323-92de-d9594c044eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:10:52,bridge_name='br-int',has_traffic_filtering=True,id=ed05074c-e64e-4323-92de-d9594c044eb2,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped05074c-e6') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG os_vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:10:52,bridge_name='br-int',has_traffic_filtering=True,id=ed05074c-e64e-4323-92de-d9594c044eb2,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped05074c-e6') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped05074c-e6, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped05074c-e6, col_values=(('external_ids', {'iface-id': 'ed05074c-e64e-4323-92de-d9594c044eb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:10:52', 'vm-uuid': '00a09aca-9913-4fba-91c6-9702c0dc44bd'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:06 user nova-compute[72782]: INFO os_vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:10:52,bridge_name='br-int',has_traffic_filtering=True,id=ed05074c-e64e-4323-92de-d9594c044eb2,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped05074c-e6')
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "address": "fa:16:3e:10:73:ae", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape703e10a-c7", "ovs_interfaceid": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "address": "fa:16:3e:10:73:ae", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape703e10a-c7", "ovs_interfaceid": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:73:ae,bridge_name='br-int',has_traffic_filtering=True,id=e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape703e10a-c7') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG os_vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:73:ae,bridge_name='br-int',has_traffic_filtering=True,id=e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape703e10a-c7') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape703e10a-c7, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape703e10a-c7, col_values=(('external_ids', {'iface-id': 'e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:73:ae', 'vm-uuid': '00a09aca-9913-4fba-91c6-9702c0dc44bd'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:06 user nova-compute[72782]: INFO os_vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:73:ae,bridge_name='br-int',has_traffic_filtering=True,id=e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape703e10a-c7')
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "address": "fa:16:3e:3a:bb:18", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1deb99-9d", "ovs_interfaceid": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "address": "fa:16:3e:3a:bb:18", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1deb99-9d", "ovs_interfaceid": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:bb:18,bridge_name='br-int',has_traffic_filtering=True,id=4e1deb99-9d04-4e8a-9436-a65820a2852b,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e1deb99-9d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG os_vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:bb:18,bridge_name='br-int',has_traffic_filtering=True,id=4e1deb99-9d04-4e8a-9436-a65820a2852b,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e1deb99-9d') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e1deb99-9d, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4e1deb99-9d, col_values=(('external_ids', {'iface-id': '4e1deb99-9d04-4e8a-9436-a65820a2852b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:bb:18', 'vm-uuid': '00a09aca-9913-4fba-91c6-9702c0dc44bd'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:07 user nova-compute[72782]: INFO os_vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:bb:18,bridge_name='br-int',has_traffic_filtering=True,id=4e1deb99-9d04-4e8a-9436-a65820a2852b,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e1deb99-9d')
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26080d32-4bd6-4320-b80a-200076d568d5", "address": "fa:16:3e:af:e3:b1", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26080d32-4b", "ovs_interfaceid": "26080d32-4bd6-4320-b80a-200076d568d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "26080d32-4bd6-4320-b80a-200076d568d5", "address": "fa:16:3e:af:e3:b1", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26080d32-4b", "ovs_interfaceid": "26080d32-4bd6-4320-b80a-200076d568d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:e3:b1,bridge_name='br-int',has_traffic_filtering=True,id=26080d32-4bd6-4320-b80a-200076d568d5,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26080d32-4b') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG os_vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:e3:b1,bridge_name='br-int',has_traffic_filtering=True,id=26080d32-4bd6-4320-b80a-200076d568d5,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26080d32-4b') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26080d32-4b, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26080d32-4b, col_values=(('external_ids', {'iface-id': '26080d32-4bd6-4320-b80a-200076d568d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:e3:b1', 'vm-uuid': '00a09aca-9913-4fba-91c6-9702c0dc44bd'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:07 user nova-compute[72782]: INFO os_vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:e3:b1,bridge_name='br-int',has_traffic_filtering=True,id=26080d32-4bd6-4320-b80a-200076d568d5,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26080d32-4b')
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "address": "fa:16:3e:35:0e:71", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbbd012-f8", "ovs_interfaceid": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "address": "fa:16:3e:35:0e:71", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbbd012-f8", "ovs_interfaceid": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:0e:71,bridge_name='br-int',has_traffic_filtering=True,id=5dbbd012-f83b-4066-8bbc-70425d5a95de,network=Network(76799c51-fdd0-42b2-b336-78eccfb25062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dbbd012-f8') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG os_vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0e:71,bridge_name='br-int',has_traffic_filtering=True,id=5dbbd012-f83b-4066-8bbc-70425d5a95de,network=Network(76799c51-fdd0-42b2-b336-78eccfb25062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dbbd012-f8') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5dbbd012-f8, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5dbbd012-f8, col_values=(('external_ids', {'iface-id': '5dbbd012-f83b-4066-8bbc-70425d5a95de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:0e:71', 'vm-uuid': '00a09aca-9913-4fba-91c6-9702c0dc44bd'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:07 user nova-compute[72782]: INFO os_vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0e:71,bridge_name='br-int',has_traffic_filtering=True,id=5dbbd012-f83b-4066-8bbc-70425d5a95de,network=Network(76799c51-fdd0-42b2-b336-78eccfb25062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dbbd012-f8')
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9302e1b4-e070-4dc6-afed-103549c16da0", "address": "fa:16:3e:41:db:4c", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9302e1b4-e0", "ovs_interfaceid": "9302e1b4-e070-4dc6-afed-103549c16da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "9302e1b4-e070-4dc6-afed-103549c16da0", "address": "fa:16:3e:41:db:4c", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9302e1b4-e0", "ovs_interfaceid": "9302e1b4-e070-4dc6-afed-103549c16da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:db:4c,bridge_name='br-int',has_traffic_filtering=True,id=9302e1b4-e070-4dc6-afed-103549c16da0,network=Network(76799c51-fdd0-42b2-b336-78eccfb25062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9302e1b4-e0') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG os_vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:db:4c,bridge_name='br-int',has_traffic_filtering=True,id=9302e1b4-e070-4dc6-afed-103549c16da0,network=Network(76799c51-fdd0-42b2-b336-78eccfb25062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9302e1b4-e0') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9302e1b4-e0, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9302e1b4-e0, col_values=(('external_ids', {'iface-id': '9302e1b4-e070-4dc6-afed-103549c16da0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:db:4c', 'vm-uuid': '00a09aca-9913-4fba-91c6-9702c0dc44bd'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:07 user nova-compute[72782]: INFO os_vif [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:db:4c,bridge_name='br-int',has_traffic_filtering=True,id=9302e1b4-e070-4dc6-afed-103549c16da0,network=Network(76799c51-fdd0-42b2-b336-78eccfb25062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9302e1b4-e0')
Aug 14 19:47:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] No BDM found with device name hda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] No VIF found with MAC fa:16:3e:7d:5e:0a, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] No VIF found with MAC fa:16:3e:af:e3:b1, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:47:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Using config drive
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042427.3570487, 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:47:07 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] VM Resumed (Lifecycle Event)
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:47:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Instance spawned successfully.
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:47:07 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042427.3583882, 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:47:07 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] VM Started (Lifecycle Event)
Aug 14 19:47:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Creating config drive at /opt/stack/data/nova/instances/00a09aca-9913-4fba-91c6-9702c0dc44bd/disk.config
Aug 14 19:47:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/00a09aca-9913-4fba-91c6-9702c0dc44bd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp11mkstjk {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:47:07 user nova-compute[72782]: INFO nova.compute.manager [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Took 6.23 seconds to spawn the instance on the hypervisor.
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/00a09aca-9913-4fba-91c6-9702c0dc44bd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp11mkstjk" returned: 0 in 0.059s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:47:07 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:47:07 user nova-compute[72782]: INFO nova.compute.manager [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Took 7.08 seconds to build instance.
Aug 14 19:47:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d6e8231-bf0e-4d13-937a-f3ec1fde16e6 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.183s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG nova.compute.manager [req-2f1c3550-9d34-497e-9171-175f5e2a1e8b req-43124739-9de3-4596-9c71-e4ab7fc00141 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Received event network-changed-f11177e3-e8db-464f-b8be-971cb3afcdf8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG nova.compute.manager [req-2f1c3550-9d34-497e-9171-175f5e2a1e8b req-43124739-9de3-4596-9c71-e4ab7fc00141 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Refreshing instance network info cache due to event network-changed-f11177e3-e8db-464f-b8be-971cb3afcdf8. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2f1c3550-9d34-497e-9171-175f5e2a1e8b req-43124739-9de3-4596-9c71-e4ab7fc00141 service nova] Acquiring lock "refresh_cache-03fc42b1-f33d-4930-ba65-22540584b7fe" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2f1c3550-9d34-497e-9171-175f5e2a1e8b req-43124739-9de3-4596-9c71-e4ab7fc00141 service nova] Acquired lock "refresh_cache-03fc42b1-f33d-4930-ba65-22540584b7fe" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG nova.network.neutron [req-2f1c3550-9d34-497e-9171-175f5e2a1e8b req-43124739-9de3-4596-9c71-e4ab7fc00141 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Refreshing network info cache for port f11177e3-e8db-464f-b8be-971cb3afcdf8 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG nova.compute.manager [req-66d6d20d-15c8-41b1-9d6e-8491d776fafa req-0fbd667b-915b-4735-9dbc-f5d9ad1682c8 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Received event network-changed-888a72be-5707-4d58-98e1-b472c928de22 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG nova.compute.manager [req-66d6d20d-15c8-41b1-9d6e-8491d776fafa req-0fbd667b-915b-4735-9dbc-f5d9ad1682c8 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Refreshing instance network info cache due to event network-changed-888a72be-5707-4d58-98e1-b472c928de22. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-66d6d20d-15c8-41b1-9d6e-8491d776fafa req-0fbd667b-915b-4735-9dbc-f5d9ad1682c8 service nova] Acquiring lock "refresh_cache-b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-66d6d20d-15c8-41b1-9d6e-8491d776fafa req-0fbd667b-915b-4735-9dbc-f5d9ad1682c8 service nova] Acquired lock "refresh_cache-b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:47:09 user nova-compute[72782]: DEBUG nova.network.neutron [req-66d6d20d-15c8-41b1-9d6e-8491d776fafa req-0fbd667b-915b-4735-9dbc-f5d9ad1682c8 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Refreshing network info cache for port 888a72be-5707-4d58-98e1-b472c928de22 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:47:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-d821bcfd-0891-4633-a1bd-26abe4658a66 req-9c87a461-2cb4-4433-8fd7-ab3be95bf92d service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d821bcfd-0891-4633-a1bd-26abe4658a66 req-9c87a461-2cb4-4433-8fd7-ab3be95bf92d service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d821bcfd-0891-4633-a1bd-26abe4658a66 req-9c87a461-2cb4-4433-8fd7-ab3be95bf92d service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d821bcfd-0891-4633-a1bd-26abe4658a66 req-9c87a461-2cb4-4433-8fd7-ab3be95bf92d service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-d821bcfd-0891-4633-a1bd-26abe4658a66 req-9c87a461-2cb4-4433-8fd7-ab3be95bf92d service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:10 user nova-compute[72782]: WARNING nova.compute.manager [req-d821bcfd-0891-4633-a1bd-26abe4658a66 req-9c87a461-2cb4-4433-8fd7-ab3be95bf92d service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd for instance with vm_state building and task_state spawning.
Aug 14 19:47:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG nova.network.neutron [req-2f1c3550-9d34-497e-9171-175f5e2a1e8b req-43124739-9de3-4596-9c71-e4ab7fc00141 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Updated VIF entry in instance network info cache for port f11177e3-e8db-464f-b8be-971cb3afcdf8. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG nova.network.neutron [req-2f1c3550-9d34-497e-9171-175f5e2a1e8b req-43124739-9de3-4596-9c71-e4ab7fc00141 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Updating instance_info_cache with network_info: [{"id": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "address": "fa:16:3e:ae:6b:5f", "network": {"id": "f9f76ffd-5958-4a0b-b374-47e53fc2c74c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-415651663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259cfb8159bd4a3bb97eafcd7ddbfa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11177e3-e8", "ovs_interfaceid": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2f1c3550-9d34-497e-9171-175f5e2a1e8b req-43124739-9de3-4596-9c71-e4ab7fc00141 service nova] Releasing lock "refresh_cache-03fc42b1-f33d-4930-ba65-22540584b7fe" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-be82e0c0-d650-40aa-bdda-b11430a7cd6b req-47d456f9-4851-4e7c-affa-89189cb5cfb0 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-be82e0c0-d650-40aa-bdda-b11430a7cd6b req-47d456f9-4851-4e7c-affa-89189cb5cfb0 service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-be82e0c0-d650-40aa-bdda-b11430a7cd6b req-47d456f9-4851-4e7c-affa-89189cb5cfb0 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-be82e0c0-d650-40aa-bdda-b11430a7cd6b req-47d456f9-4851-4e7c-affa-89189cb5cfb0 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-be82e0c0-d650-40aa-bdda-b11430a7cd6b req-47d456f9-4851-4e7c-affa-89189cb5cfb0 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:11 user nova-compute[72782]: WARNING nova.compute.manager [req-be82e0c0-d650-40aa-bdda-b11430a7cd6b req-47d456f9-4851-4e7c-affa-89189cb5cfb0 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b for instance with vm_state building and task_state spawning.
Aug 14 19:47:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-be82e0c0-d650-40aa-bdda-b11430a7cd6b req-47d456f9-4851-4e7c-affa-89189cb5cfb0 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-be82e0c0-d650-40aa-bdda-b11430a7cd6b req-47d456f9-4851-4e7c-affa-89189cb5cfb0 service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-be82e0c0-d650-40aa-bdda-b11430a7cd6b req-47d456f9-4851-4e7c-affa-89189cb5cfb0 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-be82e0c0-d650-40aa-bdda-b11430a7cd6b req-47d456f9-4851-4e7c-affa-89189cb5cfb0 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-be82e0c0-d650-40aa-bdda-b11430a7cd6b req-47d456f9-4851-4e7c-affa-89189cb5cfb0 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:11 user nova-compute[72782]: WARNING nova.compute.manager [req-be82e0c0-d650-40aa-bdda-b11430a7cd6b req-47d456f9-4851-4e7c-affa-89189cb5cfb0 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b for instance with vm_state building and task_state spawning.
Aug 14 19:47:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG nova.network.neutron [req-66d6d20d-15c8-41b1-9d6e-8491d776fafa req-0fbd667b-915b-4735-9dbc-f5d9ad1682c8 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Updated VIF entry in instance network info cache for port 888a72be-5707-4d58-98e1-b472c928de22. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG nova.network.neutron [req-66d6d20d-15c8-41b1-9d6e-8491d776fafa req-0fbd667b-915b-4735-9dbc-f5d9ad1682c8 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Updating instance_info_cache with network_info: [{"id": "888a72be-5707-4d58-98e1-b472c928de22", "address": "fa:16:3e:83:d0:33", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888a72be-57", "ovs_interfaceid": "888a72be-5707-4d58-98e1-b472c928de22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-66d6d20d-15c8-41b1-9d6e-8491d776fafa req-0fbd667b-915b-4735-9dbc-f5d9ad1682c8 service nova] Releasing lock "refresh_cache-b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-f486b184-f147-46f2-9334-c3319227a288 req-5aa5c3c7-4974-45a1-9b87-1ddce06a4053 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-ed05074c-e64e-4323-92de-d9594c044eb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f486b184-f147-46f2-9334-c3319227a288 req-5aa5c3c7-4974-45a1-9b87-1ddce06a4053 service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f486b184-f147-46f2-9334-c3319227a288 req-5aa5c3c7-4974-45a1-9b87-1ddce06a4053 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f486b184-f147-46f2-9334-c3319227a288 req-5aa5c3c7-4974-45a1-9b87-1ddce06a4053 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-f486b184-f147-46f2-9334-c3319227a288 req-5aa5c3c7-4974-45a1-9b87-1ddce06a4053 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-ed05074c-e64e-4323-92de-d9594c044eb2 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:12 user nova-compute[72782]: WARNING nova.compute.manager [req-f486b184-f147-46f2-9334-c3319227a288 req-5aa5c3c7-4974-45a1-9b87-1ddce06a4053 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-ed05074c-e64e-4323-92de-d9594c044eb2 for instance with vm_state building and task_state spawning.
Aug 14 19:47:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-f486b184-f147-46f2-9334-c3319227a288 req-5aa5c3c7-4974-45a1-9b87-1ddce06a4053 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-ed05074c-e64e-4323-92de-d9594c044eb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f486b184-f147-46f2-9334-c3319227a288 req-5aa5c3c7-4974-45a1-9b87-1ddce06a4053 service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f486b184-f147-46f2-9334-c3319227a288 req-5aa5c3c7-4974-45a1-9b87-1ddce06a4053 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f486b184-f147-46f2-9334-c3319227a288 req-5aa5c3c7-4974-45a1-9b87-1ddce06a4053 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-f486b184-f147-46f2-9334-c3319227a288 req-5aa5c3c7-4974-45a1-9b87-1ddce06a4053 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-ed05074c-e64e-4323-92de-d9594c044eb2 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:12 user nova-compute[72782]: WARNING nova.compute.manager [req-f486b184-f147-46f2-9334-c3319227a288 req-5aa5c3c7-4974-45a1-9b87-1ddce06a4053 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-ed05074c-e64e-4323-92de-d9594c044eb2 for instance with vm_state building and task_state spawning.
Aug 14 19:47:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-f486b184-f147-46f2-9334-c3319227a288 req-5aa5c3c7-4974-45a1-9b87-1ddce06a4053 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-9302e1b4-e070-4dc6-afed-103549c16da0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f486b184-f147-46f2-9334-c3319227a288 req-5aa5c3c7-4974-45a1-9b87-1ddce06a4053 service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f486b184-f147-46f2-9334-c3319227a288 req-5aa5c3c7-4974-45a1-9b87-1ddce06a4053 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f486b184-f147-46f2-9334-c3319227a288 req-5aa5c3c7-4974-45a1-9b87-1ddce06a4053 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-f486b184-f147-46f2-9334-c3319227a288 req-5aa5c3c7-4974-45a1-9b87-1ddce06a4053 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-9302e1b4-e070-4dc6-afed-103549c16da0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:12 user nova-compute[72782]: WARNING nova.compute.manager [req-f486b184-f147-46f2-9334-c3319227a288 req-5aa5c3c7-4974-45a1-9b87-1ddce06a4053 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-9302e1b4-e070-4dc6-afed-103549c16da0 for instance with vm_state building and task_state spawning.
Aug 14 19:47:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:12 user nova-compute[72782]: WARNING nova.compute.manager [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd for instance with vm_state building and task_state spawning.
Aug 14 19:47:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-4e1deb99-9d04-4e8a-9436-a65820a2852b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-4e1deb99-9d04-4e8a-9436-a65820a2852b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:12 user nova-compute[72782]: WARNING nova.compute.manager [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-4e1deb99-9d04-4e8a-9436-a65820a2852b for instance with vm_state building and task_state spawning.
Aug 14 19:47:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-4e1deb99-9d04-4e8a-9436-a65820a2852b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-4e1deb99-9d04-4e8a-9436-a65820a2852b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:12 user nova-compute[72782]: WARNING nova.compute.manager [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-4e1deb99-9d04-4e8a-9436-a65820a2852b for instance with vm_state building and task_state spawning.
Aug 14 19:47:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-26080d32-4bd6-4320-b80a-200076d568d5 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-26080d32-4bd6-4320-b80a-200076d568d5 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:12 user nova-compute[72782]: WARNING nova.compute.manager [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-26080d32-4bd6-4320-b80a-200076d568d5 for instance with vm_state building and task_state spawning.
Aug 14 19:47:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-26080d32-4bd6-4320-b80a-200076d568d5 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-26080d32-4bd6-4320-b80a-200076d568d5 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:12 user nova-compute[72782]: WARNING nova.compute.manager [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-26080d32-4bd6-4320-b80a-200076d568d5 for instance with vm_state building and task_state spawning.
Aug 14 19:47:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-5dbbd012-f83b-4066-8bbc-70425d5a95de {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-5dbbd012-f83b-4066-8bbc-70425d5a95de {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:12 user nova-compute[72782]: WARNING nova.compute.manager [req-71cc512b-140e-4d82-acc1-13591a017cd0 req-7f8295c6-2b2b-445b-82ea-62bb3f42f21e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-5dbbd012-f83b-4066-8bbc-70425d5a95de for instance with vm_state building and task_state spawning.
Aug 14 19:47:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:13 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042433.9923556, 00a09aca-9913-4fba-91c6-9702c0dc44bd => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:47:13 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] VM Resumed (Lifecycle Event)
Aug 14 19:47:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:47:13 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:47:14 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Instance spawned successfully.
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:47:14 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042433.995722, 00a09aca-9913-4fba-91c6-9702c0dc44bd => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:47:14 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] VM Started (Lifecycle Event)
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Acquiring lock "03fc42b1-f33d-4930-ba65-22540584b7fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:14 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.objects.instance [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lazy-loading 'flavor' on Instance uuid 03fc42b1-f33d-4930-ba65-22540584b7fe {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:14 user nova-compute[72782]: INFO nova.compute.manager [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Took 11.61 seconds to spawn the instance on the hypervisor.
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-b7f7c5f7-3cc2-4181-ae03-9ed0c104f532 req-36c66ce6-bd1f-4243-96b0-0c514f82068e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-9302e1b4-e070-4dc6-afed-103549c16da0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b7f7c5f7-3cc2-4181-ae03-9ed0c104f532 req-36c66ce6-bd1f-4243-96b0-0c514f82068e service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b7f7c5f7-3cc2-4181-ae03-9ed0c104f532 req-36c66ce6-bd1f-4243-96b0-0c514f82068e service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b7f7c5f7-3cc2-4181-ae03-9ed0c104f532 req-36c66ce6-bd1f-4243-96b0-0c514f82068e service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-b7f7c5f7-3cc2-4181-ae03-9ed0c104f532 req-36c66ce6-bd1f-4243-96b0-0c514f82068e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-9302e1b4-e070-4dc6-afed-103549c16da0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:14 user nova-compute[72782]: WARNING nova.compute.manager [req-b7f7c5f7-3cc2-4181-ae03-9ed0c104f532 req-36c66ce6-bd1f-4243-96b0-0c514f82068e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-9302e1b4-e070-4dc6-afed-103549c16da0 for instance with vm_state building and task_state spawning.
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:14 user nova-compute[72782]: INFO nova.compute.manager [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Took 45.13 seconds to build instance.
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26703214-8126-43d9-9862-d10075f25144 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.238s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Acquiring lock "03fc42b1-f33d-4930-ba65-22540584b7fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:14 user nova-compute[72782]: INFO nova.compute.manager [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Attaching volume 5bdfe978-676b-4544-a16a-505d26d0589e to /dev/sdc
Aug 14 19:47:14 user nova-compute[72782]: DEBUG os_brick.utils [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce43bd8e-e4ff-4087-8a57-bdce13fbd723]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59c7e14-e29b-4443-8872-1ec785af0324]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0890ba3c-d56c-470a-a486-f7da4a4b615e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4254a0d6-8be8-4986-9edc-54c02898a8eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:47:14 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c7651d-57cd-4b0c-9f4a-cfd2d5057212]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG os_brick.utils [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Updating existing volume attachment record: 49045f78-c042-4cba-bf6c-4e5bea7ea93e {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-6c4ba592-8fe9-4f86-bd7f-862580aa2a55 req-c0cf1b45-af61-4f44-9275-2372ed6c41d8 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-5dbbd012-f83b-4066-8bbc-70425d5a95de {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6c4ba592-8fe9-4f86-bd7f-862580aa2a55 req-c0cf1b45-af61-4f44-9275-2372ed6c41d8 service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6c4ba592-8fe9-4f86-bd7f-862580aa2a55 req-c0cf1b45-af61-4f44-9275-2372ed6c41d8 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6c4ba592-8fe9-4f86-bd7f-862580aa2a55 req-c0cf1b45-af61-4f44-9275-2372ed6c41d8 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-6c4ba592-8fe9-4f86-bd7f-862580aa2a55 req-c0cf1b45-af61-4f44-9275-2372ed6c41d8 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-5dbbd012-f83b-4066-8bbc-70425d5a95de {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:14 user nova-compute[72782]: WARNING nova.compute.manager [req-6c4ba592-8fe9-4f86-bd7f-862580aa2a55 req-c0cf1b45-af61-4f44-9275-2372ed6c41d8 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-5dbbd012-f83b-4066-8bbc-70425d5a95de for instance with vm_state active and task_state None.
Aug 14 19:47:14 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042419.9763982, 39039cef-13fa-4434-9edc-4628757cbc24 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:47:14 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] VM Stopped (Lifecycle Event)
Aug 14 19:47:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4b1c6760-8f7a-486c-8425-f39fe8fe0edc None None] [instance: 39039cef-13fa-4434-9edc-4628757cbc24] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG nova.objects.instance [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lazy-loading 'flavor' on Instance uuid b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:15 user nova-compute[72782]: INFO nova.compute.manager [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Attaching volume b55ea7a4-4f65-4853-b76b-85661be8eb7d to /dev/vdb
Aug 14 19:47:15 user nova-compute[72782]: DEBUG os_brick.utils [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c3171f-f8e2-48fc-95df-9293e19fda64]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1f5e62-c8d1-4368-821c-e9eb28f70f06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[60281168-563f-49ec-aeb5-2c1b493850da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b842ff-eea9-4d18-9a06-a49bddc85a0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:47:15 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:47:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[592e58b8-d149-41cb-b341-3e1ff4d06b88]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG os_brick.utils [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:15 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Updating existing volume attachment record: 0715d27c-feae-49ef-887f-fd44cd6ba9ec {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:47:16 user nova-compute[72782]: DEBUG nova.compute.manager [req-84b555a7-219e-43af-985e-198ee28034c9 req-a39de8ad-1fe8-42fa-ad55-fa656b247f37 service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Received event network-changed-4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:16 user nova-compute[72782]: DEBUG nova.compute.manager [req-84b555a7-219e-43af-985e-198ee28034c9 req-a39de8ad-1fe8-42fa-ad55-fa656b247f37 service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Refreshing instance network info cache due to event network-changed-4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:47:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-84b555a7-219e-43af-985e-198ee28034c9 req-a39de8ad-1fe8-42fa-ad55-fa656b247f37 service nova] Acquiring lock "refresh_cache-04969095-d5d4-4581-bb3e-df44e21d33d6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:47:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-84b555a7-219e-43af-985e-198ee28034c9 req-a39de8ad-1fe8-42fa-ad55-fa656b247f37 service nova] Acquired lock "refresh_cache-04969095-d5d4-4581-bb3e-df44e21d33d6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:47:16 user nova-compute[72782]: DEBUG nova.network.neutron [req-84b555a7-219e-43af-985e-198ee28034c9 req-a39de8ad-1fe8-42fa-ad55-fa656b247f37 service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Refreshing network info cache for port 4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:47:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "interface-5d532038-555f-42d3-b35a-9e6f0350b023-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "interface-5d532038-555f-42d3-b35a-9e6f0350b023-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:16 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lazy-loading 'flavor' on Instance uuid 5d532038-555f-42d3-b35a-9e6f0350b023 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:16 user nova-compute[72782]: DEBUG nova.compute.manager [req-632cafb7-a85f-4d11-be62-86e6bf5cbb47 req-a15057cd-acbc-4450-a731-84b8b6c26756 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received event network-changed-1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:16 user nova-compute[72782]: DEBUG nova.compute.manager [req-632cafb7-a85f-4d11-be62-86e6bf5cbb47 req-a15057cd-acbc-4450-a731-84b8b6c26756 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Refreshing instance network info cache due to event network-changed-1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:47:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-632cafb7-a85f-4d11-be62-86e6bf5cbb47 req-a15057cd-acbc-4450-a731-84b8b6c26756 service nova] Acquiring lock "refresh_cache-5d532038-555f-42d3-b35a-9e6f0350b023" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:47:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-632cafb7-a85f-4d11-be62-86e6bf5cbb47 req-a15057cd-acbc-4450-a731-84b8b6c26756 service nova] Acquired lock "refresh_cache-5d532038-555f-42d3-b35a-9e6f0350b023" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:47:16 user nova-compute[72782]: DEBUG nova.network.neutron [req-632cafb7-a85f-4d11-be62-86e6bf5cbb47 req-a15057cd-acbc-4450-a731-84b8b6c26756 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Refreshing network info cache for port 1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:47:17 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lazy-loading 'pci_requests' on Instance uuid 5d532038-555f-42d3-b35a-9e6f0350b023 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:17 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:47:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:17 user nova-compute[72782]: DEBUG nova.policy [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5283c6441c04ba497e3c89403bb2d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de6c5ad7cf54432b6e2704cd3c0201c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:47:17 user nova-compute[72782]: DEBUG nova.network.neutron [req-632cafb7-a85f-4d11-be62-86e6bf5cbb47 req-a15057cd-acbc-4450-a731-84b8b6c26756 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Updated VIF entry in instance network info cache for port 1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:47:17 user nova-compute[72782]: DEBUG nova.network.neutron [req-632cafb7-a85f-4d11-be62-86e6bf5cbb47 req-a15057cd-acbc-4450-a731-84b8b6c26756 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Updating instance_info_cache with network_info: [{"id": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "address": "fa:16:3e:0c:34:c8", "network": {"id": "6e75566e-5f3a-4d09-97c7-580d9c7c8db1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2064496785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec76c6a-a5", "ovs_interfaceid": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:47:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-632cafb7-a85f-4d11-be62-86e6bf5cbb47 req-a15057cd-acbc-4450-a731-84b8b6c26756 service nova] Releasing lock "refresh_cache-5d532038-555f-42d3-b35a-9e6f0350b023" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:47:17 user nova-compute[72782]: DEBUG nova.network.neutron [req-84b555a7-219e-43af-985e-198ee28034c9 req-a39de8ad-1fe8-42fa-ad55-fa656b247f37 service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Updated VIF entry in instance network info cache for port 4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:47:17 user nova-compute[72782]: DEBUG nova.network.neutron [req-84b555a7-219e-43af-985e-198ee28034c9 req-a39de8ad-1fe8-42fa-ad55-fa656b247f37 service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Updating instance_info_cache with network_info: [{"id": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "address": "fa:16:3e:ac:8b:14", "network": {"id": "b106d629-341a-464c-abfc-c9d9fbd4105f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-208648938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a94fb20b4e2489987bc77c5e1e5bb00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccbc9f5-29", "ovs_interfaceid": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:47:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-84b555a7-219e-43af-985e-198ee28034c9 req-a39de8ad-1fe8-42fa-ad55-fa656b247f37 service nova] Releasing lock "refresh_cache-04969095-d5d4-4581-bb3e-df44e21d33d6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:47:18 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Successfully created port: cf430810-9ec0-4b97-a972-710a70074785 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:47:19 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Successfully updated port: cf430810-9ec0-4b97-a972-710a70074785 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:47:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "refresh_cache-5d532038-555f-42d3-b35a-9e6f0350b023" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:47:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquired lock "refresh_cache-5d532038-555f-42d3-b35a-9e6f0350b023" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:47:19 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:47:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-db48e580-c0d3-4043-bb2d-8a31ccb738cb req-d0162358-b4b6-49e2-9b5d-e7e1b095540b service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received event network-changed-cf430810-9ec0-4b97-a972-710a70074785 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-db48e580-c0d3-4043-bb2d-8a31ccb738cb req-d0162358-b4b6-49e2-9b5d-e7e1b095540b service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Refreshing instance network info cache due to event network-changed-cf430810-9ec0-4b97-a972-710a70074785. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:47:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-db48e580-c0d3-4043-bb2d-8a31ccb738cb req-d0162358-b4b6-49e2-9b5d-e7e1b095540b service nova] Acquiring lock "refresh_cache-5d532038-555f-42d3-b35a-9e6f0350b023" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Updating instance_info_cache with network_info: [{"id": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "address": "fa:16:3e:0c:34:c8", "network": {"id": "6e75566e-5f3a-4d09-97c7-580d9c7c8db1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2064496785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec76c6a-a5", "ovs_interfaceid": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cf430810-9ec0-4b97-a972-710a70074785", "address": "fa:16:3e:af:61:8e", "network": {"id": "9304f63a-1168-4ba5-be3b-ad1dc3af0b54", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1958522820", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf430810-9e", "ovs_interfaceid": "cf430810-9ec0-4b97-a972-710a70074785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Releasing lock "refresh_cache-5d532038-555f-42d3-b35a-9e6f0350b023" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-db48e580-c0d3-4043-bb2d-8a31ccb738cb req-d0162358-b4b6-49e2-9b5d-e7e1b095540b service nova] Acquired lock "refresh_cache-5d532038-555f-42d3-b35a-9e6f0350b023" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG nova.network.neutron [req-db48e580-c0d3-4043-bb2d-8a31ccb738cb req-d0162358-b4b6-49e2-9b5d-e7e1b095540b service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Refreshing network info cache for port cf430810-9ec0-4b97-a972-710a70074785 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205293026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205293026',id=5,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBUAZVMa4gIP2YmvcmOx5iou8wFV659Y2z9FXeRWhphzcOnzkYKBYpe1JczET+ExPwbJu9nwpHcQhAkzlPTFrALtNgdc28pKtERMGb/9tfusWIUd9XgIsvq2vJiC3QUAw==',key_name='tempest-keypair-190172691',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:45:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4de6c5ad7cf54432b6e2704cd3c0201c',ramdisk_id='',reservation_id='r-py4qploq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2072296078',owner_user_name='tempest-TaggedAttachmentsTest-2072296078-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5283c6441c04ba497e3c89403bb2d87',uuid=5d532038-555f-42d3-b35a-9e6f0350b023,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf430810-9ec0-4b97-a972-710a70074785", "address": "fa:16:3e:af:61:8e", "network": {"id": "9304f63a-1168-4ba5-be3b-ad1dc3af0b54", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1958522820", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf430810-9e", "ovs_interfaceid": "cf430810-9ec0-4b97-a972-710a70074785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Converting VIF {"id": "cf430810-9ec0-4b97-a972-710a70074785", "address": "fa:16:3e:af:61:8e", "network": {"id": "9304f63a-1168-4ba5-be3b-ad1dc3af0b54", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1958522820", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf430810-9e", "ovs_interfaceid": "cf430810-9ec0-4b97-a972-710a70074785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=cf430810-9ec0-4b97-a972-710a70074785,network=Network(9304f63a-1168-4ba5-be3b-ad1dc3af0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf430810-9e') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG os_vif [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=cf430810-9ec0-4b97-a972-710a70074785,network=Network(9304f63a-1168-4ba5-be3b-ad1dc3af0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf430810-9e') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf430810-9e, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcf430810-9e, col_values=(('external_ids', {'iface-id': 'cf430810-9ec0-4b97-a972-710a70074785', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:61:8e', 'vm-uuid': '5d532038-555f-42d3-b35a-9e6f0350b023'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:20 user nova-compute[72782]: INFO os_vif [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=cf430810-9ec0-4b97-a972-710a70074785,network=Network(9304f63a-1168-4ba5-be3b-ad1dc3af0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf430810-9e')
Aug 14 19:47:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205293026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205293026',id=5,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBUAZVMa4gIP2YmvcmOx5iou8wFV659Y2z9FXeRWhphzcOnzkYKBYpe1JczET+ExPwbJu9nwpHcQhAkzlPTFrALtNgdc28pKtERMGb/9tfusWIUd9XgIsvq2vJiC3QUAw==',key_name='tempest-keypair-190172691',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:45:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4de6c5ad7cf54432b6e2704cd3c0201c',ramdisk_id='',reservation_id='r-py4qploq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2072296078',owner_user_name='tempest-TaggedAttachmentsTest-2072296078-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5283c6441c04ba497e3c89403bb2d87',uuid=5d532038-555f-42d3-b35a-9e6f0350b023,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf430810-9ec0-4b97-a972-710a70074785", "address": "fa:16:3e:af:61:8e", "network": {"id": "9304f63a-1168-4ba5-be3b-ad1dc3af0b54", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1958522820", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf430810-9e", "ovs_interfaceid": "cf430810-9ec0-4b97-a972-710a70074785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Converting VIF {"id": "cf430810-9ec0-4b97-a972-710a70074785", "address": "fa:16:3e:af:61:8e", "network": {"id": "9304f63a-1168-4ba5-be3b-ad1dc3af0b54", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1958522820", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf430810-9e", "ovs_interfaceid": "cf430810-9ec0-4b97-a972-710a70074785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=cf430810-9ec0-4b97-a972-710a70074785,network=Network(9304f63a-1168-4ba5-be3b-ad1dc3af0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf430810-9e') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] attach device xml: <interface type="ethernet">
Aug 14 19:47:20 user nova-compute[72782]:   <mac address="fa:16:3e:af:61:8e"/>
Aug 14 19:47:20 user nova-compute[72782]:   <model type="virtio"/>
Aug 14 19:47:20 user nova-compute[72782]:   <mtu size="1442"/>
Aug 14 19:47:20 user nova-compute[72782]:   <target dev="tapcf430810-9e"/>
Aug 14 19:47:20 user nova-compute[72782]: </interface>
Aug 14 19:47:20 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] No BDM found with device name hda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] No VIF found with MAC fa:16:3e:0c:34:c8, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:47:20 user nova-compute[72782]:   <nova:package version="0.0.0"/>
Aug 14 19:47:20 user nova-compute[72782]:   <nova:name>tempest-device-tagging-server-205293026</nova:name>
Aug 14 19:47:20 user nova-compute[72782]:   <nova:creationTime>2023-08-14 19:47:20</nova:creationTime>
Aug 14 19:47:20 user nova-compute[72782]:   <nova:flavor name="m1.tiny">
Aug 14 19:47:20 user nova-compute[72782]:     <nova:memory>512</nova:memory>
Aug 14 19:47:20 user nova-compute[72782]:     <nova:disk>1</nova:disk>
Aug 14 19:47:20 user nova-compute[72782]:     <nova:swap>0</nova:swap>
Aug 14 19:47:20 user nova-compute[72782]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:47:20 user nova-compute[72782]:     <nova:vcpus>1</nova:vcpus>
Aug 14 19:47:20 user nova-compute[72782]:   </nova:flavor>
Aug 14 19:47:20 user nova-compute[72782]:   <nova:owner>
Aug 14 19:47:20 user nova-compute[72782]:     <nova:user uuid="c5283c6441c04ba497e3c89403bb2d87">tempest-TaggedAttachmentsTest-2072296078-project-member</nova:user>
Aug 14 19:47:20 user nova-compute[72782]:     <nova:project uuid="4de6c5ad7cf54432b6e2704cd3c0201c">tempest-TaggedAttachmentsTest-2072296078</nova:project>
Aug 14 19:47:20 user nova-compute[72782]:   </nova:owner>
Aug 14 19:47:20 user nova-compute[72782]:   <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:47:20 user nova-compute[72782]:   <nova:ports>
Aug 14 19:47:20 user nova-compute[72782]:     <nova:port uuid="1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e">
Aug 14 19:47:20 user nova-compute[72782]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 19:47:20 user nova-compute[72782]:     </nova:port>
Aug 14 19:47:20 user nova-compute[72782]:     <nova:port uuid="cf430810-9ec0-4b97-a972-710a70074785">
Aug 14 19:47:20 user nova-compute[72782]:       <nova:ip type="fixed" address="10.10.10.253" ipVersion="4"/>
Aug 14 19:47:20 user nova-compute[72782]:     </nova:port>
Aug 14 19:47:20 user nova-compute[72782]:   </nova:ports>
Aug 14 19:47:20 user nova-compute[72782]: </nova:instance>
Aug 14 19:47:20 user nova-compute[72782]:  {{(pid=72782) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5c4bd0d6-a03d-42e9-b01b-401d4220ef41 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "interface-5d532038-555f-42d3-b35a-9e6f0350b023-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.124s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:21 user nova-compute[72782]: DEBUG nova.network.neutron [req-db48e580-c0d3-4043-bb2d-8a31ccb738cb req-d0162358-b4b6-49e2-9b5d-e7e1b095540b service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Updated VIF entry in instance network info cache for port cf430810-9ec0-4b97-a972-710a70074785. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:47:21 user nova-compute[72782]: DEBUG nova.network.neutron [req-db48e580-c0d3-4043-bb2d-8a31ccb738cb req-d0162358-b4b6-49e2-9b5d-e7e1b095540b service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Updating instance_info_cache with network_info: [{"id": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "address": "fa:16:3e:0c:34:c8", "network": {"id": "6e75566e-5f3a-4d09-97c7-580d9c7c8db1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2064496785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec76c6a-a5", "ovs_interfaceid": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cf430810-9ec0-4b97-a972-710a70074785", "address": "fa:16:3e:af:61:8e", "network": {"id": "9304f63a-1168-4ba5-be3b-ad1dc3af0b54", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1958522820", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf430810-9e", "ovs_interfaceid": "cf430810-9ec0-4b97-a972-710a70074785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:47:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-9b6feb3a-f07c-45df-b58b-dd8760970391 req-99d5efae-a83c-49bc-9da8-cc5733c51226 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received event network-vif-plugged-cf430810-9ec0-4b97-a972-710a70074785 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9b6feb3a-f07c-45df-b58b-dd8760970391 req-99d5efae-a83c-49bc-9da8-cc5733c51226 service nova] Acquiring lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9b6feb3a-f07c-45df-b58b-dd8760970391 req-99d5efae-a83c-49bc-9da8-cc5733c51226 service nova] Lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9b6feb3a-f07c-45df-b58b-dd8760970391 req-99d5efae-a83c-49bc-9da8-cc5733c51226 service nova] Lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-9b6feb3a-f07c-45df-b58b-dd8760970391 req-99d5efae-a83c-49bc-9da8-cc5733c51226 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] No waiting events found dispatching network-vif-plugged-cf430810-9ec0-4b97-a972-710a70074785 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:21 user nova-compute[72782]: WARNING nova.compute.manager [req-9b6feb3a-f07c-45df-b58b-dd8760970391 req-99d5efae-a83c-49bc-9da8-cc5733c51226 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received unexpected event network-vif-plugged-cf430810-9ec0-4b97-a972-710a70074785 for instance with vm_state active and task_state None.
Aug 14 19:47:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-db48e580-c0d3-4043-bb2d-8a31ccb738cb req-d0162358-b4b6-49e2-9b5d-e7e1b095540b service nova] Releasing lock "refresh_cache-5d532038-555f-42d3-b35a-9e6f0350b023" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:47:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-d557fcf3-52f0-4089-af25-7db6446edbbc req-c64f5a62-53cd-40e4-9748-7e4b0aa2e10f service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received event network-vif-plugged-cf430810-9ec0-4b97-a972-710a70074785 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d557fcf3-52f0-4089-af25-7db6446edbbc req-c64f5a62-53cd-40e4-9748-7e4b0aa2e10f service nova] Acquiring lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d557fcf3-52f0-4089-af25-7db6446edbbc req-c64f5a62-53cd-40e4-9748-7e4b0aa2e10f service nova] Lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d557fcf3-52f0-4089-af25-7db6446edbbc req-c64f5a62-53cd-40e4-9748-7e4b0aa2e10f service nova] Lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-d557fcf3-52f0-4089-af25-7db6446edbbc req-c64f5a62-53cd-40e4-9748-7e4b0aa2e10f service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] No waiting events found dispatching network-vif-plugged-cf430810-9ec0-4b97-a972-710a70074785 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:23 user nova-compute[72782]: WARNING nova.compute.manager [req-d557fcf3-52f0-4089-af25-7db6446edbbc req-c64f5a62-53cd-40e4-9748-7e4b0aa2e10f service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received unexpected event network-vif-plugged-cf430810-9ec0-4b97-a972-710a70074785 for instance with vm_state active and task_state None.
Aug 14 19:47:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:47:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LwiRsmxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:24 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:24 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:24 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:47:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[271bd3d7-b3e6-4f83-bbef-8218d5dd514e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:47:24 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[17df8b8f-e53b-4037-9059-2455fe1f8a8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e] added
Aug 14 19:47:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[61513708-7dff-4b74-a1cb-eef2d484f5b4]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c66294-bac3-42de-98cc-eb0b2e141120]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LwiRsmxt {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LwiRsmxt" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0e69b9-f73c-4982-ae5b-0bad7005a9ac]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LwiRsmxt'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0ae494-2995-4955-900c-129f0298408a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8eb3df-ae1f-4c77-b7a2-ad97b629d1c5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:25 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:25 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:25 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:25 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:25 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:25 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[774fa3fe-088e-47f9-95a1-609e7aa2e8e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e, portal: 172.16.0.220,3260]
Aug 14 19:47:25 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e, portal: 172.16.0.220,3260] successful.
Aug 14 19:47:25 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e932774-cc54-4441-b148-07d672450522]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Acquiring lock "04969095-d5d4-4581-bb3e-df44e21d33d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d919a47-f942-48d3-8565-58ef084a9629]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:25 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:25 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:25 user nova-compute[72782]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e (non-flash)
Aug 14 19:47:25 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:25 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:25 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:25 user nova-compute[72782]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e (non-flash)
Aug 14 19:47:25 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] HCTL ('35', '-', '-', 0) found on session 7 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG nova.objects.instance [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Lazy-loading 'flavor' on Instance uuid 04969095-d5d4-4581-bb3e-df44e21d33d6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "5d532038-555f-42d3-b35a-9e6f0350b023" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "5d532038-555f-42d3-b35a-9e6f0350b023" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[967cc91b-8860-49b9-993d-22f54a20cc50]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Searching for a device in session 7 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LwiRsmxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG nova.objects.instance [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lazy-loading 'flavor' on Instance uuid 5d532038-555f-42d3-b35a-9e6f0350b023 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "5d532038-555f-42d3-b35a-9e6f0350b023" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.119s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Acquiring lock "04969095-d5d4-4581-bb3e-df44e21d33d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:25 user nova-compute[72782]: INFO nova.compute.manager [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Attaching volume e27a3b0e-a5d9-43f8-9889-d40525866b7b to /dev/vdb
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "5d532038-555f-42d3-b35a-9e6f0350b023" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "5d532038-555f-42d3-b35a-9e6f0350b023" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:25 user nova-compute[72782]: INFO nova.compute.manager [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Attaching volume 4b15ecee-7780-4324-a64d-7486d96fcb85 to /dev/vdb
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.utils [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[577df198-3f9b-43e4-9b02-859e8f9b0f2e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aef382-8f46-4f3a-9014-b0f605942bf4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.utils [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2671537a-a807-41bc-a596-33dacfc17a2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee8b12f-7cd6-46cd-b999-2069ed7d9bc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0369023f-c2cf-405c-9459-13fd124a40c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:47:25 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[23683e19-2560-476f-a5ae-c6cfc38bbe4a]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.utils [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Updating existing volume attachment record: a4a2991d-3ee3-4b84-acea-5dde1cbec736 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85e3e80-e3b5-45ca-9d29-9f6eb447674b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2c09b9-9849-4763-9506-dcf7bfb5a43b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf65f8f9-5298-4105-b4ff-96f8b6c5491a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:47:25 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:47:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f26f800-37be-433a-8a4e-09e1b44ffc2d]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG os_brick.utils [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:25 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Updating existing volume attachment record: f87b6e6e-1bd4-439b-a88e-37881dbcca2b {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PXhHWCjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:26 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26139393430616164', 'path': '/dev/sdd'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139393430616164', 'path': '/dev/sdd'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.100s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:26 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:26 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG nova.objects.instance [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lazy-loading 'flavor' on Instance uuid 03fc42b1-f33d-4930-ba65-22540584b7fe {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7efad9-1e0d-4217-a02a-13eea0c14d72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:47:26 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abea4c1-63f2-41ea-853a-c6860eb05e1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d] added
Aug 14 19:47:26 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:47:26 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:47:26 user nova-compute[72782]:   <source dev="/dev/sdd"/>
Aug 14 19:47:26 user nova-compute[72782]:   <target dev="sdc" bus="scsi"/>
Aug 14 19:47:26 user nova-compute[72782]:   <serial>5bdfe978-676b-4544-a16a-505d26d0589e</serial>
Aug 14 19:47:26 user nova-compute[72782]:   <address type="drive" controller="0" unit="2"/>
Aug 14 19:47:26 user nova-compute[72782]: </disk>
Aug 14 19:47:26 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf41248-ae49-456f-b732-af9ddfad961a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b01fd39-d63f-43b5-8aa0-0b8da8804e13]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PXhHWCjV {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PXhHWCjV" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf57f175-5e5e-4c82-a8e8-2128a19387eb]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PXhHWCjV'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce89f790-a0fb-42cc-9ea4-0a2fb27a55fa]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00fd09b-308b-47d4-ab22-bce16d637198]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:26 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:26 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:26 user nova-compute[72782]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e (non-flash)
Aug 14 19:47:26 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:26 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:26 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:26 user nova-compute[72782]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e (non-flash)
Aug 14 19:47:26 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8a3210-7ff2-48db-98f5-022e9db1b32d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d, portal: 172.16.0.220,3260]
Aug 14 19:47:26 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d, portal: 172.16.0.220,3260] successful.
Aug 14 19:47:26 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24e0cbd-3bde-4499-9428-3727eb11ac7a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[496addb8-7611-404d-8e71-224bd992a4b9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:26 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:26 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:26 user nova-compute[72782]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e (non-flash)
Aug 14 19:47:26 user nova-compute[72782]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d (non-flash)
Aug 14 19:47:26 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:26 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:26 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:26 user nova-compute[72782]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e (non-flash)
Aug 14 19:47:26 user nova-compute[72782]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d (non-flash)
Aug 14 19:47:26 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[adec958c-611a-4f60-bc0f-f39518b181f3]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PXhHWCjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] No BDM found with device name sda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] No VIF found with MAC fa:16:3e:ae:6b:5f, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:47:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '26466313862393631', 'path': '/dev/sdf'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466313862393631', 'path': '/dev/sdf'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:47:27 user nova-compute[72782]: DEBUG nova.objects.instance [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lazy-loading 'flavor' on Instance uuid b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:47:27 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:47:27 user nova-compute[72782]:   <source dev="/dev/sdf"/>
Aug 14 19:47:27 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:47:27 user nova-compute[72782]:   <serial>b55ea7a4-4f65-4853-b76b-85661be8eb7d</serial>
Aug 14 19:47:27 user nova-compute[72782]: </disk>
Aug 14 19:47:27 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:47:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] No VIF found with MAC fa:16:3e:83:d0:33, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smUtcMYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:29 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:29 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:29 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c438aa04-a513-43c2-bc29-d284819c248c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:47:29 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[409c8ea8-85b4-43fb-9c9b-16765ad32fd4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96] added
Aug 14 19:47:29 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6fda4c-5ad9-43b5-a717-bc42a53ab1ba]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edb5232-2207-48e7-aca7-c7f3a2d30db0]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v smUtcMYr {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v smUtcMYr" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8038027-eab9-4d7e-bbee-5106bc53d0ad]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'smUtcMYr'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aab0ed5-c6a0-4939-b5da-2838616235d0]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d66036e-10fc-427f-ae35-ac5d0f859c67]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:29 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:29 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:29 user nova-compute[72782]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e (non-flash)
Aug 14 19:47:29 user nova-compute[72782]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d (non-flash)
Aug 14 19:47:29 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:29 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:29 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:29 user nova-compute[72782]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e (non-flash)
Aug 14 19:47:29 user nova-compute[72782]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d (non-flash)
Aug 14 19:47:29 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e840c84-cb87-4749-82fa-55c6dabe2ba6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96, portal: 172.16.0.220,3260]
Aug 14 19:47:29 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96, portal: 172.16.0.220,3260] successful.
Aug 14 19:47:29 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:29 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01032e2-89cb-4c0b-8b75-068955eafe02]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:30 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:30 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47766f7-5d51-4dc9-b18a-bb86625b66ca]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:30 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:30 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:30 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:30 user nova-compute[72782]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e (non-flash)
Aug 14 19:47:30 user nova-compute[72782]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d (non-flash)
Aug 14 19:47:30 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:30 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:30 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:30 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:30 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:30 user nova-compute[72782]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e (non-flash)
Aug 14 19:47:30 user nova-compute[72782]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d (non-flash)
Aug 14 19:47:30 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:30 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:30 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.402s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:30 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:47:30 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:47:30 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:47:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:30 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b9054a-77fc-4aaa-906a-bfa33bdc650d]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:30 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:47:30 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smUtcMYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:47:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-15f95869-29e2-4d09-aeee-642684bc9215 tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.711s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-21755a49-7243-426f-a524-475991c932a0 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.841s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:31 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:31 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '26239353262643061', 'path': '/dev/sdg'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239353262643061', 'path': '/dev/sdg'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:47:31 user nova-compute[72782]: DEBUG nova.objects.instance [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'flavor' on Instance uuid 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:47:31 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:47:31 user nova-compute[72782]:   <source dev="/dev/sdg"/>
Aug 14 19:47:31 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:47:31 user nova-compute[72782]:   <serial>114e53d3-d652-4c90-9e16-2c52a44e1c96</serial>
Aug 14 19:47:31 user nova-compute[72782]: </disk>
Aug 14 19:47:31 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:47:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Acquiring lock "03fc42b1-f33d-4930-ba65-22540584b7fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:31 user nova-compute[72782]: INFO nova.compute.manager [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Detaching volume 5bdfe978-676b-4544-a16a-505d26d0589e
Aug 14 19:47:31 user nova-compute[72782]: DEBUG nova.compute.manager [req-3f4ceae0-40e3-494d-9d09-b2b544415921 req-6330c855-37a2-4a01-9ef8-b72d5cdcf492 service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Received event network-changed-028b6a27-22aa-41b4-887c-984dc24826be {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:31 user nova-compute[72782]: DEBUG nova.compute.manager [req-3f4ceae0-40e3-494d-9d09-b2b544415921 req-6330c855-37a2-4a01-9ef8-b72d5cdcf492 service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Refreshing instance network info cache due to event network-changed-028b6a27-22aa-41b4-887c-984dc24826be. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:47:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3f4ceae0-40e3-494d-9d09-b2b544415921 req-6330c855-37a2-4a01-9ef8-b72d5cdcf492 service nova] Acquiring lock "refresh_cache-d51b224a-5167-40bf-8d3c-8426b420458c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:47:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3f4ceae0-40e3-494d-9d09-b2b544415921 req-6330c855-37a2-4a01-9ef8-b72d5cdcf492 service nova] Acquired lock "refresh_cache-d51b224a-5167-40bf-8d3c-8426b420458c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:47:31 user nova-compute[72782]: DEBUG nova.network.neutron [req-3f4ceae0-40e3-494d-9d09-b2b544415921 req-6330c855-37a2-4a01-9ef8-b72d5cdcf492 service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Refreshing network info cache for port 028b6a27-22aa-41b4-887c-984dc24826be {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:47:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] No VIF found with MAC fa:16:3e:9a:a4:fc, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:47:32 user nova-compute[72782]: INFO nova.virt.block_device [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Attempting to driver detach volume 5bdfe978-676b-4544-a16a-505d26d0589e from mountpoint /dev/sdc
Aug 14 19:47:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Attempting to detach device sdc from instance 03fc42b1-f33d-4930-ba65-22540584b7fe from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:47:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:47:32 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:47:32 user nova-compute[72782]:   <source dev="/dev/sdd"/>
Aug 14 19:47:32 user nova-compute[72782]:   <target dev="sdc" bus="scsi"/>
Aug 14 19:47:32 user nova-compute[72782]:   <serial>5bdfe978-676b-4544-a16a-505d26d0589e</serial>
Aug 14 19:47:32 user nova-compute[72782]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 14 19:47:32 user nova-compute[72782]: </disk>
Aug 14 19:47:32 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:47:32 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Successfully detached device sdc from instance 03fc42b1-f33d-4930-ba65-22540584b7fe from the persistent domain config.
Aug 14 19:47:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 03fc42b1-f33d-4930-ba65-22540584b7fe from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:47:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:47:32 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:47:32 user nova-compute[72782]:   <source dev="/dev/sdd"/>
Aug 14 19:47:32 user nova-compute[72782]:   <target dev="sdc" bus="scsi"/>
Aug 14 19:47:32 user nova-compute[72782]:   <serial>5bdfe978-676b-4544-a16a-505d26d0589e</serial>
Aug 14 19:47:32 user nova-compute[72782]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 14 19:47:32 user nova-compute[72782]: </disk>
Aug 14 19:47:32 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:47:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:32 user nova-compute[72782]: INFO nova.compute.manager [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Detaching volume b55ea7a4-4f65-4853-b76b-85661be8eb7d
Aug 14 19:47:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-af28c942-d2d2-4e64-be7f-3220dfca21e9 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.219s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Acquiring lock "d51b224a-5167-40bf-8d3c-8426b420458c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "d51b224a-5167-40bf-8d3c-8426b420458c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:32 user nova-compute[72782]: DEBUG nova.objects.instance [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lazy-loading 'flavor' on Instance uuid d51b224a-5167-40bf-8d3c-8426b420458c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692042452.9897811, 03fc42b1-f33d-4930-ba65-22540584b7fe => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 03fc42b1-f33d-4930-ba65-22540584b7fe {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:47:33 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Successfully detached device sdc from instance 03fc42b1-f33d-4930-ba65-22540584b7fe from the live domain config.
Aug 14 19:47:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LwiRsmxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:33 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "d51b224a-5167-40bf-8d3c-8426b420458c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.612s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a73059-ec29-4286-8d52-38385ecd00fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:33 user nova-compute[72782]: INFO nova.virt.block_device [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Attempting to driver detach volume b55ea7a4-4f65-4853-b76b-85661be8eb7d from mountpoint /dev/vdb
Aug 14 19:47:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Attempting to detach device vdb from instance b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:47:33 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:47:33 user nova-compute[72782]:   <source dev="/dev/sdf"/>
Aug 14 19:47:33 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:47:33 user nova-compute[72782]:   <serial>b55ea7a4-4f65-4853-b76b-85661be8eb7d</serial>
Aug 14 19:47:33 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:47:33 user nova-compute[72782]: </disk>
Aug 14 19:47:33 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:47:33 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Successfully detached device vdb from instance b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 from the persistent domain config.
Aug 14 19:47:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:47:33 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:47:33 user nova-compute[72782]:   <source dev="/dev/sdf"/>
Aug 14 19:47:33 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:47:33 user nova-compute[72782]:   <serial>b55ea7a4-4f65-4853-b76b-85661be8eb7d</serial>
Aug 14 19:47:33 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:47:33 user nova-compute[72782]: </disk>
Aug 14 19:47:33 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95afb57-5de6-4738-8f91-04d1fa8cc1fe]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:33 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:33 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:33 user nova-compute[72782]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e (non-flash)
Aug 14 19:47:33 user nova-compute[72782]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d (non-flash)
Aug 14 19:47:33 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:33 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:33 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:33 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:33 user nova-compute[72782]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e (non-flash)
Aug 14 19:47:33 user nova-compute[72782]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d (non-flash)
Aug 14 19:47:33 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:33 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f64084d3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e'): ({'sdd'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Removing single pathed devices sdd {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG nova.network.neutron [req-3f4ceae0-40e3-494d-9d09-b2b544415921 req-6330c855-37a2-4a01-9ef8-b72d5cdcf492 service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Updated VIF entry in instance network info cache for port 028b6a27-22aa-41b4-887c-984dc24826be. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG nova.network.neutron [req-3f4ceae0-40e3-494d-9d09-b2b544415921 req-6330c855-37a2-4a01-9ef8-b72d5cdcf492 service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Updating instance_info_cache with network_info: [{"id": "028b6a27-22aa-41b4-887c-984dc24826be", "address": "fa:16:3e:ac:9b:7b", "network": {"id": "05421250-9ad9-4d5a-97c0-3bcd1d423709", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1416606760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0351b1b7deb4c9da4ad0a4021ca4b4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028b6a27-22", "ovs_interfaceid": "028b6a27-22aa-41b4-887c-984dc24826be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3f4ceae0-40e3-494d-9d09-b2b544415921 req-6330c855-37a2-4a01-9ef8-b72d5cdcf492 service nova] Releasing lock "refresh_cache-d51b224a-5167-40bf-8d3c-8426b420458c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[48604b05-cdcd-402f-8bdd-59435bbe7b09]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8420fc58-ec69-4865-9c97-aaef5f0d33f6]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Flushing IO for device /dev/sdd {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7297c7c-4bfc-427b-93b6-06db7cbb32c8]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[10632d93-81ba-4b74-9b44-9b29f185e3d4]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c642ca-e6c1-44b7-897c-665983f5580c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Acquiring lock "d51b224a-5167-40bf-8d3c-8426b420458c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "d51b224a-5167-40bf-8d3c-8426b420458c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:33 user nova-compute[72782]: INFO nova.compute.manager [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Attaching volume ddb56ed8-6a67-421d-bb15-f23b6a7cd241 to /dev/vdb
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1806c8-e058-4599-9b71-e1478c6ef8d9]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e, portal: 172.16.0.220,3260]
Aug 14 19:47:33 user nova-compute[72782]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e, portal: 172.16.0.220,3260] successful.
Aug 14 19:47:33 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bdfe978-676b-4544-a16a-505d26d0589e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b07e650-2041-4982-8026-dc4c16b11501]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] <== disconnect_volume: return (378ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692042453.572497, b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:47:33 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Successfully detached device vdb from instance b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 from the live domain config.
Aug 14 19:47:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PXhHWCjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:33 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbd5201-fea1-4f75-8a3b-22dfd7268155]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fb74be-65a9-4997-9f96-929d18c20f9d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:33 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:33 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:33 user nova-compute[72782]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d (non-flash)
Aug 14 19:47:33 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:33 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:33 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:33 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:33 user nova-compute[72782]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d (non-flash)
Aug 14 19:47:33 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:33 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f64084828c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d'): ({'sdf'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Removing single pathed devices sdf {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff99dbf2-fd9c-4265-b098-9b21efffa0ae]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b9bf12-6b78-4d35-9a62-b955f50b47e5]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Flushing IO for device /dev/sdf {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[242b5e3a-5d7b-49f3-a0a8-9fa26a6e2e3d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3766655c-f676-4c4e-9509-8825fec777e1]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] SCSI volumes sdf have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd01f7e9-3a33-471b-a5de-2021420edab7]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b100a87b-2839-4dde-9a1c-956be7d872f8]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d, portal: 172.16.0.220,3260]
Aug 14 19:47:33 user nova-compute[72782]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d, portal: 172.16.0.220,3260] successful.
Aug 14 19:47:33 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55ea7a4-4f65-4853-b76b-85661be8eb7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[053e2be6-1ee4-484f-9576-fa3e9b47f5cc]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] <== disconnect_volume: return (348ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:47:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:47:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:36 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:47:36 user nova-compute[72782]: INFO nova.compute.claims [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Claim successful on node user
Aug 14 19:47:37 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG nova.compute.manager [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG nova.compute.manager [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG nova.network.neutron [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:47:37 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:47:37 user nova-compute[72782]: DEBUG nova.compute.manager [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG nova.compute.manager [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:47:37 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Creating image(s)
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "/opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "/opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG nova.policy [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0cada11ffdb4ebc8d9e80218818ec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c26e0199de48ee8c48dde8177bc519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.194s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG nova.objects.instance [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lazy-loading 'flavor' on Instance uuid 03fc42b1-f33d-4930-ba65-22540584b7fe {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d04b44b6-8bf7-41a7-b950-d5f18fc5c4cc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.085s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.194s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG os_brick.utils [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/disk 1073741824" returned: 0 in 0.060s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[277a79a8-feb4-471a-ae57-6fe48a3de9d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95882ba-5b60-4a47-8682-99b79a3f5b41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2fdb86-befd-45bb-925b-5c6c886a5d5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75a35a0-7fc1-42e6-872f-45b25e548bff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:47:38 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:47:38 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ee389d-c7f4-498b-8bea-261976a0770e]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG os_brick.utils [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Updating existing volume attachment record: 8700a507-aec9-4e2d-9d39-a2cab252f638 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Cannot resize image /opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG nova.objects.instance [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'migration_context' on Instance uuid 0dfd5674-7b67-45ee-9847-40c76ac4ada9 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Ensure instance console log exists: /opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG nova.network.neutron [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Successfully created port: ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG nova.objects.instance [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lazy-loading 'flavor' on Instance uuid b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b1e3ee66-b401-46a0-94c5-64c3b89fc0b3 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.488s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.network.neutron [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Successfully updated port: ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "refresh_cache-0dfd5674-7b67-45ee-9847-40c76ac4ada9" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquired lock "refresh_cache-0dfd5674-7b67-45ee-9847-40c76ac4ada9" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.network.neutron [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-2ddf1796-0d49-4925-8bc8-1409f2a686b9 req-c8b1d5cb-ce0e-462f-966e-18d1c0d711ab service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Received event network-changed-ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-2ddf1796-0d49-4925-8bc8-1409f2a686b9 req-c8b1d5cb-ce0e-462f-966e-18d1c0d711ab service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Refreshing instance network info cache due to event network-changed-ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2ddf1796-0d49-4925-8bc8-1409f2a686b9 req-c8b1d5cb-ce0e-462f-966e-18d1c0d711ab service nova] Acquiring lock "refresh_cache-0dfd5674-7b67-45ee-9847-40c76ac4ada9" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.network.neutron [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.network.neutron [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Updating instance_info_cache with network_info: [{"id": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "address": "fa:16:3e:32:9b:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec251a71-c6", "ovs_interfaceid": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Releasing lock "refresh_cache-0dfd5674-7b67-45ee-9847-40c76ac4ada9" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Instance network_info: |[{"id": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "address": "fa:16:3e:32:9b:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec251a71-c6", "ovs_interfaceid": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2ddf1796-0d49-4925-8bc8-1409f2a686b9 req-c8b1d5cb-ce0e-462f-966e-18d1c0d711ab service nova] Acquired lock "refresh_cache-0dfd5674-7b67-45ee-9847-40c76ac4ada9" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.network.neutron [req-2ddf1796-0d49-4925-8bc8-1409f2a686b9 req-c8b1d5cb-ce0e-462f-966e-18d1c0d711ab service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Refreshing network info cache for port ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Start _get_guest_xml network_info=[{"id": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "address": "fa:16:3e:32:9b:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec251a71-c6", "ovs_interfaceid": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:47:39 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:47:39 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1413059343',display_name='tempest-AttachVolumeNegativeTest-server-1413059343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1413059343',id=11,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo2XTl+w1FDGSD4ZqP5pY/zxxU6KWlLkYODDapqnU6+Wa3+lS58VB7z2v6DydjWOy8j1KF62isD2vHG9ksLyxRdsf0dZtQldXLYreIsHvSafKvrFCRarbYhBIpvMOvpYA==',key_name='tempest-keypair-1561677291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2c26e0199de48ee8c48dde8177bc519',ramdisk_id='',reservation_id='r-4urqzlst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1229463629',owner_user_name='tempest-AttachVolumeNegativeTest-1229463629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:47:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0cada11ffdb4ebc8d9e80218818ec3b',uuid=0dfd5674-7b67-45ee-9847-40c76ac4ada9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "address": "fa:16:3e:32:9b:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec251a71-c6", "ovs_interfaceid": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converting VIF {"id": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "address": "fa:16:3e:32:9b:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec251a71-c6", "ovs_interfaceid": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:9b:61,bridge_name='br-int',has_traffic_filtering=True,id=ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec251a71-c6') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.objects.instance [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dfd5674-7b67-45ee-9847-40c76ac4ada9 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:47:39 user nova-compute[72782]:   <uuid>0dfd5674-7b67-45ee-9847-40c76ac4ada9</uuid>
Aug 14 19:47:39 user nova-compute[72782]:   <name>instance-0000000b</name>
Aug 14 19:47:39 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:47:39 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:47:39 user nova-compute[72782]:   <metadata>
Aug 14 19:47:39 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:47:39 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:47:39 user nova-compute[72782]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1413059343</nova:name>
Aug 14 19:47:39 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:47:39</nova:creationTime>
Aug 14 19:47:39 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:47:39 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:47:39 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:47:39 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:47:39 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:47:39 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:47:39 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:47:39 user nova-compute[72782]:       <nova:owner>
Aug 14 19:47:39 user nova-compute[72782]:         <nova:user uuid="b0cada11ffdb4ebc8d9e80218818ec3b">tempest-AttachVolumeNegativeTest-1229463629-project-member</nova:user>
Aug 14 19:47:39 user nova-compute[72782]:         <nova:project uuid="f2c26e0199de48ee8c48dde8177bc519">tempest-AttachVolumeNegativeTest-1229463629</nova:project>
Aug 14 19:47:39 user nova-compute[72782]:       </nova:owner>
Aug 14 19:47:39 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:47:39 user nova-compute[72782]:       <nova:ports>
Aug 14 19:47:39 user nova-compute[72782]:         <nova:port uuid="ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0">
Aug 14 19:47:39 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 19:47:39 user nova-compute[72782]:         </nova:port>
Aug 14 19:47:39 user nova-compute[72782]:       </nova:ports>
Aug 14 19:47:39 user nova-compute[72782]:     </nova:instance>
Aug 14 19:47:39 user nova-compute[72782]:   </metadata>
Aug 14 19:47:39 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:47:39 user nova-compute[72782]:     <system>
Aug 14 19:47:39 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:47:39 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:47:39 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:47:39 user nova-compute[72782]:       <entry name="serial">0dfd5674-7b67-45ee-9847-40c76ac4ada9</entry>
Aug 14 19:47:39 user nova-compute[72782]:       <entry name="uuid">0dfd5674-7b67-45ee-9847-40c76ac4ada9</entry>
Aug 14 19:47:39 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:47:39 user nova-compute[72782]:     </system>
Aug 14 19:47:39 user nova-compute[72782]:   </sysinfo>
Aug 14 19:47:39 user nova-compute[72782]:   <os>
Aug 14 19:47:39 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:47:39 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:47:39 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:47:39 user nova-compute[72782]:   </os>
Aug 14 19:47:39 user nova-compute[72782]:   <features>
Aug 14 19:47:39 user nova-compute[72782]:     <acpi/>
Aug 14 19:47:39 user nova-compute[72782]:     <apic/>
Aug 14 19:47:39 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:47:39 user nova-compute[72782]:   </features>
Aug 14 19:47:39 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:47:39 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:47:39 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:47:39 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:47:39 user nova-compute[72782]:   </clock>
Aug 14 19:47:39 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:47:39 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:47:39 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:47:39 user nova-compute[72782]:   </cpu>
Aug 14 19:47:39 user nova-compute[72782]:   <devices>
Aug 14 19:47:39 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:47:39 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:47:39 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/disk"/>
Aug 14 19:47:39 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:47:39 user nova-compute[72782]:     </disk>
Aug 14 19:47:39 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:47:39 user nova-compute[72782]:       <mac address="fa:16:3e:32:9b:61"/>
Aug 14 19:47:39 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:47:39 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:47:39 user nova-compute[72782]:       <target dev="tapec251a71-c6"/>
Aug 14 19:47:39 user nova-compute[72782]:     </interface>
Aug 14 19:47:39 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:47:39 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/console.log" append="off"/>
Aug 14 19:47:39 user nova-compute[72782]:     </serial>
Aug 14 19:47:39 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:47:39 user nova-compute[72782]:     <video>
Aug 14 19:47:39 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:47:39 user nova-compute[72782]:     </video>
Aug 14 19:47:39 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:47:39 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:47:39 user nova-compute[72782]:     </rng>
Aug 14 19:47:39 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:47:39 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:47:39 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:47:39 user nova-compute[72782]:     </memballoon>
Aug 14 19:47:39 user nova-compute[72782]:   </devices>
Aug 14 19:47:39 user nova-compute[72782]: </domain>
Aug 14 19:47:39 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1413059343',display_name='tempest-AttachVolumeNegativeTest-server-1413059343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1413059343',id=11,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo2XTl+w1FDGSD4ZqP5pY/zxxU6KWlLkYODDapqnU6+Wa3+lS58VB7z2v6DydjWOy8j1KF62isD2vHG9ksLyxRdsf0dZtQldXLYreIsHvSafKvrFCRarbYhBIpvMOvpYA==',key_name='tempest-keypair-1561677291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2c26e0199de48ee8c48dde8177bc519',ramdisk_id='',reservation_id='r-4urqzlst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1229463629',owner_user_name='tempest-AttachVolumeNegativeTest-1229463629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:47:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0cada11ffdb4ebc8d9e80218818ec3b',uuid=0dfd5674-7b67-45ee-9847-40c76ac4ada9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "address": "fa:16:3e:32:9b:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec251a71-c6", "ovs_interfaceid": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converting VIF {"id": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "address": "fa:16:3e:32:9b:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec251a71-c6", "ovs_interfaceid": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:9b:61,bridge_name='br-int',has_traffic_filtering=True,id=ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec251a71-c6') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG os_vif [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:9b:61,bridge_name='br-int',has_traffic_filtering=True,id=ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec251a71-c6') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec251a71-c6, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec251a71-c6, col_values=(('external_ids', {'iface-id': 'ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:9b:61', 'vm-uuid': '0dfd5674-7b67-45ee-9847-40c76ac4ada9'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:39 user nova-compute[72782]: INFO os_vif [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:9b:61,bridge_name='br-int',has_traffic_filtering=True,id=ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec251a71-c6')
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] No VIF found with MAC fa:16:3e:32:9b:61, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:47:40 user nova-compute[72782]: DEBUG nova.network.neutron [req-2ddf1796-0d49-4925-8bc8-1409f2a686b9 req-c8b1d5cb-ce0e-462f-966e-18d1c0d711ab service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Updated VIF entry in instance network info cache for port ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:47:40 user nova-compute[72782]: DEBUG nova.network.neutron [req-2ddf1796-0d49-4925-8bc8-1409f2a686b9 req-c8b1d5cb-ce0e-462f-966e-18d1c0d711ab service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Updating instance_info_cache with network_info: [{"id": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "address": "fa:16:3e:32:9b:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec251a71-c6", "ovs_interfaceid": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:47:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2ddf1796-0d49-4925-8bc8-1409f2a686b9 req-c8b1d5cb-ce0e-462f-966e-18d1c0d711ab service nova] Releasing lock "refresh_cache-0dfd5674-7b67-45ee-9847-40c76ac4ada9" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:47:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:41 user nova-compute[72782]: DEBUG nova.compute.manager [req-287a6233-b737-48e0-87ff-e97fd16dd4cb req-02a4446d-0c75-4849-aff9-ff5fc33c2c7a service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Received event network-vif-plugged-ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-287a6233-b737-48e0-87ff-e97fd16dd4cb req-02a4446d-0c75-4849-aff9-ff5fc33c2c7a service nova] Acquiring lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-287a6233-b737-48e0-87ff-e97fd16dd4cb req-02a4446d-0c75-4849-aff9-ff5fc33c2c7a service nova] Lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-287a6233-b737-48e0-87ff-e97fd16dd4cb req-02a4446d-0c75-4849-aff9-ff5fc33c2c7a service nova] Lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:41 user nova-compute[72782]: DEBUG nova.compute.manager [req-287a6233-b737-48e0-87ff-e97fd16dd4cb req-02a4446d-0c75-4849-aff9-ff5fc33c2c7a service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] No waiting events found dispatching network-vif-plugged-ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:41 user nova-compute[72782]: WARNING nova.compute.manager [req-287a6233-b737-48e0-87ff-e97fd16dd4cb req-02a4446d-0c75-4849-aff9-ff5fc33c2c7a service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Received unexpected event network-vif-plugged-ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 for instance with vm_state building and task_state spawning.
Aug 14 19:47:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:43 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042463.6429148, 0dfd5674-7b67-45ee-9847-40c76ac4ada9 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:47:43 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] VM Resumed (Lifecycle Event)
Aug 14 19:47:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:47:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:47:43 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Instance spawned successfully.
Aug 14 19:47:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:47:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:47:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:47:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:47:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:47:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:47:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:47:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:47:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:47:43 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:47:43 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042463.6485462, 0dfd5674-7b67-45ee-9847-40c76ac4ada9 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:47:43 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] VM Started (Lifecycle Event)
Aug 14 19:47:43 user nova-compute[72782]: DEBUG nova.compute.manager [req-498b647a-de38-44fd-8a51-a7ee3da89219 req-356404bc-e579-46b0-aa7c-ced197550e30 service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Received event network-vif-plugged-ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-498b647a-de38-44fd-8a51-a7ee3da89219 req-356404bc-e579-46b0-aa7c-ced197550e30 service nova] Acquiring lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-498b647a-de38-44fd-8a51-a7ee3da89219 req-356404bc-e579-46b0-aa7c-ced197550e30 service nova] Lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-498b647a-de38-44fd-8a51-a7ee3da89219 req-356404bc-e579-46b0-aa7c-ced197550e30 service nova] Lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:43 user nova-compute[72782]: DEBUG nova.compute.manager [req-498b647a-de38-44fd-8a51-a7ee3da89219 req-356404bc-e579-46b0-aa7c-ced197550e30 service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] No waiting events found dispatching network-vif-plugged-ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:43 user nova-compute[72782]: WARNING nova.compute.manager [req-498b647a-de38-44fd-8a51-a7ee3da89219 req-356404bc-e579-46b0-aa7c-ced197550e30 service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Received unexpected event network-vif-plugged-ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 for instance with vm_state building and task_state spawning.
Aug 14 19:47:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:47:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:47:43 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:47:43 user nova-compute[72782]: INFO nova.compute.manager [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Took 6.38 seconds to spawn the instance on the hypervisor.
Aug 14 19:47:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:47:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:43 user nova-compute[72782]: INFO nova.compute.manager [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Took 7.15 seconds to build instance.
Aug 14 19:47:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-932bbf6c-abb9-4db8-8944-74936b3cf586 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.294s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pZKoOAjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:48 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:48 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:48 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d283de-4ce7-4950-be5f-64634fb33d94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:47:48 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7faa542-8a89-4918-a4cc-1946d5a4ad54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b] added
Aug 14 19:47:48 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[de15057b-ca75-45a2-9873-098559b86c8c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[438a8f5f-06f9-4c7d-8b68-d09d02ca03a9]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pZKoOAjX {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnCulVSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:48 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pZKoOAjX" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e428b012-3f67-46bb-ab59-3eeb5fa2bd7d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pZKoOAjX'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5dac99-322e-4aa6-af82-40fbea6ac65b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyaJRQYL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:48 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdcdf4f-41bb-42ab-9d89-0887c2ab61d5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:48 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:48 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:48 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:48 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:48 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:48 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:48 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:48 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03eb6dc-6b03-4409-a9a7-7243be429f52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b, portal: 172.16.0.220,3260]
Aug 14 19:47:49 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b, portal: 172.16.0.220,3260] successful.
Aug 14 19:47:49 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62b4dce-3622-4eb4-a868-fd88b3320333]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da016fa-ba82-45a1-b42e-7de146837205]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b (non-flash)
Aug 14 19:47:49 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:49 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:49 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:49 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:49 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b (non-flash)
Aug 14 19:47:49 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:49 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:49 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:49 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:49 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] HCTL ('35', '-', '-', 0) found on session 10 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28f8bc6-c1a0-4fd5-86b8-eea99ca1d6be]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Searching for a device in session 10 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pZKoOAjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Acquiring lock "03fc42b1-f33d-4930-ba65-22540584b7fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Acquiring lock "03fc42b1-f33d-4930-ba65-22540584b7fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:49 user nova-compute[72782]: INFO nova.compute.manager [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Terminating instance
Aug 14 19:47:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-43604aed-f9b9-437c-a35f-1c087745f912 req-268766ff-39a5-45cc-a5a9-542d882faecd service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Received event network-vif-unplugged-f11177e3-e8db-464f-b8be-971cb3afcdf8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-43604aed-f9b9-437c-a35f-1c087745f912 req-268766ff-39a5-45cc-a5a9-542d882faecd service nova] Acquiring lock "03fc42b1-f33d-4930-ba65-22540584b7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-43604aed-f9b9-437c-a35f-1c087745f912 req-268766ff-39a5-45cc-a5a9-542d882faecd service nova] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-43604aed-f9b9-437c-a35f-1c087745f912 req-268766ff-39a5-45cc-a5a9-542d882faecd service nova] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-43604aed-f9b9-437c-a35f-1c087745f912 req-268766ff-39a5-45cc-a5a9-542d882faecd service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] No waiting events found dispatching network-vif-unplugged-f11177e3-e8db-464f-b8be-971cb3afcdf8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-43604aed-f9b9-437c-a35f-1c087745f912 req-268766ff-39a5-45cc-a5a9-542d882faecd service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Received event network-vif-unplugged-f11177e3-e8db-464f-b8be-971cb3afcdf8 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:47:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:50 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Instance destroyed successfully.
Aug 14 19:47:50 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lazy-loading 'resources' on Instance uuid 03fc42b1-f33d-4930-ba65-22540584b7fe {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-120544087',display_name='tempest-AttachSCSIVolumeTestJSON-server-120544087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-120544087',id=3,image_ref='4c69f568-4fcd-4cbd-91de-5de7506d4e45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKaLehSH9hVxHcAYqtw2ruweM2okxfxi1ysC+IfTtUqa1RmtHJItept+V0x0jPvVR+LmxMTmlO+qhtBdolBFw9K0DvbmFwwZogTJdnTHx40sXaPZKLeQE32vn2w8ebRCw==',key_name='tempest-keypair-1801166116',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:45:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='259cfb8159bd4a3bb97eafcd7ddbfa29',ramdisk_id='',reservation_id='r-50y9m384',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4c69f568-4fcd-4cbd-91de-5de7506d4e45',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1734207431',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1734207431-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f115dc3b880454c9261803ea3832e23',uuid=03fc42b1-f33d-4930-ba65-22540584b7fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "address": "fa:16:3e:ae:6b:5f", "network": {"id": "f9f76ffd-5958-4a0b-b374-47e53fc2c74c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-415651663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259cfb8159bd4a3bb97eafcd7ddbfa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11177e3-e8", "ovs_interfaceid": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Converting VIF {"id": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "address": "fa:16:3e:ae:6b:5f", "network": {"id": "f9f76ffd-5958-4a0b-b374-47e53fc2c74c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-415651663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259cfb8159bd4a3bb97eafcd7ddbfa29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11177e3-e8", "ovs_interfaceid": "f11177e3-e8db-464f-b8be-971cb3afcdf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:6b:5f,bridge_name='br-int',has_traffic_filtering=True,id=f11177e3-e8db-464f-b8be-971cb3afcdf8,network=Network(f9f76ffd-5958-4a0b-b374-47e53fc2c74c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11177e3-e8') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_vif [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:6b:5f,bridge_name='br-int',has_traffic_filtering=True,id=f11177e3-e8db-464f-b8be-971cb3afcdf8,network=Network(f9f76ffd-5958-4a0b-b374-47e53fc2c74c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11177e3-e8') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf11177e3-e8, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23632663535303436', 'path': '/dev/sdd'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632663535303436', 'path': '/dev/sdd'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.266s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:50 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:50 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:47:50 user nova-compute[72782]: INFO os_vif [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:6b:5f,bridge_name='br-int',has_traffic_filtering=True,id=f11177e3-e8db-464f-b8be-971cb3afcdf8,network=Network(f9f76ffd-5958-4a0b-b374-47e53fc2c74c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11177e3-e8')
Aug 14 19:47:50 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Deleting instance files /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe_del
Aug 14 19:47:50 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Deletion of /opt/stack/data/nova/instances/03fc42b1-f33d-4930-ba65-22540584b7fe_del complete
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG nova.objects.instance [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Lazy-loading 'flavor' on Instance uuid 04969095-d5d4-4581-bb3e-df44e21d33d6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d5ad70-4d96-44c0-b168-da017004333d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:47:50 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[119a7641-c264-4756-8ca0-4c6e6360dd38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241] added
Aug 14 19:47:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] attach device xml: <disk type="block" device="disk">
Aug 14 19:47:50 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:47:50 user nova-compute[72782]:   <source dev="/dev/sdd"/>
Aug 14 19:47:50 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:47:50 user nova-compute[72782]:   <serial>e27a3b0e-a5d9-43f8-9889-d40525866b7b</serial>
Aug 14 19:47:50 user nova-compute[72782]: </disk>
Aug 14 19:47:50 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b95331-ce39-490d-ab4f-050a70800190]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b63023-392c-4950-9e7b-bb0782ed1949]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AnCulVSf {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:50 user nova-compute[72782]: INFO nova.compute.manager [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AnCulVSf" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e41dd7-4c99-4472-a36b-9ed97522516d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AnCulVSf'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e23b81-9b0f-4612-8e7a-4d4a95e7fb4f]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[589da571-2c13-4afd-a6a3-165d96d31e77]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b (non-flash)
Aug 14 19:47:50 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:50 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:50 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:50 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b (non-flash)
Aug 14 19:47:50 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:50 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:50 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:50 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3faee57-9e5c-4d34-a5df-f85629c338e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241, portal: 172.16.0.220,3260]
Aug 14 19:47:50 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241, portal: 172.16.0.220,3260] successful.
Aug 14 19:47:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb05126-80e4-401b-b333-d95ce720276c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea682722-b73f-46d7-94ee-21eb318dfbf4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b (non-flash)
Aug 14 19:47:50 user nova-compute[72782]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:47:50 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:50 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:50 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:50 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b (non-flash)
Aug 14 19:47:50 user nova-compute[72782]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:47:50 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:50 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:50 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:50 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30b4a98-d9cf-4870-a8c0-86b423f6575f]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnCulVSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] No VIF found with MAC fa:16:3e:ac:8b:14, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d076b2d8-d368-4eb9-9db5-664f55352d4b tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.292s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28505808-fcf5-46ba-a9fe-1d3dc5d5bd8e tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] volume_snapshot_create: create_info: {'snapshot_id': '0b1e8cf9-1a47-44a3-a99a-1c40aba9cf63', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72782) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28505808-fcf5-46ba-a9fe-1d3dc5d5bd8e tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] snap xml: <domainsnapshot>
Aug 14 19:47:51 user nova-compute[72782]:   <disks>
Aug 14 19:47:51 user nova-compute[72782]:     <disk name="/dev/sdd" snapshot="external" type="file">
Aug 14 19:47:51 user nova-compute[72782]:       <source file="/dev/new_file"/>
Aug 14 19:47:51 user nova-compute[72782]:     </disk>
Aug 14 19:47:51 user nova-compute[72782]:     <disk name="vda" snapshot="no"/>
Aug 14 19:47:51 user nova-compute[72782]:   </disks>
Aug 14 19:47:51 user nova-compute[72782]: </domainsnapshot>
Aug 14 19:47:51 user nova-compute[72782]:  {{(pid=72782) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-28505808-fcf5-46ba-a9fe-1d3dc5d5bd8e tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Lazy-loading 'system_metadata' on Instance uuid 04969095-d5d4-4581-bb3e-df44e21d33d6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:51 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-28505808-fcf5-46ba-a9fe-1d3dc5d5bd8e tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [None req-28505808-fcf5-46ba-a9fe-1d3dc5d5bd8e tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Traceback (most recent call last):
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     rv = execute(f, *args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     six.reraise(c, e, tb)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     raise value
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     rv = meth(*args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] 
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [None req-28505808-fcf5-46ba-a9fe-1d3dc5d5bd8e tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Traceback (most recent call last):
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     self._volume_snapshot_create(context, instance, guest,
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     rv = execute(f, *args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     six.reraise(c, e, tb)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     raise value
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     rv = meth(*args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] 
Aug 14 19:47:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-318d89d7-aec0-4a43-94cb-818dd6f3aad1 tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] volume_snapshot_delete: delete_info: {'volume_id': 'e27a3b0e-a5d9-43f8-9889-d40525866b7b'} {{(pid=72782) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [None req-318d89d7-aec0-4a43-94cb-818dd6f3aad1 tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Traceback (most recent call last):
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6]     if delete_info['type'] != 'qcow2':
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] KeyError: 'type'
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] 
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [None req-28505808-fcf5-46ba-a9fe-1d3dc5d5bd8e tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 0b1e8cf9-1a47-44a3-a99a-1c40aba9cf63 could not be found.
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     raise value
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver 
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver 
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 0b1e8cf9-1a47-44a3-a99a-1c40aba9cf63 could not be found. (HTTP 404) (Request-ID: req-7ea0fc8b-7da8-4aa4-8a5d-6a631b0781b1)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver 
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver 
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 0b1e8cf9-1a47-44a3-a99a-1c40aba9cf63 could not be found.
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver 
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server [None req-28505808-fcf5-46ba-a9fe-1d3dc5d5bd8e tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     raise value
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server 
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver [None req-318d89d7-aec0-4a43-94cb-818dd6f3aad1 tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver 
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver 
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-f07f7513-091d-4f19-88c3-bb6e89f86426)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver 
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver 
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 14 19:47:51 user nova-compute[72782]: ERROR nova.virt.libvirt.driver 
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server [None req-318d89d7-aec0-4a43-94cb-818dd6f3aad1 tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Exception during message handling: KeyError: 'type'
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 14 19:47:51 user nova-compute[72782]: ERROR oslo_messaging.rpc.server 
Aug 14 19:47:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] <== connect_volume: return (2695ms) {'type': 'block', 'scsi_wwn': '23031363539343863', 'path': '/dev/sdf'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031363539343863', 'path': '/dev/sdf'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.625s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:51 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:51 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lazy-loading 'flavor' on Instance uuid d51b224a-5167-40bf-8d3c-8426b420458c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG nova.compute.manager [req-78b97971-d5dc-40af-a90a-1a454b4f5a3c req-b2893d5a-8465-414f-97c7-3dc8ab08a956 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Received event network-vif-plugged-f11177e3-e8db-464f-b8be-971cb3afcdf8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-78b97971-d5dc-40af-a90a-1a454b4f5a3c req-b2893d5a-8465-414f-97c7-3dc8ab08a956 service nova] Acquiring lock "03fc42b1-f33d-4930-ba65-22540584b7fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-78b97971-d5dc-40af-a90a-1a454b4f5a3c req-b2893d5a-8465-414f-97c7-3dc8ab08a956 service nova] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-78b97971-d5dc-40af-a90a-1a454b4f5a3c req-b2893d5a-8465-414f-97c7-3dc8ab08a956 service nova] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG nova.compute.manager [req-78b97971-d5dc-40af-a90a-1a454b4f5a3c req-b2893d5a-8465-414f-97c7-3dc8ab08a956 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] No waiting events found dispatching network-vif-plugged-f11177e3-e8db-464f-b8be-971cb3afcdf8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:47:51 user nova-compute[72782]: WARNING nova.compute.manager [req-78b97971-d5dc-40af-a90a-1a454b4f5a3c req-b2893d5a-8465-414f-97c7-3dc8ab08a956 service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Received unexpected event network-vif-plugged-f11177e3-e8db-464f-b8be-971cb3afcdf8 for instance with vm_state active and task_state deleting.
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9851f6-d26f-4578-97c4-26d9e65ec3a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:47:51 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:47:51 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:47:51 user nova-compute[72782]:   <source dev="/dev/sdf"/>
Aug 14 19:47:51 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:47:51 user nova-compute[72782]:   <serial>ddb56ed8-6a67-421d-bb15-f23b6a7cd241</serial>
Aug 14 19:47:51 user nova-compute[72782]: </disk>
Aug 14 19:47:51 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cf64c4-6ec0-480a-afee-ba32f2f1498d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85] added
Aug 14 19:47:51 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e07e4f-02c0-46a6-8db0-ca86ddf17c1e]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG nova.compute.manager [req-a31c0a3f-3ee8-4868-b5b9-3645b0ab0946 req-366debe5-8bfd-469c-beb5-d95d18dcf89f service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Received event network-vif-deleted-f11177e3-e8db-464f-b8be-971cb3afcdf8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:51 user nova-compute[72782]: INFO nova.compute.manager [req-a31c0a3f-3ee8-4868-b5b9-3645b0ab0946 req-366debe5-8bfd-469c-beb5-d95d18dcf89f service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Neutron deleted interface f11177e3-e8db-464f-b8be-971cb3afcdf8; detaching it from the instance and deleting it from the info cache
Aug 14 19:47:51 user nova-compute[72782]: DEBUG nova.network.neutron [req-a31c0a3f-3ee8-4868-b5b9-3645b0ab0946 req-366debe5-8bfd-469c-beb5-d95d18dcf89f service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[42df0b7d-b275-40b6-8bea-8e5f99ad039d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uyaJRQYL {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG nova.compute.manager [req-a31c0a3f-3ee8-4868-b5b9-3645b0ab0946 req-366debe5-8bfd-469c-beb5-d95d18dcf89f service nova] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Detach interface failed, port_id=f11177e3-e8db-464f-b8be-971cb3afcdf8, reason: Instance 03fc42b1-f33d-4930-ba65-22540584b7fe could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 19:47:51 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Took 1.44 seconds to deallocate network for instance.
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uyaJRQYL" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0a32ed-2461-427d-8fd6-62482ab0e40c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uyaJRQYL'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.042s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a3834f-7414-40f7-9f27-e052d31b7303]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Skipping network cache update for instance because it is being deleted. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9891}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca2f5e2-1300-41c9-84f9-84981e75c18f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b (non-flash)
Aug 14 19:47:51 user nova-compute[72782]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:47:51 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:51 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:51 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:51 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:51 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b (non-flash)
Aug 14 19:47:51 user nova-compute[72782]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:47:51 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:51 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:51 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:51 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:51 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4cc806-b199-4647-96e2-b6b0dd4460f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85, portal: 172.16.0.220,3260]
Aug 14 19:47:51 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85, portal: 172.16.0.220,3260] successful.
Aug 14 19:47:51 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[856defe6-d4fd-40b4-9e16-44313a84c6f0]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06707a5-195c-4617-b5b9-263bab56e9fb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b (non-flash)
Aug 14 19:47:52 user nova-compute[72782]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:47:52 user nova-compute[72782]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 (non-flash)
Aug 14 19:47:52 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:52 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:52 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:52 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b (non-flash)
Aug 14 19:47:52 user nova-compute[72782]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:47:52 user nova-compute[72782]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 (non-flash)
Aug 14 19:47:52 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:52 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:52 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:52 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.456s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de7af16-5bd0-4ef5-8ecc-b35de3a1a8a4]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyaJRQYL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Acquiring lock "04969095-d5d4-4581-bb3e-df44e21d33d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:52 user nova-compute[72782]: INFO nova.compute.manager [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Detaching volume e27a3b0e-a5d9-43f8-9889-d40525866b7b
Aug 14 19:47:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] No VIF found with MAC fa:16:3e:ac:9b:7b, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:47:52 user nova-compute[72782]: INFO nova.virt.block_device [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Attempting to driver detach volume e27a3b0e-a5d9-43f8-9889-d40525866b7b from mountpoint /dev/vdb
Aug 14 19:47:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Attempting to detach device vdb from instance 04969095-d5d4-4581-bb3e-df44e21d33d6 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] detach device xml: <disk type="block" device="disk">
Aug 14 19:47:52 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:47:52 user nova-compute[72782]:   <source dev="/dev/sdd"/>
Aug 14 19:47:52 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:47:52 user nova-compute[72782]:   <serial>e27a3b0e-a5d9-43f8-9889-d40525866b7b</serial>
Aug 14 19:47:52 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:47:52 user nova-compute[72782]: </disk>
Aug 14 19:47:52 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:47:52 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Successfully detached device vdb from instance 04969095-d5d4-4581-bb3e-df44e21d33d6 from the persistent domain config.
Aug 14 19:47:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 04969095-d5d4-4581-bb3e-df44e21d33d6 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] detach device xml: <disk type="block" device="disk">
Aug 14 19:47:52 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:47:52 user nova-compute[72782]:   <source dev="/dev/sdd"/>
Aug 14 19:47:52 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:47:52 user nova-compute[72782]:   <serial>e27a3b0e-a5d9-43f8-9889-d40525866b7b</serial>
Aug 14 19:47:52 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:47:52 user nova-compute[72782]: </disk>
Aug 14 19:47:52 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-048a4381-e727-44b8-9e8d-256fd9bcdebc tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "d51b224a-5167-40bf-8d3c-8426b420458c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.097s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.575s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:52 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Deleted allocations for instance 03fc42b1-f33d-4930-ba65-22540584b7fe
Aug 14 19:47:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fc0b7677-9c74-4dd0-a56a-caad6fc04dcc tempest-AttachSCSIVolumeTestJSON-1734207431 tempest-AttachSCSIVolumeTestJSON-1734207431-project-member] Lock "03fc42b1-f33d-4930-ba65-22540584b7fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.399s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692042472.7476995, 04969095-d5d4-4581-bb3e-df44e21d33d6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 04969095-d5d4-4581-bb3e-df44e21d33d6 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:47:52 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Successfully detached device vdb from instance 04969095-d5d4-4581-bb3e-df44e21d33d6 from the live domain config.
Aug 14 19:47:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:47:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pZKoOAjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:52 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:47:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.515s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] <== connect_volume: return (4140ms) {'type': 'block', 'scsi_wwn': '23937356661303932', 'path': '/dev/sdh'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937356661303932', 'path': '/dev/sdh'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.310s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG nova.objects.instance [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lazy-loading 'flavor' on Instance uuid 5d532038-555f-42d3-b35a-9e6f0350b023 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[057a5ff7-a11d-4554-b383-1cc13eb07eab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:47:53 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:47:53 user nova-compute[72782]:   <source dev="/dev/sdh"/>
Aug 14 19:47:53 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:47:53 user nova-compute[72782]:   <serial>4b15ecee-7780-4324-a64d-7486d96fcb85</serial>
Aug 14 19:47:53 user nova-compute[72782]: </disk>
Aug 14 19:47:53 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f895f3e2-02da-44d0-8b92-e4aa0df6bcdc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b (non-flash)
Aug 14 19:47:53 user nova-compute[72782]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:47:53 user nova-compute[72782]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 (non-flash)
Aug 14 19:47:53 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:53 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:53 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:53 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:53 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b (non-flash)
Aug 14 19:47:53 user nova-compute[72782]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:47:53 user nova-compute[72782]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 (non-flash)
Aug 14 19:47:53 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:47:53 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:47:53 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:47:53 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:47:53 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e86597e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b'): ({'sdd'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Removing single pathed devices sdd {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9cb546-07e1-4ec2-be1e-22f683f7d837]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d67248-5331-464a-82d1-cdc7aa44229c]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Flushing IO for device /dev/sdd {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[736bd501-dca4-422a-a606-8ffd0dfe227b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Updating instance_info_cache with network_info: [{"id": "888a72be-5707-4d58-98e1-b472c928de22", "address": "fa:16:3e:83:d0:33", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888a72be-57", "ovs_interfaceid": "888a72be-5707-4d58-98e1-b472c928de22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e551910b-c88e-4683-ac1f-c9fabe15b219]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b72dce3-27f5-4cec-beb8-ef485704a57a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.116s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec81fe7-292e-467e-aaf0-a4d74649ecff]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b, portal: 172.16.0.220,3260]
Aug 14 19:47:53 user nova-compute[72782]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b, portal: 172.16.0.220,3260] successful.
Aug 14 19:47:53 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27a3b0e-a5d9-43f8-9889-d40525866b7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[048d22d5-3e53-45fb-8c1e-44f66c011605]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.433s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] <== disconnect_volume: return (743ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] No BDM found with device name hda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] No VIF found with MAC fa:16:3e:0c:34:c8, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d8f54491-63bb-4193-b497-e378ebf67ace tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "5d532038-555f-42d3-b35a-9e6f0350b023" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.224s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Acquiring lock "d51b224a-5167-40bf-8d3c-8426b420458c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Lock "d51b224a-5167-40bf-8d3c-8426b420458c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG os_brick.utils [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad348db-55ce-4614-a812-56f058fafab6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:47:54 user nova-compute[72782]: INFO nova.compute.claims [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Claim successful on node user
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab61984-0604-47e1-bfcb-cdfcb1cc4863]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a31c9ce-59f9-40a4-99d7-dcfa4ac6d3cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[459af739-92c5-42dd-834d-1672b7a355fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:47:54 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8218deb-8f70-4d33-a5dd-e784f42e0ff3]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG os_brick.utils [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:54 user nova-compute[72782]: INFO nova.compute.manager [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Swapping volume ddb56ed8-6a67-421d-bb15-f23b6a7cd241 for b4896c6c-889e-4372-a34c-43256cbe0dc4
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.694s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:47:54 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:47:55 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG nova.policy [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e9eaaa882374ccca3caa21be6023022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ab27e735104a3caad51ab1049677a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:47:55 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Creating image(s)
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "/opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "/opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "/opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.170s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.172s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk 1073741824" returned: 0 in 0.050s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Successfully created port: 5b0452fc-96f1-4844-afe9-290b93c90fda {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.247s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Checking if we can resize image /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Cannot resize image /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lazy-loading 'migration_context' on Instance uuid 132b9b0b-9556-4aaf-a9ad-577e18215e84 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Ensure instance console log exists: /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Successfully updated port: 5b0452fc-96f1-4844-afe9-290b93c90fda {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "refresh_cache-132b9b0b-9556-4aaf-a9ad-577e18215e84" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquired lock "refresh_cache-132b9b0b-9556-4aaf-a9ad-577e18215e84" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG nova.compute.manager [req-812ffcfb-36da-46e5-acb9-5f365da58724 req-245e3a5f-2351-44e6-8ce3-84cb67b24322 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Received event network-changed-5b0452fc-96f1-4844-afe9-290b93c90fda {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG nova.compute.manager [req-812ffcfb-36da-46e5-acb9-5f365da58724 req-245e3a5f-2351-44e6-8ce3-84cb67b24322 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Refreshing instance network info cache due to event network-changed-5b0452fc-96f1-4844-afe9-290b93c90fda. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-812ffcfb-36da-46e5-acb9-5f365da58724 req-245e3a5f-2351-44e6-8ce3-84cb67b24322 service nova] Acquiring lock "refresh_cache-132b9b0b-9556-4aaf-a9ad-577e18215e84" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Updating instance_info_cache with network_info: [{"id": "5b0452fc-96f1-4844-afe9-290b93c90fda", "address": "fa:16:3e:6a:36:8a", "network": {"id": "2e677476-9a97-4e6d-a259-3c1427e62a6e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-607049029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab27e735104a3caad51ab1049677a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0452fc-96", "ovs_interfaceid": "5b0452fc-96f1-4844-afe9-290b93c90fda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Releasing lock "refresh_cache-132b9b0b-9556-4aaf-a9ad-577e18215e84" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Instance network_info: |[{"id": "5b0452fc-96f1-4844-afe9-290b93c90fda", "address": "fa:16:3e:6a:36:8a", "network": {"id": "2e677476-9a97-4e6d-a259-3c1427e62a6e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-607049029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab27e735104a3caad51ab1049677a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0452fc-96", "ovs_interfaceid": "5b0452fc-96f1-4844-afe9-290b93c90fda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-812ffcfb-36da-46e5-acb9-5f365da58724 req-245e3a5f-2351-44e6-8ce3-84cb67b24322 service nova] Acquired lock "refresh_cache-132b9b0b-9556-4aaf-a9ad-577e18215e84" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG nova.network.neutron [req-812ffcfb-36da-46e5-acb9-5f365da58724 req-245e3a5f-2351-44e6-8ce3-84cb67b24322 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Refreshing network info cache for port 5b0452fc-96f1-4844-afe9-290b93c90fda {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Start _get_guest_xml network_info=[{"id": "5b0452fc-96f1-4844-afe9-290b93c90fda", "address": "fa:16:3e:6a:36:8a", "network": {"id": "2e677476-9a97-4e6d-a259-3c1427e62a6e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-607049029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab27e735104a3caad51ab1049677a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0452fc-96", "ovs_interfaceid": "5b0452fc-96f1-4844-afe9-290b93c90fda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:47:57 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:47:57 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:47:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1332349428',display_name='tempest-TestServerVolumeAttachmentScenario-server-1332349428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1332349428',id=12,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2j9WPGVcxPMkHwhH1b2XrLb2qAY9wnIGEQivbR27VCyyYzuASc0xgPrpTGxFMhCTgOFRd4NRv/buaO3fO/8vnao0Yu73RcffnnVqbDY0Xq2Ar57C7fRhwB+e+vORQCFw==',key_name='tempest-keypair-120233547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ab27e735104a3caad51ab1049677a5',ramdisk_id='',reservation_id='r-42l4m140',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1589824258',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1589824258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:47:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9eaaa882374ccca3caa21be6023022',uuid=132b9b0b-9556-4aaf-a9ad-577e18215e84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b0452fc-96f1-4844-afe9-290b93c90fda", "address": "fa:16:3e:6a:36:8a", "network": {"id": "2e677476-9a97-4e6d-a259-3c1427e62a6e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-607049029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab27e735104a3caad51ab1049677a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0452fc-96", "ovs_interfaceid": "5b0452fc-96f1-4844-afe9-290b93c90fda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Converting VIF {"id": "5b0452fc-96f1-4844-afe9-290b93c90fda", "address": "fa:16:3e:6a:36:8a", "network": {"id": "2e677476-9a97-4e6d-a259-3c1427e62a6e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-607049029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab27e735104a3caad51ab1049677a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0452fc-96", "ovs_interfaceid": "5b0452fc-96f1-4844-afe9-290b93c90fda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:36:8a,bridge_name='br-int',has_traffic_filtering=True,id=5b0452fc-96f1-4844-afe9-290b93c90fda,network=Network(2e677476-9a97-4e6d-a259-3c1427e62a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b0452fc-96') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lazy-loading 'pci_devices' on Instance uuid 132b9b0b-9556-4aaf-a9ad-577e18215e84 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:47:57 user nova-compute[72782]:   <uuid>132b9b0b-9556-4aaf-a9ad-577e18215e84</uuid>
Aug 14 19:47:57 user nova-compute[72782]:   <name>instance-0000000c</name>
Aug 14 19:47:57 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:47:57 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:47:57 user nova-compute[72782]:   <metadata>
Aug 14 19:47:57 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:47:57 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:47:57 user nova-compute[72782]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1332349428</nova:name>
Aug 14 19:47:57 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:47:57</nova:creationTime>
Aug 14 19:47:57 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:47:57 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:47:57 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:47:57 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:47:57 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:47:57 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:47:57 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:47:57 user nova-compute[72782]:       <nova:owner>
Aug 14 19:47:57 user nova-compute[72782]:         <nova:user uuid="8e9eaaa882374ccca3caa21be6023022">tempest-TestServerVolumeAttachmentScenario-1589824258-project-member</nova:user>
Aug 14 19:47:57 user nova-compute[72782]:         <nova:project uuid="f7ab27e735104a3caad51ab1049677a5">tempest-TestServerVolumeAttachmentScenario-1589824258</nova:project>
Aug 14 19:47:57 user nova-compute[72782]:       </nova:owner>
Aug 14 19:47:57 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:47:57 user nova-compute[72782]:       <nova:ports>
Aug 14 19:47:57 user nova-compute[72782]:         <nova:port uuid="5b0452fc-96f1-4844-afe9-290b93c90fda">
Aug 14 19:47:57 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 19:47:57 user nova-compute[72782]:         </nova:port>
Aug 14 19:47:57 user nova-compute[72782]:       </nova:ports>
Aug 14 19:47:57 user nova-compute[72782]:     </nova:instance>
Aug 14 19:47:57 user nova-compute[72782]:   </metadata>
Aug 14 19:47:57 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:47:57 user nova-compute[72782]:     <system>
Aug 14 19:47:57 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:47:57 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:47:57 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:47:57 user nova-compute[72782]:       <entry name="serial">132b9b0b-9556-4aaf-a9ad-577e18215e84</entry>
Aug 14 19:47:57 user nova-compute[72782]:       <entry name="uuid">132b9b0b-9556-4aaf-a9ad-577e18215e84</entry>
Aug 14 19:47:57 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:47:57 user nova-compute[72782]:     </system>
Aug 14 19:47:57 user nova-compute[72782]:   </sysinfo>
Aug 14 19:47:57 user nova-compute[72782]:   <os>
Aug 14 19:47:57 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:47:57 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:47:57 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:47:57 user nova-compute[72782]:   </os>
Aug 14 19:47:57 user nova-compute[72782]:   <features>
Aug 14 19:47:57 user nova-compute[72782]:     <acpi/>
Aug 14 19:47:57 user nova-compute[72782]:     <apic/>
Aug 14 19:47:57 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:47:57 user nova-compute[72782]:   </features>
Aug 14 19:47:57 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:47:57 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:47:57 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:47:57 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:47:57 user nova-compute[72782]:   </clock>
Aug 14 19:47:57 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:47:57 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:47:57 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:47:57 user nova-compute[72782]:   </cpu>
Aug 14 19:47:57 user nova-compute[72782]:   <devices>
Aug 14 19:47:57 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:47:57 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:47:57 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk"/>
Aug 14 19:47:57 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:47:57 user nova-compute[72782]:     </disk>
Aug 14 19:47:57 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:47:57 user nova-compute[72782]:       <mac address="fa:16:3e:6a:36:8a"/>
Aug 14 19:47:57 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:47:57 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:47:57 user nova-compute[72782]:       <target dev="tap5b0452fc-96"/>
Aug 14 19:47:57 user nova-compute[72782]:     </interface>
Aug 14 19:47:57 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:47:57 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/console.log" append="off"/>
Aug 14 19:47:57 user nova-compute[72782]:     </serial>
Aug 14 19:47:57 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:47:57 user nova-compute[72782]:     <video>
Aug 14 19:47:57 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:47:57 user nova-compute[72782]:     </video>
Aug 14 19:47:57 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:47:57 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:47:57 user nova-compute[72782]:     </rng>
Aug 14 19:47:57 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:47:57 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:47:57 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:47:57 user nova-compute[72782]:     </memballoon>
Aug 14 19:47:57 user nova-compute[72782]:   </devices>
Aug 14 19:47:57 user nova-compute[72782]: </domain>
Aug 14 19:47:57 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:47:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1332349428',display_name='tempest-TestServerVolumeAttachmentScenario-server-1332349428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1332349428',id=12,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2j9WPGVcxPMkHwhH1b2XrLb2qAY9wnIGEQivbR27VCyyYzuASc0xgPrpTGxFMhCTgOFRd4NRv/buaO3fO/8vnao0Yu73RcffnnVqbDY0Xq2Ar57C7fRhwB+e+vORQCFw==',key_name='tempest-keypair-120233547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ab27e735104a3caad51ab1049677a5',ramdisk_id='',reservation_id='r-42l4m140',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1589824258',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1589824258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:47:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9eaaa882374ccca3caa21be6023022',uuid=132b9b0b-9556-4aaf-a9ad-577e18215e84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b0452fc-96f1-4844-afe9-290b93c90fda", "address": "fa:16:3e:6a:36:8a", "network": {"id": "2e677476-9a97-4e6d-a259-3c1427e62a6e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-607049029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab27e735104a3caad51ab1049677a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0452fc-96", "ovs_interfaceid": "5b0452fc-96f1-4844-afe9-290b93c90fda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Converting VIF {"id": "5b0452fc-96f1-4844-afe9-290b93c90fda", "address": "fa:16:3e:6a:36:8a", "network": {"id": "2e677476-9a97-4e6d-a259-3c1427e62a6e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-607049029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab27e735104a3caad51ab1049677a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0452fc-96", "ovs_interfaceid": "5b0452fc-96f1-4844-afe9-290b93c90fda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:36:8a,bridge_name='br-int',has_traffic_filtering=True,id=5b0452fc-96f1-4844-afe9-290b93c90fda,network=Network(2e677476-9a97-4e6d-a259-3c1427e62a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b0452fc-96') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG os_vif [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:36:8a,bridge_name='br-int',has_traffic_filtering=True,id=5b0452fc-96f1-4844-afe9-290b93c90fda,network=Network(2e677476-9a97-4e6d-a259-3c1427e62a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b0452fc-96') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b0452fc-96, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b0452fc-96, col_values=(('external_ids', {'iface-id': '5b0452fc-96f1-4844-afe9-290b93c90fda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:36:8a', 'vm-uuid': '132b9b0b-9556-4aaf-a9ad-577e18215e84'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:47:57 user nova-compute[72782]: INFO os_vif [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:36:8a,bridge_name='br-int',has_traffic_filtering=True,id=5b0452fc-96f1-4844-afe9-290b93c90fda,network=Network(2e677476-9a97-4e6d-a259-3c1427e62a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b0452fc-96')
Aug 14 19:47:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:47:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] No VIF found with MAC fa:16:3e:6a:36:8a, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.objects.instance [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Lazy-loading 'flavor' on Instance uuid 04969095-d5d4-4581-bb3e-df44e21d33d6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042480.8147254, 132b9b0b-9556-4aaf-a9ad-577e18215e84 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:48:01 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] VM Resumed (Lifecycle Event)
Aug 14 19:48:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-3f37ba3b-9882-431f-8781-d4aaf3fce947 req-72883cf9-29f6-4a74-90a0-38218e415fb0 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Received event network-vif-plugged-5b0452fc-96f1-4844-afe9-290b93c90fda {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3f37ba3b-9882-431f-8781-d4aaf3fce947 req-72883cf9-29f6-4a74-90a0-38218e415fb0 service nova] Acquiring lock "132b9b0b-9556-4aaf-a9ad-577e18215e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3f37ba3b-9882-431f-8781-d4aaf3fce947 req-72883cf9-29f6-4a74-90a0-38218e415fb0 service nova] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3f37ba3b-9882-431f-8781-d4aaf3fce947 req-72883cf9-29f6-4a74-90a0-38218e415fb0 service nova] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-3f37ba3b-9882-431f-8781-d4aaf3fce947 req-72883cf9-29f6-4a74-90a0-38218e415fb0 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] No waiting events found dispatching network-vif-plugged-5b0452fc-96f1-4844-afe9-290b93c90fda {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:01 user nova-compute[72782]: WARNING nova.compute.manager [req-3f37ba3b-9882-431f-8781-d4aaf3fce947 req-72883cf9-29f6-4a74-90a0-38218e415fb0 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Received unexpected event network-vif-plugged-5b0452fc-96f1-4844-afe9-290b93c90fda for instance with vm_state building and task_state spawning.
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-ef2b8513-956c-48c3-a24d-f12d7f644818 req-6ef13e31-b838-4ba9-83e0-a9f14923ceae service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Received event network-vif-plugged-5b0452fc-96f1-4844-afe9-290b93c90fda {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ef2b8513-956c-48c3-a24d-f12d7f644818 req-6ef13e31-b838-4ba9-83e0-a9f14923ceae service nova] Acquiring lock "132b9b0b-9556-4aaf-a9ad-577e18215e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ef2b8513-956c-48c3-a24d-f12d7f644818 req-6ef13e31-b838-4ba9-83e0-a9f14923ceae service nova] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ef2b8513-956c-48c3-a24d-f12d7f644818 req-6ef13e31-b838-4ba9-83e0-a9f14923ceae service nova] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-ef2b8513-956c-48c3-a24d-f12d7f644818 req-6ef13e31-b838-4ba9-83e0-a9f14923ceae service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] No waiting events found dispatching network-vif-plugged-5b0452fc-96f1-4844-afe9-290b93c90fda {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:01 user nova-compute[72782]: WARNING nova.compute.manager [req-ef2b8513-956c-48c3-a24d-f12d7f644818 req-6ef13e31-b838-4ba9-83e0-a9f14923ceae service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Received unexpected event network-vif-plugged-5b0452fc-96f1-4844-afe9-290b93c90fda for instance with vm_state building and task_state spawning.
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:48:01 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:48:01 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7217MB free_disk=25.759323120117188GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f720d260-2a7d-4761-9bb4-1dc3775780af tempest-VolumesAssistedSnapshotsTest-134922125 tempest-VolumesAssistedSnapshotsTest-134922125-project-admin] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.313s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:01 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Instance spawned successfully.
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "5d532038-555f-42d3-b35a-9e6f0350b023" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "5d532038-555f-42d3-b35a-9e6f0350b023" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:01 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042480.815002, 132b9b0b-9556-4aaf-a9ad-577e18215e84 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:48:01 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] VM Started (Lifecycle Event)
Aug 14 19:48:01 user nova-compute[72782]: INFO nova.compute.manager [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Detaching volume 4b15ecee-7780-4324-a64d-7486d96fcb85
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:48:01 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:48:01 user nova-compute[72782]: INFO nova.virt.block_device [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Attempting to driver detach volume 4b15ecee-7780-4324-a64d-7486d96fcb85 from mountpoint /dev/vdb
Aug 14 19:48:01 user nova-compute[72782]: INFO nova.compute.manager [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Took 6.39 seconds to spawn the instance on the hypervisor.
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Attempting to detach device vdb from instance 5d532038-555f-42d3-b35a-9e6f0350b023 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:48:01 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:48:01 user nova-compute[72782]:   <source dev="/dev/sdh"/>
Aug 14 19:48:01 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:48:01 user nova-compute[72782]:   <serial>4b15ecee-7780-4324-a64d-7486d96fcb85</serial>
Aug 14 19:48:01 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 19:48:01 user nova-compute[72782]: </disk>
Aug 14 19:48:01 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 5d532038-555f-42d3-b35a-9e6f0350b023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 04969095-d5d4-4581-bb3e-df44e21d33d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance d51b224a-5167-40bf-8d3c-8426b420458c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ea26c664-91cb-4824-a66b-c8fe216c6ba4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 00a09aca-9913-4fba-91c6-9702c0dc44bd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0dfd5674-7b67-45ee-9847-40c76ac4ada9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 132b9b0b-9556-4aaf-a9ad-577e18215e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:48:01 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Successfully detached device vdb from instance 5d532038-555f-42d3-b35a-9e6f0350b023 from the persistent domain config.
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d532038-555f-42d3-b35a-9e6f0350b023 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:48:01 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:48:01 user nova-compute[72782]:   <source dev="/dev/sdh"/>
Aug 14 19:48:01 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:48:01 user nova-compute[72782]:   <serial>4b15ecee-7780-4324-a64d-7486d96fcb85</serial>
Aug 14 19:48:01 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 19:48:01 user nova-compute[72782]: </disk>
Aug 14 19:48:01 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.network.neutron [req-812ffcfb-36da-46e5-acb9-5f365da58724 req-245e3a5f-2351-44e6-8ce3-84cb67b24322 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Updated VIF entry in instance network info cache for port 5b0452fc-96f1-4844-afe9-290b93c90fda. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG nova.network.neutron [req-812ffcfb-36da-46e5-acb9-5f365da58724 req-245e3a5f-2351-44e6-8ce3-84cb67b24322 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Updating instance_info_cache with network_info: [{"id": "5b0452fc-96f1-4844-afe9-290b93c90fda", "address": "fa:16:3e:6a:36:8a", "network": {"id": "2e677476-9a97-4e6d-a259-3c1427e62a6e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-607049029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab27e735104a3caad51ab1049677a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0452fc-96", "ovs_interfaceid": "5b0452fc-96f1-4844-afe9-290b93c90fda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:48:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-812ffcfb-36da-46e5-acb9-5f365da58724 req-245e3a5f-2351-44e6-8ce3-84cb67b24322 service nova] Releasing lock "refresh_cache-132b9b0b-9556-4aaf-a9ad-577e18215e84" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:48:01 user nova-compute[72782]: INFO nova.compute.manager [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Took 7.50 seconds to build instance.
Aug 14 19:48:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4904c4a8-be42-4ebb-a894-cade1b57adf3 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.621s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.736s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692042482.2955174, 5d532038-555f-42d3-b35a-9e6f0350b023 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d532038-555f-42d3-b35a-9e6f0350b023 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:48:02 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Successfully detached device vdb from instance 5d532038-555f-42d3-b35a-9e6f0350b023 from the live domain config.
Aug 14 19:48:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyaJRQYL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:48:02 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:48:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0f5c84-e853-4308-9552-69afbc856315]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[803b5377-792c-48af-b244-d7be38ddef30]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:48:02 user nova-compute[72782]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 (non-flash)
Aug 14 19:48:02 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:48:02 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:48:02 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:48:02 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:48:02 user nova-compute[72782]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 (non-flash)
Aug 14 19:48:02 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:48:02 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:48:02 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:48:02 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e865a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85'): ({'sdh'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Removing single pathed devices sdh {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fad4fcf-0626-44eb-b6e3-e1df282365d4]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7cab1c-be21-4fb8-b47a-7760e5411ccc]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Flushing IO for device /dev/sdh {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caddcb4-8ec0-4a63-b0ec-d9e8754fa0f6]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b92f89-e989-4863-beec-a28b52189365]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] SCSI volumes sdh have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e638591e-2547-4d2e-a5d9-a7652a26b27f]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6c2c60-74fb-45e4-9ddf-fb48dd1e8c25]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85, portal: 172.16.0.220,3260]
Aug 14 19:48:02 user nova-compute[72782]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85, portal: 172.16.0.220,3260] successful.
Aug 14 19:48:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b15ecee-7780-4324-a64d-7486d96fcb85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e5f492-5010-4ba3-9c15-155a98efba61]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] <== disconnect_volume: return (345ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:48:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:48:05 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042470.0395827, 03fc42b1-f33d-4930-ba65-22540584b7fe => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:48:05 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] VM Stopped (Lifecycle Event)
Aug 14 19:48:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6ff64d72-1ec2-49d4-bc7b-76d9b4a3b543 None None] [instance: 03fc42b1-f33d-4930-ba65-22540584b7fe] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:48:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Acquiring lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Acquiring lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:06 user nova-compute[72782]: INFO nova.compute.manager [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Terminating instance
Aug 14 19:48:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:48:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:06 user nova-compute[72782]: DEBUG nova.objects.instance [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lazy-loading 'flavor' on Instance uuid 5d532038-555f-42d3-b35a-9e6f0350b023 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c199855-2c83-441b-ab82-1f32096e9e7c tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "5d532038-555f-42d3-b35a-9e6f0350b023" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.627s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.compute.manager [req-734335b3-0d09-4015-9526-61eba08291c7 req-a57cc654-6880-406b-a47f-4baeb1069aae service nova] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Received event network-vif-unplugged-3efffdad-bcfc-4f5d-8d72-75656b5cba62 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-734335b3-0d09-4015-9526-61eba08291c7 req-a57cc654-6880-406b-a47f-4baeb1069aae service nova] Acquiring lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-734335b3-0d09-4015-9526-61eba08291c7 req-a57cc654-6880-406b-a47f-4baeb1069aae service nova] Lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-734335b3-0d09-4015-9526-61eba08291c7 req-a57cc654-6880-406b-a47f-4baeb1069aae service nova] Lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.compute.manager [req-734335b3-0d09-4015-9526-61eba08291c7 req-a57cc654-6880-406b-a47f-4baeb1069aae service nova] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] No waiting events found dispatching network-vif-unplugged-3efffdad-bcfc-4f5d-8d72-75656b5cba62 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.compute.manager [req-734335b3-0d09-4015-9526-61eba08291c7 req-a57cc654-6880-406b-a47f-4baeb1069aae service nova] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Received event network-vif-unplugged-3efffdad-bcfc-4f5d-8d72-75656b5cba62 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "interface-5d532038-555f-42d3-b35a-9e6f0350b023-cf430810-9ec0-4b97-a972-710a70074785" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "interface-5d532038-555f-42d3-b35a-9e6f0350b023-cf430810-9ec0-4b97-a972-710a70074785" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.objects.instance [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lazy-loading 'flavor' on Instance uuid 5d532038-555f-42d3-b35a-9e6f0350b023 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205293026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205293026',id=5,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBUAZVMa4gIP2YmvcmOx5iou8wFV659Y2z9FXeRWhphzcOnzkYKBYpe1JczET+ExPwbJu9nwpHcQhAkzlPTFrALtNgdc28pKtERMGb/9tfusWIUd9XgIsvq2vJiC3QUAw==',key_name='tempest-keypair-190172691',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:45:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4de6c5ad7cf54432b6e2704cd3c0201c',ramdisk_id='',reservation_id='r-py4qploq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2072296078',owner_user_name='tempest-TaggedAttachmentsTest-2072296078-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5283c6441c04ba497e3c89403bb2d87',uuid=5d532038-555f-42d3-b35a-9e6f0350b023,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf430810-9ec0-4b97-a972-710a70074785", "address": "fa:16:3e:af:61:8e", "network": {"id": "9304f63a-1168-4ba5-be3b-ad1dc3af0b54", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1958522820", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf430810-9e", "ovs_interfaceid": "cf430810-9ec0-4b97-a972-710a70074785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Converting VIF {"id": "cf430810-9ec0-4b97-a972-710a70074785", "address": "fa:16:3e:af:61:8e", "network": {"id": "9304f63a-1168-4ba5-be3b-ad1dc3af0b54", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1958522820", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf430810-9e", "ovs_interfaceid": "cf430810-9ec0-4b97-a972-710a70074785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=cf430810-9ec0-4b97-a972-710a70074785,network=Network(9304f63a-1168-4ba5-be3b-ad1dc3af0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf430810-9e') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:af:61:8e"/><model type="virtio"/><mtu size="1442"/><target dev="tapcf430810-9e"/></interface> {{(pid=72782) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:af:61:8e"/><model type="virtio"/><mtu size="1442"/><target dev="tapcf430810-9e"/></interface> {{(pid=72782) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Attempting to detach device tapcf430810-9e from instance 5d532038-555f-42d3-b35a-9e6f0350b023 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] detach device xml: <interface type="ethernet">
Aug 14 19:48:07 user nova-compute[72782]:   <mac address="fa:16:3e:af:61:8e"/>
Aug 14 19:48:07 user nova-compute[72782]:   <model type="virtio"/>
Aug 14 19:48:07 user nova-compute[72782]:   <mtu size="1442"/>
Aug 14 19:48:07 user nova-compute[72782]:   <target dev="tapcf430810-9e"/>
Aug 14 19:48:07 user nova-compute[72782]: </interface>
Aug 14 19:48:07 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:af:61:8e"/><model type="virtio"/><mtu size="1442"/><target dev="tapcf430810-9e"/></interface> {{(pid=72782) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:af:61:8e"/><model type="virtio"/><mtu size="1442"/><target dev="tapcf430810-9e"/></interface>not found in domain: <domain type='kvm' id='5'>
Aug 14 19:48:07 user nova-compute[72782]:   <name>instance-00000005</name>
Aug 14 19:48:07 user nova-compute[72782]:   <uuid>5d532038-555f-42d3-b35a-9e6f0350b023</uuid>
Aug 14 19:48:07 user nova-compute[72782]:   <metadata>
Aug 14 19:48:07 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:48:07 user nova-compute[72782]:   <nova:package version="0.0.0"/>
Aug 14 19:48:07 user nova-compute[72782]:   <nova:name>tempest-device-tagging-server-205293026</nova:name>
Aug 14 19:48:07 user nova-compute[72782]:   <nova:creationTime>2023-08-14 19:47:20</nova:creationTime>
Aug 14 19:48:07 user nova-compute[72782]:   <nova:flavor name="m1.tiny">
Aug 14 19:48:07 user nova-compute[72782]:     <nova:memory>512</nova:memory>
Aug 14 19:48:07 user nova-compute[72782]:     <nova:disk>1</nova:disk>
Aug 14 19:48:07 user nova-compute[72782]:     <nova:swap>0</nova:swap>
Aug 14 19:48:07 user nova-compute[72782]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:48:07 user nova-compute[72782]:     <nova:vcpus>1</nova:vcpus>
Aug 14 19:48:07 user nova-compute[72782]:   </nova:flavor>
Aug 14 19:48:07 user nova-compute[72782]:   <nova:owner>
Aug 14 19:48:07 user nova-compute[72782]:     <nova:user uuid="c5283c6441c04ba497e3c89403bb2d87">tempest-TaggedAttachmentsTest-2072296078-project-member</nova:user>
Aug 14 19:48:07 user nova-compute[72782]:     <nova:project uuid="4de6c5ad7cf54432b6e2704cd3c0201c">tempest-TaggedAttachmentsTest-2072296078</nova:project>
Aug 14 19:48:07 user nova-compute[72782]:   </nova:owner>
Aug 14 19:48:07 user nova-compute[72782]:   <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:48:07 user nova-compute[72782]:   <nova:ports>
Aug 14 19:48:07 user nova-compute[72782]:     <nova:port uuid="1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e">
Aug 14 19:48:07 user nova-compute[72782]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 19:48:07 user nova-compute[72782]:     </nova:port>
Aug 14 19:48:07 user nova-compute[72782]:     <nova:port uuid="cf430810-9ec0-4b97-a972-710a70074785">
Aug 14 19:48:07 user nova-compute[72782]:       <nova:ip type="fixed" address="10.10.10.253" ipVersion="4"/>
Aug 14 19:48:07 user nova-compute[72782]:     </nova:port>
Aug 14 19:48:07 user nova-compute[72782]:   </nova:ports>
Aug 14 19:48:07 user nova-compute[72782]: </nova:instance>
Aug 14 19:48:07 user nova-compute[72782]:   </metadata>
Aug 14 19:48:07 user nova-compute[72782]:   <memory unit='KiB'>524288</memory>
Aug 14 19:48:07 user nova-compute[72782]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 19:48:07 user nova-compute[72782]:   <vcpu placement='static'>1</vcpu>
Aug 14 19:48:07 user nova-compute[72782]:   <resource>
Aug 14 19:48:07 user nova-compute[72782]:     <partition>/machine</partition>
Aug 14 19:48:07 user nova-compute[72782]:   </resource>
Aug 14 19:48:07 user nova-compute[72782]:   <sysinfo type='smbios'>
Aug 14 19:48:07 user nova-compute[72782]:     <system>
Aug 14 19:48:07 user nova-compute[72782]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 19:48:07 user nova-compute[72782]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 19:48:07 user nova-compute[72782]:       <entry name='version'>0.0.0</entry>
Aug 14 19:48:07 user nova-compute[72782]:       <entry name='serial'>5d532038-555f-42d3-b35a-9e6f0350b023</entry>
Aug 14 19:48:07 user nova-compute[72782]:       <entry name='uuid'>5d532038-555f-42d3-b35a-9e6f0350b023</entry>
Aug 14 19:48:07 user nova-compute[72782]:       <entry name='family'>Virtual Machine</entry>
Aug 14 19:48:07 user nova-compute[72782]:     </system>
Aug 14 19:48:07 user nova-compute[72782]:   </sysinfo>
Aug 14 19:48:07 user nova-compute[72782]:   <os>
Aug 14 19:48:07 user nova-compute[72782]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 19:48:07 user nova-compute[72782]:     <boot dev='hd'/>
Aug 14 19:48:07 user nova-compute[72782]:     <smbios mode='sysinfo'/>
Aug 14 19:48:07 user nova-compute[72782]:   </os>
Aug 14 19:48:07 user nova-compute[72782]:   <features>
Aug 14 19:48:07 user nova-compute[72782]:     <acpi/>
Aug 14 19:48:07 user nova-compute[72782]:     <apic/>
Aug 14 19:48:07 user nova-compute[72782]:     <vmcoreinfo state='on'/>
Aug 14 19:48:07 user nova-compute[72782]:   </features>
Aug 14 19:48:07 user nova-compute[72782]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 19:48:07 user nova-compute[72782]:     <model fallback='forbid'>Nehalem</model>
Aug 14 19:48:07 user nova-compute[72782]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 19:48:07 user nova-compute[72782]:     <feature policy='require' name='vme'/>
Aug 14 19:48:07 user nova-compute[72782]:     <feature policy='require' name='x2apic'/>
Aug 14 19:48:07 user nova-compute[72782]:     <feature policy='require' name='hypervisor'/>
Aug 14 19:48:07 user nova-compute[72782]:   </cpu>
Aug 14 19:48:07 user nova-compute[72782]:   <clock offset='utc'>
Aug 14 19:48:07 user nova-compute[72782]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 19:48:07 user nova-compute[72782]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 19:48:07 user nova-compute[72782]:     <timer name='hpet' present='no'/>
Aug 14 19:48:07 user nova-compute[72782]:   </clock>
Aug 14 19:48:07 user nova-compute[72782]:   <on_poweroff>destroy</on_poweroff>
Aug 14 19:48:07 user nova-compute[72782]:   <on_reboot>restart</on_reboot>
Aug 14 19:48:07 user nova-compute[72782]:   <on_crash>destroy</on_crash>
Aug 14 19:48:07 user nova-compute[72782]:   <devices>
Aug 14 19:48:07 user nova-compute[72782]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 19:48:07 user nova-compute[72782]:     <disk type='file' device='disk'>
Aug 14 19:48:07 user nova-compute[72782]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 19:48:07 user nova-compute[72782]:       <source file='/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk' index='2'/>
Aug 14 19:48:07 user nova-compute[72782]:       <backingStore type='file' index='3'>
Aug 14 19:48:07 user nova-compute[72782]:         <format type='raw'/>
Aug 14 19:48:07 user nova-compute[72782]:         <source file='/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7'/>
Aug 14 19:48:07 user nova-compute[72782]:         <backingStore/>
Aug 14 19:48:07 user nova-compute[72782]:       </backingStore>
Aug 14 19:48:07 user nova-compute[72782]:       <target dev='vda' bus='virtio'/>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='virtio-disk0'/>
Aug 14 19:48:07 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </disk>
Aug 14 19:48:07 user nova-compute[72782]:     <disk type='file' device='cdrom'>
Aug 14 19:48:07 user nova-compute[72782]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 19:48:07 user nova-compute[72782]:       <source file='/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk.config' index='1'/>
Aug 14 19:48:07 user nova-compute[72782]:       <backingStore/>
Aug 14 19:48:07 user nova-compute[72782]:       <target dev='hda' bus='ide'/>
Aug 14 19:48:07 user nova-compute[72782]:       <readonly/>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='ide0-0-0'/>
Aug 14 19:48:07 user nova-compute[72782]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </disk>
Aug 14 19:48:07 user nova-compute[72782]:     <controller type='usb' index='0' model='none'>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='usb'/>
Aug 14 19:48:07 user nova-compute[72782]:     </controller>
Aug 14 19:48:07 user nova-compute[72782]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='pci.0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </controller>
Aug 14 19:48:07 user nova-compute[72782]:     <controller type='ide' index='0'>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='ide'/>
Aug 14 19:48:07 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 19:48:07 user nova-compute[72782]:     </controller>
Aug 14 19:48:07 user nova-compute[72782]:     <interface type='ethernet'>
Aug 14 19:48:07 user nova-compute[72782]:       <mac address='fa:16:3e:0c:34:c8'/>
Aug 14 19:48:07 user nova-compute[72782]:       <target dev='tap1ec76c6a-a5'/>
Aug 14 19:48:07 user nova-compute[72782]:       <model type='virtio'/>
Aug 14 19:48:07 user nova-compute[72782]:       <mtu size='1442'/>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='net0'/>
Aug 14 19:48:07 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </interface>
Aug 14 19:48:07 user nova-compute[72782]:     <interface type='ethernet'>
Aug 14 19:48:07 user nova-compute[72782]:       <mac address='fa:16:3e:af:61:8e'/>
Aug 14 19:48:07 user nova-compute[72782]:       <target dev='tapcf430810-9e'/>
Aug 14 19:48:07 user nova-compute[72782]:       <model type='virtio'/>
Aug 14 19:48:07 user nova-compute[72782]:       <mtu size='1442'/>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='net1'/>
Aug 14 19:48:07 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </interface>
Aug 14 19:48:07 user nova-compute[72782]:     <serial type='pty'>
Aug 14 19:48:07 user nova-compute[72782]:       <source path='/dev/pts/4'/>
Aug 14 19:48:07 user nova-compute[72782]:       <log file='/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/console.log' append='off'/>
Aug 14 19:48:07 user nova-compute[72782]:       <target type='isa-serial' port='0'>
Aug 14 19:48:07 user nova-compute[72782]:         <model name='isa-serial'/>
Aug 14 19:48:07 user nova-compute[72782]:       </target>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='serial0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </serial>
Aug 14 19:48:07 user nova-compute[72782]:     <console type='pty' tty='/dev/pts/4'>
Aug 14 19:48:07 user nova-compute[72782]:       <source path='/dev/pts/4'/>
Aug 14 19:48:07 user nova-compute[72782]:       <log file='/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/console.log' append='off'/>
Aug 14 19:48:07 user nova-compute[72782]:       <target type='serial' port='0'/>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='serial0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </console>
Aug 14 19:48:07 user nova-compute[72782]:     <input type='mouse' bus='ps2'>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='input0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </input>
Aug 14 19:48:07 user nova-compute[72782]:     <input type='keyboard' bus='ps2'>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='input1'/>
Aug 14 19:48:07 user nova-compute[72782]:     </input>
Aug 14 19:48:07 user nova-compute[72782]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Aug 14 19:48:07 user nova-compute[72782]:       <listen type='address' address='0.0.0.0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </graphics>
Aug 14 19:48:07 user nova-compute[72782]:     <audio id='1' type='none'/>
Aug 14 19:48:07 user nova-compute[72782]:     <video>
Aug 14 19:48:07 user nova-compute[72782]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='video0'/>
Aug 14 19:48:07 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </video>
Aug 14 19:48:07 user nova-compute[72782]:     <memballoon model='virtio'>
Aug 14 19:48:07 user nova-compute[72782]:       <stats period='10'/>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='balloon0'/>
Aug 14 19:48:07 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </memballoon>
Aug 14 19:48:07 user nova-compute[72782]:     <rng model='virtio'>
Aug 14 19:48:07 user nova-compute[72782]:       <backend model='random'>/dev/urandom</backend>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='rng0'/>
Aug 14 19:48:07 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </rng>
Aug 14 19:48:07 user nova-compute[72782]:   </devices>
Aug 14 19:48:07 user nova-compute[72782]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 19:48:07 user nova-compute[72782]:     <label>libvirt-5d532038-555f-42d3-b35a-9e6f0350b023</label>
Aug 14 19:48:07 user nova-compute[72782]:     <imagelabel>libvirt-5d532038-555f-42d3-b35a-9e6f0350b023</imagelabel>
Aug 14 19:48:07 user nova-compute[72782]:   </seclabel>
Aug 14 19:48:07 user nova-compute[72782]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 19:48:07 user nova-compute[72782]:     <label>+64055:+108</label>
Aug 14 19:48:07 user nova-compute[72782]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 19:48:07 user nova-compute[72782]:   </seclabel>
Aug 14 19:48:07 user nova-compute[72782]: </domain>
Aug 14 19:48:07 user nova-compute[72782]:  {{(pid=72782) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 19:48:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Successfully detached device tapcf430810-9e from instance 5d532038-555f-42d3-b35a-9e6f0350b023 from the persistent domain config.
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] (1/8): Attempting to detach device tapcf430810-9e with device alias net1 from instance 5d532038-555f-42d3-b35a-9e6f0350b023 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] detach device xml: <interface type="ethernet">
Aug 14 19:48:07 user nova-compute[72782]:   <mac address="fa:16:3e:af:61:8e"/>
Aug 14 19:48:07 user nova-compute[72782]:   <model type="virtio"/>
Aug 14 19:48:07 user nova-compute[72782]:   <mtu size="1442"/>
Aug 14 19:48:07 user nova-compute[72782]:   <target dev="tapcf430810-9e"/>
Aug 14 19:48:07 user nova-compute[72782]: </interface>
Aug 14 19:48:07 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:48:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Instance destroyed successfully.
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.objects.instance [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lazy-loading 'resources' on Instance uuid ea26c664-91cb-4824-a66b-c8fe216c6ba4 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:45:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-824226313',display_name='tempest-VolumesActionsTest-instance-824226313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-824226313',id=8,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:45:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6a39356dc3b40e68fc1f8c2adfe31bd',ramdisk_id='',reservation_id='r-lziyfzsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-252225685',owner_user_name='tempest-VolumesActionsTest-252225685-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:45:53Z,user_data=None,user_id='309d1190683d42d5b09677deeaa0b03e',uuid=ea26c664-91cb-4824-a66b-c8fe216c6ba4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "address": "fa:16:3e:10:bd:b5", "network": {"id": "d2e9bc7d-c0d9-410d-9f21-3f617955f28d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1874761389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a39356dc3b40e68fc1f8c2adfe31bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efffdad-bc", "ovs_interfaceid": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Converting VIF {"id": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "address": "fa:16:3e:10:bd:b5", "network": {"id": "d2e9bc7d-c0d9-410d-9f21-3f617955f28d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1874761389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a39356dc3b40e68fc1f8c2adfe31bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efffdad-bc", "ovs_interfaceid": "3efffdad-bcfc-4f5d-8d72-75656b5cba62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:bd:b5,bridge_name='br-int',has_traffic_filtering=True,id=3efffdad-bcfc-4f5d-8d72-75656b5cba62,network=Network(d2e9bc7d-c0d9-410d-9f21-3f617955f28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efffdad-bc') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG os_vif [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:bd:b5,bridge_name='br-int',has_traffic_filtering=True,id=3efffdad-bcfc-4f5d-8d72-75656b5cba62,network=Network(d2e9bc7d-c0d9-410d-9f21-3f617955f28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efffdad-bc') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3efffdad-bc, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:48:07 user nova-compute[72782]: INFO os_vif [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:bd:b5,bridge_name='br-int',has_traffic_filtering=True,id=3efffdad-bcfc-4f5d-8d72-75656b5cba62,network=Network(d2e9bc7d-c0d9-410d-9f21-3f617955f28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efffdad-bc')
Aug 14 19:48:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Deleting instance files /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4_del
Aug 14 19:48:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Deletion of /opt/stack/data/nova/instances/ea26c664-91cb-4824-a66b-c8fe216c6ba4_del complete
Aug 14 19:48:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:07 user nova-compute[72782]: INFO nova.compute.manager [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 14 19:48:07 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692042487.938442, 5d532038-555f-42d3-b35a-9e6f0350b023 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Start waiting for the detach event from libvirt for device tapcf430810-9e with device alias net1 for instance 5d532038-555f-42d3-b35a-9e6f0350b023 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:af:61:8e"/><model type="virtio"/><mtu size="1442"/><target dev="tapcf430810-9e"/></interface> {{(pid=72782) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:af:61:8e"/><model type="virtio"/><mtu size="1442"/><target dev="tapcf430810-9e"/></interface>not found in domain: <domain type='kvm' id='5'>
Aug 14 19:48:07 user nova-compute[72782]:   <name>instance-00000005</name>
Aug 14 19:48:07 user nova-compute[72782]:   <uuid>5d532038-555f-42d3-b35a-9e6f0350b023</uuid>
Aug 14 19:48:07 user nova-compute[72782]:   <metadata>
Aug 14 19:48:07 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:48:07 user nova-compute[72782]:   <nova:package version="0.0.0"/>
Aug 14 19:48:07 user nova-compute[72782]:   <nova:name>tempest-device-tagging-server-205293026</nova:name>
Aug 14 19:48:07 user nova-compute[72782]:   <nova:creationTime>2023-08-14 19:47:20</nova:creationTime>
Aug 14 19:48:07 user nova-compute[72782]:   <nova:flavor name="m1.tiny">
Aug 14 19:48:07 user nova-compute[72782]:     <nova:memory>512</nova:memory>
Aug 14 19:48:07 user nova-compute[72782]:     <nova:disk>1</nova:disk>
Aug 14 19:48:07 user nova-compute[72782]:     <nova:swap>0</nova:swap>
Aug 14 19:48:07 user nova-compute[72782]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:48:07 user nova-compute[72782]:     <nova:vcpus>1</nova:vcpus>
Aug 14 19:48:07 user nova-compute[72782]:   </nova:flavor>
Aug 14 19:48:07 user nova-compute[72782]:   <nova:owner>
Aug 14 19:48:07 user nova-compute[72782]:     <nova:user uuid="c5283c6441c04ba497e3c89403bb2d87">tempest-TaggedAttachmentsTest-2072296078-project-member</nova:user>
Aug 14 19:48:07 user nova-compute[72782]:     <nova:project uuid="4de6c5ad7cf54432b6e2704cd3c0201c">tempest-TaggedAttachmentsTest-2072296078</nova:project>
Aug 14 19:48:07 user nova-compute[72782]:   </nova:owner>
Aug 14 19:48:07 user nova-compute[72782]:   <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:48:07 user nova-compute[72782]:   <nova:ports>
Aug 14 19:48:07 user nova-compute[72782]:     <nova:port uuid="1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e">
Aug 14 19:48:07 user nova-compute[72782]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 19:48:07 user nova-compute[72782]:     </nova:port>
Aug 14 19:48:07 user nova-compute[72782]:     <nova:port uuid="cf430810-9ec0-4b97-a972-710a70074785">
Aug 14 19:48:07 user nova-compute[72782]:       <nova:ip type="fixed" address="10.10.10.253" ipVersion="4"/>
Aug 14 19:48:07 user nova-compute[72782]:     </nova:port>
Aug 14 19:48:07 user nova-compute[72782]:   </nova:ports>
Aug 14 19:48:07 user nova-compute[72782]: </nova:instance>
Aug 14 19:48:07 user nova-compute[72782]:   </metadata>
Aug 14 19:48:07 user nova-compute[72782]:   <memory unit='KiB'>524288</memory>
Aug 14 19:48:07 user nova-compute[72782]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 19:48:07 user nova-compute[72782]:   <vcpu placement='static'>1</vcpu>
Aug 14 19:48:07 user nova-compute[72782]:   <resource>
Aug 14 19:48:07 user nova-compute[72782]:     <partition>/machine</partition>
Aug 14 19:48:07 user nova-compute[72782]:   </resource>
Aug 14 19:48:07 user nova-compute[72782]:   <sysinfo type='smbios'>
Aug 14 19:48:07 user nova-compute[72782]:     <system>
Aug 14 19:48:07 user nova-compute[72782]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 19:48:07 user nova-compute[72782]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 19:48:07 user nova-compute[72782]:       <entry name='version'>0.0.0</entry>
Aug 14 19:48:07 user nova-compute[72782]:       <entry name='serial'>5d532038-555f-42d3-b35a-9e6f0350b023</entry>
Aug 14 19:48:07 user nova-compute[72782]:       <entry name='uuid'>5d532038-555f-42d3-b35a-9e6f0350b023</entry>
Aug 14 19:48:07 user nova-compute[72782]:       <entry name='family'>Virtual Machine</entry>
Aug 14 19:48:07 user nova-compute[72782]:     </system>
Aug 14 19:48:07 user nova-compute[72782]:   </sysinfo>
Aug 14 19:48:07 user nova-compute[72782]:   <os>
Aug 14 19:48:07 user nova-compute[72782]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 19:48:07 user nova-compute[72782]:     <boot dev='hd'/>
Aug 14 19:48:07 user nova-compute[72782]:     <smbios mode='sysinfo'/>
Aug 14 19:48:07 user nova-compute[72782]:   </os>
Aug 14 19:48:07 user nova-compute[72782]:   <features>
Aug 14 19:48:07 user nova-compute[72782]:     <acpi/>
Aug 14 19:48:07 user nova-compute[72782]:     <apic/>
Aug 14 19:48:07 user nova-compute[72782]:     <vmcoreinfo state='on'/>
Aug 14 19:48:07 user nova-compute[72782]:   </features>
Aug 14 19:48:07 user nova-compute[72782]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 19:48:07 user nova-compute[72782]:     <model fallback='forbid'>Nehalem</model>
Aug 14 19:48:07 user nova-compute[72782]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 19:48:07 user nova-compute[72782]:     <feature policy='require' name='vme'/>
Aug 14 19:48:07 user nova-compute[72782]:     <feature policy='require' name='x2apic'/>
Aug 14 19:48:07 user nova-compute[72782]:     <feature policy='require' name='hypervisor'/>
Aug 14 19:48:07 user nova-compute[72782]:   </cpu>
Aug 14 19:48:07 user nova-compute[72782]:   <clock offset='utc'>
Aug 14 19:48:07 user nova-compute[72782]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 19:48:07 user nova-compute[72782]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 19:48:07 user nova-compute[72782]:     <timer name='hpet' present='no'/>
Aug 14 19:48:07 user nova-compute[72782]:   </clock>
Aug 14 19:48:07 user nova-compute[72782]:   <on_poweroff>destroy</on_poweroff>
Aug 14 19:48:07 user nova-compute[72782]:   <on_reboot>restart</on_reboot>
Aug 14 19:48:07 user nova-compute[72782]:   <on_crash>destroy</on_crash>
Aug 14 19:48:07 user nova-compute[72782]:   <devices>
Aug 14 19:48:07 user nova-compute[72782]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 19:48:07 user nova-compute[72782]:     <disk type='file' device='disk'>
Aug 14 19:48:07 user nova-compute[72782]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 19:48:07 user nova-compute[72782]:       <source file='/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk' index='2'/>
Aug 14 19:48:07 user nova-compute[72782]:       <backingStore type='file' index='3'>
Aug 14 19:48:07 user nova-compute[72782]:         <format type='raw'/>
Aug 14 19:48:07 user nova-compute[72782]:         <source file='/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7'/>
Aug 14 19:48:07 user nova-compute[72782]:         <backingStore/>
Aug 14 19:48:07 user nova-compute[72782]:       </backingStore>
Aug 14 19:48:07 user nova-compute[72782]:       <target dev='vda' bus='virtio'/>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='virtio-disk0'/>
Aug 14 19:48:07 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </disk>
Aug 14 19:48:07 user nova-compute[72782]:     <disk type='file' device='cdrom'>
Aug 14 19:48:07 user nova-compute[72782]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 19:48:07 user nova-compute[72782]:       <source file='/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk.config' index='1'/>
Aug 14 19:48:07 user nova-compute[72782]:       <backingStore/>
Aug 14 19:48:07 user nova-compute[72782]:       <target dev='hda' bus='ide'/>
Aug 14 19:48:07 user nova-compute[72782]:       <readonly/>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='ide0-0-0'/>
Aug 14 19:48:07 user nova-compute[72782]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </disk>
Aug 14 19:48:07 user nova-compute[72782]:     <controller type='usb' index='0' model='none'>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='usb'/>
Aug 14 19:48:07 user nova-compute[72782]:     </controller>
Aug 14 19:48:07 user nova-compute[72782]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='pci.0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </controller>
Aug 14 19:48:07 user nova-compute[72782]:     <controller type='ide' index='0'>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='ide'/>
Aug 14 19:48:07 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 19:48:07 user nova-compute[72782]:     </controller>
Aug 14 19:48:07 user nova-compute[72782]:     <interface type='ethernet'>
Aug 14 19:48:07 user nova-compute[72782]:       <mac address='fa:16:3e:0c:34:c8'/>
Aug 14 19:48:07 user nova-compute[72782]:       <target dev='tap1ec76c6a-a5'/>
Aug 14 19:48:07 user nova-compute[72782]:       <model type='virtio'/>
Aug 14 19:48:07 user nova-compute[72782]:       <mtu size='1442'/>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='net0'/>
Aug 14 19:48:07 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </interface>
Aug 14 19:48:07 user nova-compute[72782]:     <serial type='pty'>
Aug 14 19:48:07 user nova-compute[72782]:       <source path='/dev/pts/4'/>
Aug 14 19:48:07 user nova-compute[72782]:       <log file='/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/console.log' append='off'/>
Aug 14 19:48:07 user nova-compute[72782]:       <target type='isa-serial' port='0'>
Aug 14 19:48:07 user nova-compute[72782]:         <model name='isa-serial'/>
Aug 14 19:48:07 user nova-compute[72782]:       </target>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='serial0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </serial>
Aug 14 19:48:07 user nova-compute[72782]:     <console type='pty' tty='/dev/pts/4'>
Aug 14 19:48:07 user nova-compute[72782]:       <source path='/dev/pts/4'/>
Aug 14 19:48:07 user nova-compute[72782]:       <log file='/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/console.log' append='off'/>
Aug 14 19:48:07 user nova-compute[72782]:       <target type='serial' port='0'/>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='serial0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </console>
Aug 14 19:48:07 user nova-compute[72782]:     <input type='mouse' bus='ps2'>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='input0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </input>
Aug 14 19:48:07 user nova-compute[72782]:     <input type='keyboard' bus='ps2'>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='input1'/>
Aug 14 19:48:07 user nova-compute[72782]:     </input>
Aug 14 19:48:07 user nova-compute[72782]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Aug 14 19:48:07 user nova-compute[72782]:       <listen type='address' address='0.0.0.0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </graphics>
Aug 14 19:48:07 user nova-compute[72782]:     <audio id='1' type='none'/>
Aug 14 19:48:07 user nova-compute[72782]:     <video>
Aug 14 19:48:07 user nova-compute[72782]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='video0'/>
Aug 14 19:48:07 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </video>
Aug 14 19:48:07 user nova-compute[72782]:     <memballoon model='virtio'>
Aug 14 19:48:07 user nova-compute[72782]:       <stats period='10'/>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='balloon0'/>
Aug 14 19:48:07 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </memballoon>
Aug 14 19:48:07 user nova-compute[72782]:     <rng model='virtio'>
Aug 14 19:48:07 user nova-compute[72782]:       <backend model='random'>/dev/urandom</backend>
Aug 14 19:48:07 user nova-compute[72782]:       <alias name='rng0'/>
Aug 14 19:48:07 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 19:48:07 user nova-compute[72782]:     </rng>
Aug 14 19:48:07 user nova-compute[72782]:   </devices>
Aug 14 19:48:07 user nova-compute[72782]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 19:48:07 user nova-compute[72782]:     <label>libvirt-5d532038-555f-42d3-b35a-9e6f0350b023</label>
Aug 14 19:48:07 user nova-compute[72782]:     <imagelabel>libvirt-5d532038-555f-42d3-b35a-9e6f0350b023</imagelabel>
Aug 14 19:48:07 user nova-compute[72782]:   </seclabel>
Aug 14 19:48:07 user nova-compute[72782]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 19:48:07 user nova-compute[72782]:     <label>+64055:+108</label>
Aug 14 19:48:07 user nova-compute[72782]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 19:48:07 user nova-compute[72782]:   </seclabel>
Aug 14 19:48:07 user nova-compute[72782]: </domain>
Aug 14 19:48:07 user nova-compute[72782]:  {{(pid=72782) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 19:48:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Successfully detached device tapcf430810-9e from instance 5d532038-555f-42d3-b35a-9e6f0350b023 from the live domain config.
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205293026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205293026',id=5,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBUAZVMa4gIP2YmvcmOx5iou8wFV659Y2z9FXeRWhphzcOnzkYKBYpe1JczET+ExPwbJu9nwpHcQhAkzlPTFrALtNgdc28pKtERMGb/9tfusWIUd9XgIsvq2vJiC3QUAw==',key_name='tempest-keypair-190172691',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:45:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4de6c5ad7cf54432b6e2704cd3c0201c',ramdisk_id='',reservation_id='r-py4qploq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2072296078',owner_user_name='tempest-TaggedAttachmentsTest-2072296078-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5283c6441c04ba497e3c89403bb2d87',uuid=5d532038-555f-42d3-b35a-9e6f0350b023,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf430810-9ec0-4b97-a972-710a70074785", "address": "fa:16:3e:af:61:8e", "network": {"id": "9304f63a-1168-4ba5-be3b-ad1dc3af0b54", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1958522820", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf430810-9e", "ovs_interfaceid": "cf430810-9ec0-4b97-a972-710a70074785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Converting VIF {"id": "cf430810-9ec0-4b97-a972-710a70074785", "address": "fa:16:3e:af:61:8e", "network": {"id": "9304f63a-1168-4ba5-be3b-ad1dc3af0b54", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1958522820", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf430810-9e", "ovs_interfaceid": "cf430810-9ec0-4b97-a972-710a70074785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=cf430810-9ec0-4b97-a972-710a70074785,network=Network(9304f63a-1168-4ba5-be3b-ad1dc3af0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf430810-9e') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG os_vif [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=cf430810-9ec0-4b97-a972-710a70074785,network=Network(9304f63a-1168-4ba5-be3b-ad1dc3af0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf430810-9e') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf430810-9e, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:48:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:08 user nova-compute[72782]: INFO os_vif [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=cf430810-9ec0-4b97-a972-710a70074785,network=Network(9304f63a-1168-4ba5-be3b-ad1dc3af0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf430810-9e')
Aug 14 19:48:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:48:08 user nova-compute[72782]:   <nova:package version="0.0.0"/>
Aug 14 19:48:08 user nova-compute[72782]:   <nova:name>tempest-device-tagging-server-205293026</nova:name>
Aug 14 19:48:08 user nova-compute[72782]:   <nova:creationTime>2023-08-14 19:48:08</nova:creationTime>
Aug 14 19:48:08 user nova-compute[72782]:   <nova:flavor name="m1.tiny">
Aug 14 19:48:08 user nova-compute[72782]:     <nova:memory>512</nova:memory>
Aug 14 19:48:08 user nova-compute[72782]:     <nova:disk>1</nova:disk>
Aug 14 19:48:08 user nova-compute[72782]:     <nova:swap>0</nova:swap>
Aug 14 19:48:08 user nova-compute[72782]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:48:08 user nova-compute[72782]:     <nova:vcpus>1</nova:vcpus>
Aug 14 19:48:08 user nova-compute[72782]:   </nova:flavor>
Aug 14 19:48:08 user nova-compute[72782]:   <nova:owner>
Aug 14 19:48:08 user nova-compute[72782]:     <nova:user uuid="c5283c6441c04ba497e3c89403bb2d87">tempest-TaggedAttachmentsTest-2072296078-project-member</nova:user>
Aug 14 19:48:08 user nova-compute[72782]:     <nova:project uuid="4de6c5ad7cf54432b6e2704cd3c0201c">tempest-TaggedAttachmentsTest-2072296078</nova:project>
Aug 14 19:48:08 user nova-compute[72782]:   </nova:owner>
Aug 14 19:48:08 user nova-compute[72782]:   <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:48:08 user nova-compute[72782]:   <nova:ports>
Aug 14 19:48:08 user nova-compute[72782]:     <nova:port uuid="1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e">
Aug 14 19:48:08 user nova-compute[72782]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 19:48:08 user nova-compute[72782]:     </nova:port>
Aug 14 19:48:08 user nova-compute[72782]:   </nova:ports>
Aug 14 19:48:08 user nova-compute[72782]: </nova:instance>
Aug 14 19:48:08 user nova-compute[72782]:  {{(pid=72782) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 14 19:48:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-a417fd51-cde3-4f5f-844c-6c68ea16c7e1 req-dbd1b985-ba20-4bfd-94cb-e967a4754198 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received event network-vif-unplugged-cf430810-9ec0-4b97-a972-710a70074785 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a417fd51-cde3-4f5f-844c-6c68ea16c7e1 req-dbd1b985-ba20-4bfd-94cb-e967a4754198 service nova] Acquiring lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a417fd51-cde3-4f5f-844c-6c68ea16c7e1 req-dbd1b985-ba20-4bfd-94cb-e967a4754198 service nova] Lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a417fd51-cde3-4f5f-844c-6c68ea16c7e1 req-dbd1b985-ba20-4bfd-94cb-e967a4754198 service nova] Lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-a417fd51-cde3-4f5f-844c-6c68ea16c7e1 req-dbd1b985-ba20-4bfd-94cb-e967a4754198 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] No waiting events found dispatching network-vif-unplugged-cf430810-9ec0-4b97-a972-710a70074785 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:08 user nova-compute[72782]: WARNING nova.compute.manager [req-a417fd51-cde3-4f5f-844c-6c68ea16c7e1 req-dbd1b985-ba20-4bfd-94cb-e967a4754198 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received unexpected event network-vif-unplugged-cf430810-9ec0-4b97-a972-710a70074785 for instance with vm_state active and task_state None.
Aug 14 19:48:09 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG nova.compute.manager [req-7bf571cf-de8b-4e10-b169-f15da0676887 req-3a06dc6c-4adc-41c7-8fb2-1b9e5e973459 service nova] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Received event network-vif-plugged-3efffdad-bcfc-4f5d-8d72-75656b5cba62 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7bf571cf-de8b-4e10-b169-f15da0676887 req-3a06dc6c-4adc-41c7-8fb2-1b9e5e973459 service nova] Acquiring lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7bf571cf-de8b-4e10-b169-f15da0676887 req-3a06dc6c-4adc-41c7-8fb2-1b9e5e973459 service nova] Lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7bf571cf-de8b-4e10-b169-f15da0676887 req-3a06dc6c-4adc-41c7-8fb2-1b9e5e973459 service nova] Lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG nova.compute.manager [req-7bf571cf-de8b-4e10-b169-f15da0676887 req-3a06dc6c-4adc-41c7-8fb2-1b9e5e973459 service nova] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] No waiting events found dispatching network-vif-plugged-3efffdad-bcfc-4f5d-8d72-75656b5cba62 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:09 user nova-compute[72782]: WARNING nova.compute.manager [req-7bf571cf-de8b-4e10-b169-f15da0676887 req-3a06dc6c-4adc-41c7-8fb2-1b9e5e973459 service nova] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Received unexpected event network-vif-plugged-3efffdad-bcfc-4f5d-8d72-75656b5cba62 for instance with vm_state active and task_state deleting.
Aug 14 19:48:09 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Took 1.21 seconds to deallocate network for instance.
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'plfkVnRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd51b224a-5167-40bf-8d3c-8426b420458c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4896c6c-889e-4372-a34c-43256cbe0dc4', 'serial': 'b4896c6c-889e-4372-a34c-43256cbe0dc4'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnCulVSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'd51b224a-5167-40bf-8d3c-8426b420458c', 'attached_at': '', 'detached_at': '', 'volume_id': 'ddb56ed8-6a67-421d-bb15-f23b6a7cd241', 'serial'} {{(pid=72782) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'plfkVnRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:48:09 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:48:09 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:48:09 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08c0524-d1d9-4354-ac0e-c78b060fa887]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:48:09 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c96e8d7-6aad-432b-8ad8-156432e9d604]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4] added
Aug 14 19:48:09 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[40361f04-c44a-47ce-adc0-e8bb12dda144]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3b84d1-53b0-4ab9-a841-6347bd8ddfb0]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v plfkVnRW {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v plfkVnRW" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc7929f-177b-4a5a-b741-a40e5fb27fda]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'plfkVnRW'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be3db42-85a9-4409-ab7a-cb0ec7829050]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "refresh_cache-5d532038-555f-42d3-b35a-9e6f0350b023" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquired lock "refresh_cache-5d532038-555f-42d3-b35a-9e6f0350b023" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG nova.network.neutron [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d33304-e86c-4d5f-87e3-20668d2d82eb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:48:09 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:48:09 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:48:09 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:48:09 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:09 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:48:09 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:48:09 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:48:09 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:48:09 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:09 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[33596218-6e3b-4cb2-adf0-9da8575616dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4, portal: 172.16.0.220,3260]
Aug 14 19:48:09 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4, portal: 172.16.0.220,3260] successful.
Aug 14 19:48:09 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c9c37a-dfb5-4786-827a-04b5bfea36da]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3132154-c346-436d-8f5c-20e14a361f28]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:48:09 user nova-compute[72782]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)
Aug 14 19:48:09 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:48:09 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:48:09 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:48:09 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:09 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:48:09 user nova-compute[72782]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)
Aug 14 19:48:09 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:48:09 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:48:09 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:48:09 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:09 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.429s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7699866e-cfac-4ef9-924b-2d3a1c83bf2a]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:48:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'plfkVnRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:48:09 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Deleted allocations for instance ea26c664-91cb-4824-a66b-c8fe216c6ba4
Aug 14 19:48:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b4b98e91-155c-4173-b1c2-ea5d3b0a7c13 tempest-VolumesActionsTest-252225685 tempest-VolumesActionsTest-252225685-project-member] Lock "ea26c664-91cb-4824-a66b-c8fe216c6ba4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.297s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received event network-vif-plugged-cf430810-9ec0-4b97-a972-710a70074785 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] Acquiring lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] Lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] Lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] No waiting events found dispatching network-vif-plugged-cf430810-9ec0-4b97-a972-710a70074785 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:10 user nova-compute[72782]: WARNING nova.compute.manager [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received unexpected event network-vif-plugged-cf430810-9ec0-4b97-a972-710a70074785 for instance with vm_state active and task_state None.
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Received event network-vif-deleted-3efffdad-bcfc-4f5d-8d72-75656b5cba62 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received event network-vif-deleted-cf430810-9ec0-4b97-a972-710a70074785 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:10 user nova-compute[72782]: INFO nova.compute.manager [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Neutron deleted interface cf430810-9ec0-4b97-a972-710a70074785; detaching it from the instance and deleting it from the info cache
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.network.neutron [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Updating instance_info_cache with network_info: [{"id": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "address": "fa:16:3e:0c:34:c8", "network": {"id": "6e75566e-5f3a-4d09-97c7-580d9c7c8db1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2064496785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec76c6a-a5", "ovs_interfaceid": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.objects.instance [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] Lazy-loading 'system_metadata' on Instance uuid 5d532038-555f-42d3-b35a-9e6f0350b023 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.objects.instance [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] Lazy-loading 'flavor' on Instance uuid 5d532038-555f-42d3-b35a-9e6f0350b023 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205293026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205293026',id=5,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBUAZVMa4gIP2YmvcmOx5iou8wFV659Y2z9FXeRWhphzcOnzkYKBYpe1JczET+ExPwbJu9nwpHcQhAkzlPTFrALtNgdc28pKtERMGb/9tfusWIUd9XgIsvq2vJiC3QUAw==',key_name='tempest-keypair-190172691',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:45:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4de6c5ad7cf54432b6e2704cd3c0201c',ramdisk_id='',reservation_id='r-py4qploq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2072296078',owner_user_name='tempest-TaggedAttachmentsTest-2072296078-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5283c6441c04ba497e3c89403bb2d87',uuid=5d532038-555f-42d3-b35a-9e6f0350b023,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf430810-9ec0-4b97-a972-710a70074785", "address": "fa:16:3e:af:61:8e", "network": {"id": "9304f63a-1168-4ba5-be3b-ad1dc3af0b54", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1958522820", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf430810-9e", "ovs_interfaceid": "cf430810-9ec0-4b97-a972-710a70074785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.network.os_vif_util [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] Converting VIF {"id": "cf430810-9ec0-4b97-a972-710a70074785", "address": "fa:16:3e:af:61:8e", "network": {"id": "9304f63a-1168-4ba5-be3b-ad1dc3af0b54", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1958522820", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf430810-9e", "ovs_interfaceid": "cf430810-9ec0-4b97-a972-710a70074785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.network.os_vif_util [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=cf430810-9ec0-4b97-a972-710a70074785,network=Network(9304f63a-1168-4ba5-be3b-ad1dc3af0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf430810-9e') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:af:61:8e"/><model type="virtio"/><mtu size="1442"/><target dev="tapcf430810-9e"/></interface> {{(pid=72782) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 19:48:10 user nova-compute[72782]: INFO nova.network.neutron [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Port cf430810-9ec0-4b97-a972-710a70074785 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.network.neutron [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Updating instance_info_cache with network_info: [{"id": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "address": "fa:16:3e:0c:34:c8", "network": {"id": "6e75566e-5f3a-4d09-97c7-580d9c7c8db1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2064496785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec76c6a-a5", "ovs_interfaceid": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:af:61:8e"/><model type="virtio"/><mtu size="1442"/><target dev="tapcf430810-9e"/></interface>not found in domain: <domain type='kvm' id='5'>
Aug 14 19:48:10 user nova-compute[72782]:   <name>instance-00000005</name>
Aug 14 19:48:10 user nova-compute[72782]:   <uuid>5d532038-555f-42d3-b35a-9e6f0350b023</uuid>
Aug 14 19:48:10 user nova-compute[72782]:   <metadata>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:48:10 user nova-compute[72782]:   <nova:package version="0.0.0"/>
Aug 14 19:48:10 user nova-compute[72782]:   <nova:name>tempest-device-tagging-server-205293026</nova:name>
Aug 14 19:48:10 user nova-compute[72782]:   <nova:creationTime>2023-08-14 19:48:08</nova:creationTime>
Aug 14 19:48:10 user nova-compute[72782]:   <nova:flavor name="m1.tiny">
Aug 14 19:48:10 user nova-compute[72782]:     <nova:memory>512</nova:memory>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:disk>1</nova:disk>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:swap>0</nova:swap>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:vcpus>1</nova:vcpus>
Aug 14 19:48:10 user nova-compute[72782]:   </nova:flavor>
Aug 14 19:48:10 user nova-compute[72782]:   <nova:owner>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:user uuid="c5283c6441c04ba497e3c89403bb2d87">tempest-TaggedAttachmentsTest-2072296078-project-member</nova:user>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:project uuid="4de6c5ad7cf54432b6e2704cd3c0201c">tempest-TaggedAttachmentsTest-2072296078</nova:project>
Aug 14 19:48:10 user nova-compute[72782]:   </nova:owner>
Aug 14 19:48:10 user nova-compute[72782]:   <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:48:10 user nova-compute[72782]:   <nova:ports>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:port uuid="1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e">
Aug 14 19:48:10 user nova-compute[72782]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 19:48:10 user nova-compute[72782]:     </nova:port>
Aug 14 19:48:10 user nova-compute[72782]:   </nova:ports>
Aug 14 19:48:10 user nova-compute[72782]: </nova:instance>
Aug 14 19:48:10 user nova-compute[72782]:   </metadata>
Aug 14 19:48:10 user nova-compute[72782]:   <memory unit='KiB'>524288</memory>
Aug 14 19:48:10 user nova-compute[72782]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 19:48:10 user nova-compute[72782]:   <vcpu placement='static'>1</vcpu>
Aug 14 19:48:10 user nova-compute[72782]:   <resource>
Aug 14 19:48:10 user nova-compute[72782]:     <partition>/machine</partition>
Aug 14 19:48:10 user nova-compute[72782]:   </resource>
Aug 14 19:48:10 user nova-compute[72782]:   <sysinfo type='smbios'>
Aug 14 19:48:10 user nova-compute[72782]:     <system>
Aug 14 19:48:10 user nova-compute[72782]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 19:48:10 user nova-compute[72782]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 19:48:10 user nova-compute[72782]:       <entry name='version'>0.0.0</entry>
Aug 14 19:48:10 user nova-compute[72782]:       <entry name='serial'>5d532038-555f-42d3-b35a-9e6f0350b023</entry>
Aug 14 19:48:10 user nova-compute[72782]:       <entry name='uuid'>5d532038-555f-42d3-b35a-9e6f0350b023</entry>
Aug 14 19:48:10 user nova-compute[72782]:       <entry name='family'>Virtual Machine</entry>
Aug 14 19:48:10 user nova-compute[72782]:     </system>
Aug 14 19:48:10 user nova-compute[72782]:   </sysinfo>
Aug 14 19:48:10 user nova-compute[72782]:   <os>
Aug 14 19:48:10 user nova-compute[72782]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 19:48:10 user nova-compute[72782]:     <boot dev='hd'/>
Aug 14 19:48:10 user nova-compute[72782]:     <smbios mode='sysinfo'/>
Aug 14 19:48:10 user nova-compute[72782]:   </os>
Aug 14 19:48:10 user nova-compute[72782]:   <features>
Aug 14 19:48:10 user nova-compute[72782]:     <acpi/>
Aug 14 19:48:10 user nova-compute[72782]:     <apic/>
Aug 14 19:48:10 user nova-compute[72782]:     <vmcoreinfo state='on'/>
Aug 14 19:48:10 user nova-compute[72782]:   </features>
Aug 14 19:48:10 user nova-compute[72782]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 19:48:10 user nova-compute[72782]:     <model fallback='forbid'>Nehalem</model>
Aug 14 19:48:10 user nova-compute[72782]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 19:48:10 user nova-compute[72782]:     <feature policy='require' name='vme'/>
Aug 14 19:48:10 user nova-compute[72782]:     <feature policy='require' name='x2apic'/>
Aug 14 19:48:10 user nova-compute[72782]:     <feature policy='require' name='hypervisor'/>
Aug 14 19:48:10 user nova-compute[72782]:   </cpu>
Aug 14 19:48:10 user nova-compute[72782]:   <clock offset='utc'>
Aug 14 19:48:10 user nova-compute[72782]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 19:48:10 user nova-compute[72782]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 19:48:10 user nova-compute[72782]:     <timer name='hpet' present='no'/>
Aug 14 19:48:10 user nova-compute[72782]:   </clock>
Aug 14 19:48:10 user nova-compute[72782]:   <on_poweroff>destroy</on_poweroff>
Aug 14 19:48:10 user nova-compute[72782]:   <on_reboot>restart</on_reboot>
Aug 14 19:48:10 user nova-compute[72782]:   <on_crash>destroy</on_crash>
Aug 14 19:48:10 user nova-compute[72782]:   <devices>
Aug 14 19:48:10 user nova-compute[72782]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 19:48:10 user nova-compute[72782]:     <disk type='file' device='disk'>
Aug 14 19:48:10 user nova-compute[72782]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 19:48:10 user nova-compute[72782]:       <source file='/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk' index='2'/>
Aug 14 19:48:10 user nova-compute[72782]:       <backingStore type='file' index='3'>
Aug 14 19:48:10 user nova-compute[72782]:         <format type='raw'/>
Aug 14 19:48:10 user nova-compute[72782]:         <source file='/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7'/>
Aug 14 19:48:10 user nova-compute[72782]:         <backingStore/>
Aug 14 19:48:10 user nova-compute[72782]:       </backingStore>
Aug 14 19:48:10 user nova-compute[72782]:       <target dev='vda' bus='virtio'/>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='virtio-disk0'/>
Aug 14 19:48:10 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </disk>
Aug 14 19:48:10 user nova-compute[72782]:     <disk type='file' device='cdrom'>
Aug 14 19:48:10 user nova-compute[72782]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 19:48:10 user nova-compute[72782]:       <source file='/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk.config' index='1'/>
Aug 14 19:48:10 user nova-compute[72782]:       <backingStore/>
Aug 14 19:48:10 user nova-compute[72782]:       <target dev='hda' bus='ide'/>
Aug 14 19:48:10 user nova-compute[72782]:       <readonly/>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='ide0-0-0'/>
Aug 14 19:48:10 user nova-compute[72782]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </disk>
Aug 14 19:48:10 user nova-compute[72782]:     <controller type='usb' index='0' model='none'>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='usb'/>
Aug 14 19:48:10 user nova-compute[72782]:     </controller>
Aug 14 19:48:10 user nova-compute[72782]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='pci.0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </controller>
Aug 14 19:48:10 user nova-compute[72782]:     <controller type='ide' index='0'>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='ide'/>
Aug 14 19:48:10 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 19:48:10 user nova-compute[72782]:     </controller>
Aug 14 19:48:10 user nova-compute[72782]:     <interface type='ethernet'>
Aug 14 19:48:10 user nova-compute[72782]:       <mac address='fa:16:3e:0c:34:c8'/>
Aug 14 19:48:10 user nova-compute[72782]:       <target dev='tap1ec76c6a-a5'/>
Aug 14 19:48:10 user nova-compute[72782]:       <model type='virtio'/>
Aug 14 19:48:10 user nova-compute[72782]:       <mtu size='1442'/>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='net0'/>
Aug 14 19:48:10 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </interface>
Aug 14 19:48:10 user nova-compute[72782]:     <serial type='pty'>
Aug 14 19:48:10 user nova-compute[72782]:       <source path='/dev/pts/4'/>
Aug 14 19:48:10 user nova-compute[72782]:       <log file='/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/console.log' append='off'/>
Aug 14 19:48:10 user nova-compute[72782]:       <target type='isa-serial' port='0'>
Aug 14 19:48:10 user nova-compute[72782]:         <model name='isa-serial'/>
Aug 14 19:48:10 user nova-compute[72782]:       </target>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='serial0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </serial>
Aug 14 19:48:10 user nova-compute[72782]:     <console type='pty' tty='/dev/pts/4'>
Aug 14 19:48:10 user nova-compute[72782]:       <source path='/dev/pts/4'/>
Aug 14 19:48:10 user nova-compute[72782]:       <log file='/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/console.log' append='off'/>
Aug 14 19:48:10 user nova-compute[72782]:       <target type='serial' port='0'/>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='serial0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </console>
Aug 14 19:48:10 user nova-compute[72782]:     <input type='mouse' bus='ps2'>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='input0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </input>
Aug 14 19:48:10 user nova-compute[72782]:     <input type='keyboard' bus='ps2'>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='input1'/>
Aug 14 19:48:10 user nova-compute[72782]:     </input>
Aug 14 19:48:10 user nova-compute[72782]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Aug 14 19:48:10 user nova-compute[72782]:       <listen type='address' address='0.0.0.0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </graphics>
Aug 14 19:48:10 user nova-compute[72782]:     <audio id='1' type='none'/>
Aug 14 19:48:10 user nova-compute[72782]:     <video>
Aug 14 19:48:10 user nova-compute[72782]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='video0'/>
Aug 14 19:48:10 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </video>
Aug 14 19:48:10 user nova-compute[72782]:     <memballoon model='virtio'>
Aug 14 19:48:10 user nova-compute[72782]:       <stats period='10'/>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='balloon0'/>
Aug 14 19:48:10 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </memballoon>
Aug 14 19:48:10 user nova-compute[72782]:     <rng model='virtio'>
Aug 14 19:48:10 user nova-compute[72782]:       <backend model='random'>/dev/urandom</backend>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='rng0'/>
Aug 14 19:48:10 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </rng>
Aug 14 19:48:10 user nova-compute[72782]:   </devices>
Aug 14 19:48:10 user nova-compute[72782]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 19:48:10 user nova-compute[72782]:     <label>libvirt-5d532038-555f-42d3-b35a-9e6f0350b023</label>
Aug 14 19:48:10 user nova-compute[72782]:     <imagelabel>libvirt-5d532038-555f-42d3-b35a-9e6f0350b023</imagelabel>
Aug 14 19:48:10 user nova-compute[72782]:   </seclabel>
Aug 14 19:48:10 user nova-compute[72782]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 19:48:10 user nova-compute[72782]:     <label>+64055:+108</label>
Aug 14 19:48:10 user nova-compute[72782]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 19:48:10 user nova-compute[72782]:   </seclabel>
Aug 14 19:48:10 user nova-compute[72782]: </domain>
Aug 14 19:48:10 user nova-compute[72782]:  {{(pid=72782) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:af:61:8e"/><model type="virtio"/><mtu size="1442"/><target dev="tapcf430810-9e"/></interface> {{(pid=72782) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:af:61:8e"/><model type="virtio"/><mtu size="1442"/><target dev="tapcf430810-9e"/></interface>not found in domain: <domain type='kvm' id='5'>
Aug 14 19:48:10 user nova-compute[72782]:   <name>instance-00000005</name>
Aug 14 19:48:10 user nova-compute[72782]:   <uuid>5d532038-555f-42d3-b35a-9e6f0350b023</uuid>
Aug 14 19:48:10 user nova-compute[72782]:   <metadata>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:48:10 user nova-compute[72782]:   <nova:package version="0.0.0"/>
Aug 14 19:48:10 user nova-compute[72782]:   <nova:name>tempest-device-tagging-server-205293026</nova:name>
Aug 14 19:48:10 user nova-compute[72782]:   <nova:creationTime>2023-08-14 19:48:08</nova:creationTime>
Aug 14 19:48:10 user nova-compute[72782]:   <nova:flavor name="m1.tiny">
Aug 14 19:48:10 user nova-compute[72782]:     <nova:memory>512</nova:memory>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:disk>1</nova:disk>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:swap>0</nova:swap>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:vcpus>1</nova:vcpus>
Aug 14 19:48:10 user nova-compute[72782]:   </nova:flavor>
Aug 14 19:48:10 user nova-compute[72782]:   <nova:owner>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:user uuid="c5283c6441c04ba497e3c89403bb2d87">tempest-TaggedAttachmentsTest-2072296078-project-member</nova:user>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:project uuid="4de6c5ad7cf54432b6e2704cd3c0201c">tempest-TaggedAttachmentsTest-2072296078</nova:project>
Aug 14 19:48:10 user nova-compute[72782]:   </nova:owner>
Aug 14 19:48:10 user nova-compute[72782]:   <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:48:10 user nova-compute[72782]:   <nova:ports>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:port uuid="1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e">
Aug 14 19:48:10 user nova-compute[72782]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 19:48:10 user nova-compute[72782]:     </nova:port>
Aug 14 19:48:10 user nova-compute[72782]:   </nova:ports>
Aug 14 19:48:10 user nova-compute[72782]: </nova:instance>
Aug 14 19:48:10 user nova-compute[72782]:   </metadata>
Aug 14 19:48:10 user nova-compute[72782]:   <memory unit='KiB'>524288</memory>
Aug 14 19:48:10 user nova-compute[72782]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 19:48:10 user nova-compute[72782]:   <vcpu placement='static'>1</vcpu>
Aug 14 19:48:10 user nova-compute[72782]:   <resource>
Aug 14 19:48:10 user nova-compute[72782]:     <partition>/machine</partition>
Aug 14 19:48:10 user nova-compute[72782]:   </resource>
Aug 14 19:48:10 user nova-compute[72782]:   <sysinfo type='smbios'>
Aug 14 19:48:10 user nova-compute[72782]:     <system>
Aug 14 19:48:10 user nova-compute[72782]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 19:48:10 user nova-compute[72782]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 19:48:10 user nova-compute[72782]:       <entry name='version'>0.0.0</entry>
Aug 14 19:48:10 user nova-compute[72782]:       <entry name='serial'>5d532038-555f-42d3-b35a-9e6f0350b023</entry>
Aug 14 19:48:10 user nova-compute[72782]:       <entry name='uuid'>5d532038-555f-42d3-b35a-9e6f0350b023</entry>
Aug 14 19:48:10 user nova-compute[72782]:       <entry name='family'>Virtual Machine</entry>
Aug 14 19:48:10 user nova-compute[72782]:     </system>
Aug 14 19:48:10 user nova-compute[72782]:   </sysinfo>
Aug 14 19:48:10 user nova-compute[72782]:   <os>
Aug 14 19:48:10 user nova-compute[72782]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 19:48:10 user nova-compute[72782]:     <boot dev='hd'/>
Aug 14 19:48:10 user nova-compute[72782]:     <smbios mode='sysinfo'/>
Aug 14 19:48:10 user nova-compute[72782]:   </os>
Aug 14 19:48:10 user nova-compute[72782]:   <features>
Aug 14 19:48:10 user nova-compute[72782]:     <acpi/>
Aug 14 19:48:10 user nova-compute[72782]:     <apic/>
Aug 14 19:48:10 user nova-compute[72782]:     <vmcoreinfo state='on'/>
Aug 14 19:48:10 user nova-compute[72782]:   </features>
Aug 14 19:48:10 user nova-compute[72782]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 19:48:10 user nova-compute[72782]:     <model fallback='forbid'>Nehalem</model>
Aug 14 19:48:10 user nova-compute[72782]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 19:48:10 user nova-compute[72782]:     <feature policy='require' name='vme'/>
Aug 14 19:48:10 user nova-compute[72782]:     <feature policy='require' name='x2apic'/>
Aug 14 19:48:10 user nova-compute[72782]:     <feature policy='require' name='hypervisor'/>
Aug 14 19:48:10 user nova-compute[72782]:   </cpu>
Aug 14 19:48:10 user nova-compute[72782]:   <clock offset='utc'>
Aug 14 19:48:10 user nova-compute[72782]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 19:48:10 user nova-compute[72782]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 19:48:10 user nova-compute[72782]:     <timer name='hpet' present='no'/>
Aug 14 19:48:10 user nova-compute[72782]:   </clock>
Aug 14 19:48:10 user nova-compute[72782]:   <on_poweroff>destroy</on_poweroff>
Aug 14 19:48:10 user nova-compute[72782]:   <on_reboot>restart</on_reboot>
Aug 14 19:48:10 user nova-compute[72782]:   <on_crash>destroy</on_crash>
Aug 14 19:48:10 user nova-compute[72782]:   <devices>
Aug 14 19:48:10 user nova-compute[72782]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 19:48:10 user nova-compute[72782]:     <disk type='file' device='disk'>
Aug 14 19:48:10 user nova-compute[72782]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 19:48:10 user nova-compute[72782]:       <source file='/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk' index='2'/>
Aug 14 19:48:10 user nova-compute[72782]:       <backingStore type='file' index='3'>
Aug 14 19:48:10 user nova-compute[72782]:         <format type='raw'/>
Aug 14 19:48:10 user nova-compute[72782]:         <source file='/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7'/>
Aug 14 19:48:10 user nova-compute[72782]:         <backingStore/>
Aug 14 19:48:10 user nova-compute[72782]:       </backingStore>
Aug 14 19:48:10 user nova-compute[72782]:       <target dev='vda' bus='virtio'/>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='virtio-disk0'/>
Aug 14 19:48:10 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </disk>
Aug 14 19:48:10 user nova-compute[72782]:     <disk type='file' device='cdrom'>
Aug 14 19:48:10 user nova-compute[72782]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 19:48:10 user nova-compute[72782]:       <source file='/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/disk.config' index='1'/>
Aug 14 19:48:10 user nova-compute[72782]:       <backingStore/>
Aug 14 19:48:10 user nova-compute[72782]:       <target dev='hda' bus='ide'/>
Aug 14 19:48:10 user nova-compute[72782]:       <readonly/>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='ide0-0-0'/>
Aug 14 19:48:10 user nova-compute[72782]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </disk>
Aug 14 19:48:10 user nova-compute[72782]:     <controller type='usb' index='0' model='none'>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='usb'/>
Aug 14 19:48:10 user nova-compute[72782]:     </controller>
Aug 14 19:48:10 user nova-compute[72782]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='pci.0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </controller>
Aug 14 19:48:10 user nova-compute[72782]:     <controller type='ide' index='0'>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='ide'/>
Aug 14 19:48:10 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 19:48:10 user nova-compute[72782]:     </controller>
Aug 14 19:48:10 user nova-compute[72782]:     <interface type='ethernet'>
Aug 14 19:48:10 user nova-compute[72782]:       <mac address='fa:16:3e:0c:34:c8'/>
Aug 14 19:48:10 user nova-compute[72782]:       <target dev='tap1ec76c6a-a5'/>
Aug 14 19:48:10 user nova-compute[72782]:       <model type='virtio'/>
Aug 14 19:48:10 user nova-compute[72782]:       <mtu size='1442'/>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='net0'/>
Aug 14 19:48:10 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </interface>
Aug 14 19:48:10 user nova-compute[72782]:     <serial type='pty'>
Aug 14 19:48:10 user nova-compute[72782]:       <source path='/dev/pts/4'/>
Aug 14 19:48:10 user nova-compute[72782]:       <log file='/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/console.log' append='off'/>
Aug 14 19:48:10 user nova-compute[72782]:       <target type='isa-serial' port='0'>
Aug 14 19:48:10 user nova-compute[72782]:         <model name='isa-serial'/>
Aug 14 19:48:10 user nova-compute[72782]:       </target>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='serial0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </serial>
Aug 14 19:48:10 user nova-compute[72782]:     <console type='pty' tty='/dev/pts/4'>
Aug 14 19:48:10 user nova-compute[72782]:       <source path='/dev/pts/4'/>
Aug 14 19:48:10 user nova-compute[72782]:       <log file='/opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023/console.log' append='off'/>
Aug 14 19:48:10 user nova-compute[72782]:       <target type='serial' port='0'/>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='serial0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </console>
Aug 14 19:48:10 user nova-compute[72782]:     <input type='mouse' bus='ps2'>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='input0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </input>
Aug 14 19:48:10 user nova-compute[72782]:     <input type='keyboard' bus='ps2'>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='input1'/>
Aug 14 19:48:10 user nova-compute[72782]:     </input>
Aug 14 19:48:10 user nova-compute[72782]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Aug 14 19:48:10 user nova-compute[72782]:       <listen type='address' address='0.0.0.0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </graphics>
Aug 14 19:48:10 user nova-compute[72782]:     <audio id='1' type='none'/>
Aug 14 19:48:10 user nova-compute[72782]:     <video>
Aug 14 19:48:10 user nova-compute[72782]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='video0'/>
Aug 14 19:48:10 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </video>
Aug 14 19:48:10 user nova-compute[72782]:     <memballoon model='virtio'>
Aug 14 19:48:10 user nova-compute[72782]:       <stats period='10'/>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='balloon0'/>
Aug 14 19:48:10 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </memballoon>
Aug 14 19:48:10 user nova-compute[72782]:     <rng model='virtio'>
Aug 14 19:48:10 user nova-compute[72782]:       <backend model='random'>/dev/urandom</backend>
Aug 14 19:48:10 user nova-compute[72782]:       <alias name='rng0'/>
Aug 14 19:48:10 user nova-compute[72782]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 19:48:10 user nova-compute[72782]:     </rng>
Aug 14 19:48:10 user nova-compute[72782]:   </devices>
Aug 14 19:48:10 user nova-compute[72782]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 19:48:10 user nova-compute[72782]:     <label>libvirt-5d532038-555f-42d3-b35a-9e6f0350b023</label>
Aug 14 19:48:10 user nova-compute[72782]:     <imagelabel>libvirt-5d532038-555f-42d3-b35a-9e6f0350b023</imagelabel>
Aug 14 19:48:10 user nova-compute[72782]:   </seclabel>
Aug 14 19:48:10 user nova-compute[72782]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 19:48:10 user nova-compute[72782]:     <label>+64055:+108</label>
Aug 14 19:48:10 user nova-compute[72782]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 19:48:10 user nova-compute[72782]:   </seclabel>
Aug 14 19:48:10 user nova-compute[72782]: </domain>
Aug 14 19:48:10 user nova-compute[72782]:  {{(pid=72782) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 19:48:10 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Detaching interface fa:16:3e:af:61:8e failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapcf430810-9e' not found.
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205293026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205293026',id=5,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBUAZVMa4gIP2YmvcmOx5iou8wFV659Y2z9FXeRWhphzcOnzkYKBYpe1JczET+ExPwbJu9nwpHcQhAkzlPTFrALtNgdc28pKtERMGb/9tfusWIUd9XgIsvq2vJiC3QUAw==',key_name='tempest-keypair-190172691',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:45:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4de6c5ad7cf54432b6e2704cd3c0201c',ramdisk_id='',reservation_id='r-py4qploq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2072296078',owner_user_name='tempest-TaggedAttachmentsTest-2072296078-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5283c6441c04ba497e3c89403bb2d87',uuid=5d532038-555f-42d3-b35a-9e6f0350b023,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf430810-9ec0-4b97-a972-710a70074785", "address": "fa:16:3e:af:61:8e", "network": {"id": "9304f63a-1168-4ba5-be3b-ad1dc3af0b54", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1958522820", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf430810-9e", "ovs_interfaceid": "cf430810-9ec0-4b97-a972-710a70074785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.network.os_vif_util [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] Converting VIF {"id": "cf430810-9ec0-4b97-a972-710a70074785", "address": "fa:16:3e:af:61:8e", "network": {"id": "9304f63a-1168-4ba5-be3b-ad1dc3af0b54", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1958522820", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf430810-9e", "ovs_interfaceid": "cf430810-9ec0-4b97-a972-710a70074785", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.network.os_vif_util [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=cf430810-9ec0-4b97-a972-710a70074785,network=Network(9304f63a-1168-4ba5-be3b-ad1dc3af0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf430810-9e') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG os_vif [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=cf430810-9ec0-4b97-a972-710a70074785,network=Network(9304f63a-1168-4ba5-be3b-ad1dc3af0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf430810-9e') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf430810-9e, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Releasing lock "refresh_cache-5d532038-555f-42d3-b35a-9e6f0350b023" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:48:10 user nova-compute[72782]: INFO os_vif [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:61:8e,bridge_name='br-int',has_traffic_filtering=True,id=cf430810-9ec0-4b97-a972-710a70074785,network=Network(9304f63a-1168-4ba5-be3b-ad1dc3af0b54),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf430810-9e')
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [req-e66ed8b0-424d-4ff7-8e56-f6fee9d45955 req-8a03859c-2a55-4552-a6ec-629104cbe861 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:48:10 user nova-compute[72782]:   <nova:package version="0.0.0"/>
Aug 14 19:48:10 user nova-compute[72782]:   <nova:name>tempest-device-tagging-server-205293026</nova:name>
Aug 14 19:48:10 user nova-compute[72782]:   <nova:creationTime>2023-08-14 19:48:10</nova:creationTime>
Aug 14 19:48:10 user nova-compute[72782]:   <nova:flavor name="m1.tiny">
Aug 14 19:48:10 user nova-compute[72782]:     <nova:memory>512</nova:memory>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:disk>1</nova:disk>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:swap>0</nova:swap>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:vcpus>1</nova:vcpus>
Aug 14 19:48:10 user nova-compute[72782]:   </nova:flavor>
Aug 14 19:48:10 user nova-compute[72782]:   <nova:owner>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:user uuid="c5283c6441c04ba497e3c89403bb2d87">tempest-TaggedAttachmentsTest-2072296078-project-member</nova:user>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:project uuid="4de6c5ad7cf54432b6e2704cd3c0201c">tempest-TaggedAttachmentsTest-2072296078</nova:project>
Aug 14 19:48:10 user nova-compute[72782]:   </nova:owner>
Aug 14 19:48:10 user nova-compute[72782]:   <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:48:10 user nova-compute[72782]:   <nova:ports>
Aug 14 19:48:10 user nova-compute[72782]:     <nova:port uuid="1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e">
Aug 14 19:48:10 user nova-compute[72782]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 19:48:10 user nova-compute[72782]:     </nova:port>
Aug 14 19:48:10 user nova-compute[72782]:   </nova:ports>
Aug 14 19:48:10 user nova-compute[72782]: </nova:instance>
Aug 14 19:48:10 user nova-compute[72782]:  {{(pid=72782) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-94d3cb86-187e-41a6-8b9c-e08c69072c33 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "interface-5d532038-555f-42d3-b35a-9e6f0350b023-cf430810-9ec0-4b97-a972-710a70074785" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 3.345s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.485s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] <== connect_volume: return (1489ms) {'type': 'block', 'scsi_wwn': '26136313961633334', 'path': '/dev/sdd'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136313961633334', 'path': '/dev/sdd'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:48:10 user nova-compute[72782]: DEBUG nova.objects.instance [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Lazy-loading 'flavor' on Instance uuid d51b224a-5167-40bf-8d3c-8426b420458c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:48:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:48:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] COPY block job progress, current cursor: 163577856 final cursor: 1073741824 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:48:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] COPY block job progress, current cursor: 320864256 final cursor: 1073741824 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:48:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] COPY block job progress, current cursor: 482344960 final cursor: 1073741824 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:48:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:13 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] COPY block job progress, current cursor: 659554304 final cursor: 1073741824 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:48:13 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] COPY block job progress, current cursor: 812646400 final cursor: 1073741824 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:48:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] COPY block job progress, current cursor: 983564288 final cursor: 1073741824 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:48:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnCulVSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:48:15 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:48:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7d44aa-b721-4959-bc90-0793feea2e3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5fe2c9-e32e-476d-9598-7a7aa69692b9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:48:15 user nova-compute[72782]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)
Aug 14 19:48:15 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:48:15 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:48:15 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:48:15 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:48:15 user nova-compute[72782]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)
Aug 14 19:48:15 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:48:15 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:48:15 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:48:15 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f640879bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241'): ({'sdf'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Removing single pathed devices sdf {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2befb787-59ef-4326-a61e-c4b1706fa59b]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c039d0-c776-4bbd-8410-edf3413a5f68]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Flushing IO for device /dev/sdf {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69586e0-aeab-497a-a203-4b60b065b3b2]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3411313b-3e63-4cad-bcdb-208074e73e06]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] SCSI volumes sdf have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2190129-44ff-470b-9450-2206d22da2a2]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[889c21ef-5768-4e81-aaf4-d7ba37bd534c]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241, portal: 172.16.0.220,3260]
Aug 14 19:48:15 user nova-compute[72782]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241, portal: 172.16.0.220,3260] successful.
Aug 14 19:48:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c0b61e-c2aa-4a07-a8e6-72a80094f22e]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] <== disconnect_volume: return (343ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'plfkVnRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'd51b224a-5167-40bf-8d3c-8426b420458c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4896c6c-889e-4372-a34c-43256cbe0dc4', 'serial'} {{(pid=72782) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 14 19:48:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] swap_volume: removing Cinder connection for volume ddb56ed8-6a67-421d-bb15-f23b6a7cd241 {{(pid=72782) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 14 19:48:16 user nova-compute[72782]: DEBUG nova.compute.manager [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] swap_volume: Updating volume ddb56ed8-6a67-421d-bb15-f23b6a7cd241 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "plfkVnRW", "auth_password": "IjtE7SWRw8B1Tm", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "b4896c6c-889e-4372-a34c-43256cbe0dc4"}, "status": "reserved", "instance": "d51b224a-5167-40bf-8d3c-8426b420458c", "attached_at": "", "detached_at": "", "volume_id": "b4896c6c-889e-4372-a34c-43256cbe0dc4", "serial": "b4896c6c-889e-4372-a34c-43256cbe0dc4"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b4896c6c-889e-4372-a34c-43256cbe0dc4', 'no_device': None, 'attachment_id': '83c01c61-7a69-4e36-b7cd-4254a36289a7'} {{(pid=72782) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 14 19:48:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bee3a1a5-2bdb-43aa-80b2-dde29c2e2620 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Lock "d51b224a-5167-40bf-8d3c-8426b420458c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 22.375s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:48:17 user nova-compute[72782]: INFO nova.compute.claims [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Claim successful on node user
Aug 14 19:48:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:48:17 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:48:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG nova.policy [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a38fa907d804b81903eb97ab88ae181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c0483a97574e7794c73fe43e51795e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:48:17 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Creating image(s)
Aug 14 19:48:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "/opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "/opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "/opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Acquiring lock "d51b224a-5167-40bf-8d3c-8426b420458c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Lock "d51b224a-5167-40bf-8d3c-8426b420458c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG os_brick.utils [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c218dc-07ea-4053-9233-8388ce6911e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4092e15b-c691-476e-836e-9a753dff23d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9abe35-0cf7-4676-83f8-e2c72a11dd7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc8b0e5-456c-4941-a0ee-7db3f356e3b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:48:18 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb04a927-8065-464f-a2e7-9356de679d22]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG os_brick.utils [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk 1073741824" returned: 0 in 0.046s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:18 user nova-compute[72782]: INFO nova.compute.manager [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Swapping volume b4896c6c-889e-4372-a34c-43256cbe0dc4 for ddb56ed8-6a67-421d-bb15-f23b6a7cd241
Aug 14 19:48:18 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Successfully created port: 35b9955c-a82a-42b9-a936-5f3429cda375 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.200s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Cannot resize image /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'migration_context' on Instance uuid 259c51df-ccd6-456e-85f4-7aaf4cba2b69 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Ensure instance console log exists: /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Successfully updated port: 35b9955c-a82a-42b9-a936-5f3429cda375 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquired lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-00810807-bd4e-4db5-822f-867efc0b614e req-527366bb-a8b1-48fa-bb23-1a9a2e012115 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Received event network-changed-35b9955c-a82a-42b9-a936-5f3429cda375 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-00810807-bd4e-4db5-822f-867efc0b614e req-527366bb-a8b1-48fa-bb23-1a9a2e012115 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Refreshing instance network info cache due to event network-changed-35b9955c-a82a-42b9-a936-5f3429cda375. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-00810807-bd4e-4db5-822f-867efc0b614e req-527366bb-a8b1-48fa-bb23-1a9a2e012115 service nova] Acquiring lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Updating instance_info_cache with network_info: [{"id": "35b9955c-a82a-42b9-a936-5f3429cda375", "address": "fa:16:3e:36:7a:36", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b9955c-a8", "ovs_interfaceid": "35b9955c-a82a-42b9-a936-5f3429cda375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Releasing lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Instance network_info: |[{"id": "35b9955c-a82a-42b9-a936-5f3429cda375", "address": "fa:16:3e:36:7a:36", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b9955c-a8", "ovs_interfaceid": "35b9955c-a82a-42b9-a936-5f3429cda375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-00810807-bd4e-4db5-822f-867efc0b614e req-527366bb-a8b1-48fa-bb23-1a9a2e012115 service nova] Acquired lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.network.neutron [req-00810807-bd4e-4db5-822f-867efc0b614e req-527366bb-a8b1-48fa-bb23-1a9a2e012115 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Refreshing network info cache for port 35b9955c-a82a-42b9-a936-5f3429cda375 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Start _get_guest_xml network_info=[{"id": "35b9955c-a82a-42b9-a936-5f3429cda375", "address": "fa:16:3e:36:7a:36", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b9955c-a8", "ovs_interfaceid": "35b9955c-a82a-42b9-a936-5f3429cda375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:48:19 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:48:19 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1612055651',display_name='tempest-ServerActionsTestOtherA-server-1612055651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1612055651',id=13,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjPa06vtlcnEwf9WmNngHo77ZQLE/dqlpBjCZ69lCWox+6yOHeDlaru6JozyQO8VPG/SE5WTpKRBcOS1LznFcAxBQR7z97DyBcD1Q9ZGwfJ2pOvn+iIjcliFOke0KJwkg==',key_name='tempest-keypair-525631678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6c0483a97574e7794c73fe43e51795e',ramdisk_id='',reservation_id='r-kn6i5sg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-956209876',owner_user_name='tempest-ServerActionsTestOtherA-956209876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:48:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a38fa907d804b81903eb97ab88ae181',uuid=259c51df-ccd6-456e-85f4-7aaf4cba2b69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35b9955c-a82a-42b9-a936-5f3429cda375", "address": "fa:16:3e:36:7a:36", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b9955c-a8", "ovs_interfaceid": "35b9955c-a82a-42b9-a936-5f3429cda375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converting VIF {"id": "35b9955c-a82a-42b9-a936-5f3429cda375", "address": "fa:16:3e:36:7a:36", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b9955c-a8", "ovs_interfaceid": "35b9955c-a82a-42b9-a936-5f3429cda375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:7a:36,bridge_name='br-int',has_traffic_filtering=True,id=35b9955c-a82a-42b9-a936-5f3429cda375,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b9955c-a8') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'pci_devices' on Instance uuid 259c51df-ccd6-456e-85f4-7aaf4cba2b69 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:48:19 user nova-compute[72782]:   <uuid>259c51df-ccd6-456e-85f4-7aaf4cba2b69</uuid>
Aug 14 19:48:19 user nova-compute[72782]:   <name>instance-0000000d</name>
Aug 14 19:48:19 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:48:19 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:48:19 user nova-compute[72782]:   <metadata>
Aug 14 19:48:19 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:48:19 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:48:19 user nova-compute[72782]:       <nova:name>tempest-ServerActionsTestOtherA-server-1612055651</nova:name>
Aug 14 19:48:19 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:48:19</nova:creationTime>
Aug 14 19:48:19 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:48:19 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:48:19 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:48:19 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:48:19 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:48:19 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:48:19 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:48:19 user nova-compute[72782]:       <nova:owner>
Aug 14 19:48:19 user nova-compute[72782]:         <nova:user uuid="8a38fa907d804b81903eb97ab88ae181">tempest-ServerActionsTestOtherA-956209876-project-member</nova:user>
Aug 14 19:48:19 user nova-compute[72782]:         <nova:project uuid="b6c0483a97574e7794c73fe43e51795e">tempest-ServerActionsTestOtherA-956209876</nova:project>
Aug 14 19:48:19 user nova-compute[72782]:       </nova:owner>
Aug 14 19:48:19 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:48:19 user nova-compute[72782]:       <nova:ports>
Aug 14 19:48:19 user nova-compute[72782]:         <nova:port uuid="35b9955c-a82a-42b9-a936-5f3429cda375">
Aug 14 19:48:19 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 19:48:19 user nova-compute[72782]:         </nova:port>
Aug 14 19:48:19 user nova-compute[72782]:       </nova:ports>
Aug 14 19:48:19 user nova-compute[72782]:     </nova:instance>
Aug 14 19:48:19 user nova-compute[72782]:   </metadata>
Aug 14 19:48:19 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:48:19 user nova-compute[72782]:     <system>
Aug 14 19:48:19 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:48:19 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:48:19 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:48:19 user nova-compute[72782]:       <entry name="serial">259c51df-ccd6-456e-85f4-7aaf4cba2b69</entry>
Aug 14 19:48:19 user nova-compute[72782]:       <entry name="uuid">259c51df-ccd6-456e-85f4-7aaf4cba2b69</entry>
Aug 14 19:48:19 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:48:19 user nova-compute[72782]:     </system>
Aug 14 19:48:19 user nova-compute[72782]:   </sysinfo>
Aug 14 19:48:19 user nova-compute[72782]:   <os>
Aug 14 19:48:19 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:48:19 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:48:19 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:48:19 user nova-compute[72782]:   </os>
Aug 14 19:48:19 user nova-compute[72782]:   <features>
Aug 14 19:48:19 user nova-compute[72782]:     <acpi/>
Aug 14 19:48:19 user nova-compute[72782]:     <apic/>
Aug 14 19:48:19 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:48:19 user nova-compute[72782]:   </features>
Aug 14 19:48:19 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:48:19 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:48:19 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:48:19 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:48:19 user nova-compute[72782]:   </clock>
Aug 14 19:48:19 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:48:19 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:48:19 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:48:19 user nova-compute[72782]:   </cpu>
Aug 14 19:48:19 user nova-compute[72782]:   <devices>
Aug 14 19:48:19 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:48:19 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:48:19 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk"/>
Aug 14 19:48:19 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:48:19 user nova-compute[72782]:     </disk>
Aug 14 19:48:19 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:48:19 user nova-compute[72782]:       <mac address="fa:16:3e:36:7a:36"/>
Aug 14 19:48:19 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:48:19 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:48:19 user nova-compute[72782]:       <target dev="tap35b9955c-a8"/>
Aug 14 19:48:19 user nova-compute[72782]:     </interface>
Aug 14 19:48:19 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:48:19 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/console.log" append="off"/>
Aug 14 19:48:19 user nova-compute[72782]:     </serial>
Aug 14 19:48:19 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:48:19 user nova-compute[72782]:     <video>
Aug 14 19:48:19 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:48:19 user nova-compute[72782]:     </video>
Aug 14 19:48:19 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:48:19 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:48:19 user nova-compute[72782]:     </rng>
Aug 14 19:48:19 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:48:19 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:48:19 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:48:19 user nova-compute[72782]:     </memballoon>
Aug 14 19:48:19 user nova-compute[72782]:   </devices>
Aug 14 19:48:19 user nova-compute[72782]: </domain>
Aug 14 19:48:19 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1612055651',display_name='tempest-ServerActionsTestOtherA-server-1612055651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1612055651',id=13,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjPa06vtlcnEwf9WmNngHo77ZQLE/dqlpBjCZ69lCWox+6yOHeDlaru6JozyQO8VPG/SE5WTpKRBcOS1LznFcAxBQR7z97DyBcD1Q9ZGwfJ2pOvn+iIjcliFOke0KJwkg==',key_name='tempest-keypair-525631678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6c0483a97574e7794c73fe43e51795e',ramdisk_id='',reservation_id='r-kn6i5sg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-956209876',owner_user_name='tempest-ServerActionsTestOtherA-956209876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:48:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a38fa907d804b81903eb97ab88ae181',uuid=259c51df-ccd6-456e-85f4-7aaf4cba2b69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35b9955c-a82a-42b9-a936-5f3429cda375", "address": "fa:16:3e:36:7a:36", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b9955c-a8", "ovs_interfaceid": "35b9955c-a82a-42b9-a936-5f3429cda375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converting VIF {"id": "35b9955c-a82a-42b9-a936-5f3429cda375", "address": "fa:16:3e:36:7a:36", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b9955c-a8", "ovs_interfaceid": "35b9955c-a82a-42b9-a936-5f3429cda375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:7a:36,bridge_name='br-int',has_traffic_filtering=True,id=35b9955c-a82a-42b9-a936-5f3429cda375,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b9955c-a8') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG os_vif [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:7a:36,bridge_name='br-int',has_traffic_filtering=True,id=35b9955c-a82a-42b9-a936-5f3429cda375,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b9955c-a8') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35b9955c-a8, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap35b9955c-a8, col_values=(('external_ids', {'iface-id': '35b9955c-a82a-42b9-a936-5f3429cda375', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:7a:36', 'vm-uuid': '259c51df-ccd6-456e-85f4-7aaf4cba2b69'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:19 user nova-compute[72782]: INFO os_vif [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:7a:36,bridge_name='br-int',has_traffic_filtering=True,id=35b9955c-a82a-42b9-a936-5f3429cda375,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b9955c-a8')
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:48:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] No VIF found with MAC fa:16:3e:36:7a:36, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:48:20 user nova-compute[72782]: DEBUG nova.network.neutron [req-00810807-bd4e-4db5-822f-867efc0b614e req-527366bb-a8b1-48fa-bb23-1a9a2e012115 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Updated VIF entry in instance network info cache for port 35b9955c-a82a-42b9-a936-5f3429cda375. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:48:20 user nova-compute[72782]: DEBUG nova.network.neutron [req-00810807-bd4e-4db5-822f-867efc0b614e req-527366bb-a8b1-48fa-bb23-1a9a2e012115 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Updating instance_info_cache with network_info: [{"id": "35b9955c-a82a-42b9-a936-5f3429cda375", "address": "fa:16:3e:36:7a:36", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b9955c-a8", "ovs_interfaceid": "35b9955c-a82a-42b9-a936-5f3429cda375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:48:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-00810807-bd4e-4db5-822f-867efc0b614e req-527366bb-a8b1-48fa-bb23-1a9a2e012115 service nova] Releasing lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:48:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-9d264389-ffdc-4233-a3a6-9e21944476fd req-6e42e2ff-bccc-4835-a686-e2a903f509fd service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-changed-7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-9d264389-ffdc-4233-a3a6-9e21944476fd req-6e42e2ff-bccc-4835-a686-e2a903f509fd service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Refreshing instance network info cache due to event network-changed-7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:48:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9d264389-ffdc-4233-a3a6-9e21944476fd req-6e42e2ff-bccc-4835-a686-e2a903f509fd service nova] Acquiring lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:48:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9d264389-ffdc-4233-a3a6-9e21944476fd req-6e42e2ff-bccc-4835-a686-e2a903f509fd service nova] Acquired lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:48:20 user nova-compute[72782]: DEBUG nova.network.neutron [req-9d264389-ffdc-4233-a3a6-9e21944476fd req-6e42e2ff-bccc-4835-a686-e2a903f509fd service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Refreshing network info cache for port 7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:48:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-3cb9934d-9cc1-4c5c-a220-2d89b96af82c req-6d2ea975-5908-4f6c-951b-f11f5618aaaa service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Received event network-vif-plugged-35b9955c-a82a-42b9-a936-5f3429cda375 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3cb9934d-9cc1-4c5c-a220-2d89b96af82c req-6d2ea975-5908-4f6c-951b-f11f5618aaaa service nova] Acquiring lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3cb9934d-9cc1-4c5c-a220-2d89b96af82c req-6d2ea975-5908-4f6c-951b-f11f5618aaaa service nova] Lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3cb9934d-9cc1-4c5c-a220-2d89b96af82c req-6d2ea975-5908-4f6c-951b-f11f5618aaaa service nova] Lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-3cb9934d-9cc1-4c5c-a220-2d89b96af82c req-6d2ea975-5908-4f6c-951b-f11f5618aaaa service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] No waiting events found dispatching network-vif-plugged-35b9955c-a82a-42b9-a936-5f3429cda375 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:21 user nova-compute[72782]: WARNING nova.compute.manager [req-3cb9934d-9cc1-4c5c-a220-2d89b96af82c req-6d2ea975-5908-4f6c-951b-f11f5618aaaa service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Received unexpected event network-vif-plugged-35b9955c-a82a-42b9-a936-5f3429cda375 for instance with vm_state building and task_state spawning.
Aug 14 19:48:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:21 user nova-compute[72782]: DEBUG nova.network.neutron [req-9d264389-ffdc-4233-a3a6-9e21944476fd req-6e42e2ff-bccc-4835-a686-e2a903f509fd service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Updated VIF entry in instance network info cache for port 7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:48:21 user nova-compute[72782]: DEBUG nova.network.neutron [req-9d264389-ffdc-4233-a3a6-9e21944476fd req-6e42e2ff-bccc-4835-a686-e2a903f509fd service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Updating instance_info_cache with network_info: [{"id": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "address": "fa:16:3e:7d:5e:0a", "network": {"id": "64006a4f-c433-4a4b-9eb1-9c01b1f92998", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-602656292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad9c25e-14", "ovs_interfaceid": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed05074c-e64e-4323-92de-d9594c044eb2", "address": "fa:16:3e:34:10:52", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped05074c-e6", "ovs_interfaceid": "ed05074c-e64e-4323-92de-d9594c044eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "address": "fa:16:3e:10:73:ae", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape703e10a-c7", "ovs_interfaceid": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "address": "fa:16:3e:3a:bb:18", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1deb99-9d", "ovs_interfaceid": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26080d32-4bd6-4320-b80a-200076d568d5", "address": "fa:16:3e:af:e3:b1", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26080d32-4b", "ovs_interfaceid": "26080d32-4bd6-4320-b80a-200076d568d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "address": "fa:16:3e:35:0e:71", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbbd012-f8", "ovs_interfaceid": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9302e1b4-e070-4dc6-afed-103549c16da0", "address": "fa:16:3e:41:db:4c", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9302e1b4-e0", "ovs_interfaceid": "9302e1b4-e070-4dc6-afed-103549c16da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:48:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9d264389-ffdc-4233-a3a6-9e21944476fd req-6e42e2ff-bccc-4835-a686-e2a903f509fd service nova] Releasing lock "refresh_cache-00a09aca-9913-4fba-91c6-9702c0dc44bd" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:48:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:22 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042487.5570736, ea26c664-91cb-4824-a66b-c8fe216c6ba4 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:48:22 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] VM Stopped (Lifecycle Event)
Aug 14 19:48:22 user nova-compute[72782]: DEBUG nova.compute.manager [None req-53150122-7752-4084-b7d8-e55075152e06 None None] [instance: ea26c664-91cb-4824-a66b-c8fe216c6ba4] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042503.2335176, 259c51df-ccd6-456e-85f4-7aaf4cba2b69 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:48:23 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] VM Resumed (Lifecycle Event)
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:48:23 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Instance spawned successfully.
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:48:23 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042503.2338583, 259c51df-ccd6-456e-85f4-7aaf4cba2b69 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:48:23 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] VM Started (Lifecycle Event)
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:48:23 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:48:23 user nova-compute[72782]: INFO nova.compute.manager [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-14c10a26-5f9e-4269-9bc2-a3e9eb8cb8bf req-65e931fb-26a8-4aa2-b8fc-6908a9b922b0 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Received event network-vif-plugged-35b9955c-a82a-42b9-a936-5f3429cda375 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-14c10a26-5f9e-4269-9bc2-a3e9eb8cb8bf req-65e931fb-26a8-4aa2-b8fc-6908a9b922b0 service nova] Acquiring lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-14c10a26-5f9e-4269-9bc2-a3e9eb8cb8bf req-65e931fb-26a8-4aa2-b8fc-6908a9b922b0 service nova] Lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-14c10a26-5f9e-4269-9bc2-a3e9eb8cb8bf req-65e931fb-26a8-4aa2-b8fc-6908a9b922b0 service nova] Lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-14c10a26-5f9e-4269-9bc2-a3e9eb8cb8bf req-65e931fb-26a8-4aa2-b8fc-6908a9b922b0 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] No waiting events found dispatching network-vif-plugged-35b9955c-a82a-42b9-a936-5f3429cda375 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:23 user nova-compute[72782]: WARNING nova.compute.manager [req-14c10a26-5f9e-4269-9bc2-a3e9eb8cb8bf req-65e931fb-26a8-4aa2-b8fc-6908a9b922b0 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Received unexpected event network-vif-plugged-35b9955c-a82a-42b9-a936-5f3429cda375 for instance with vm_state building and task_state spawning.
Aug 14 19:48:23 user nova-compute[72782]: INFO nova.compute.manager [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Took 6.29 seconds to build instance.
Aug 14 19:48:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f0bd49c-eb9b-4c2f-820b-58d92ec9c820 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.469s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:23 user nova-compute[72782]: INFO nova.compute.manager [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Terminating instance
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:48:23 user nova-compute[72782]: INFO nova.compute.claims [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Claim successful on node user
Aug 14 19:48:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-86612fa3-587b-4db2-8265-e277b109a67d req-9b24963d-fc90-402e-a6dd-4e4b891065d9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-unplugged-ed05074c-e64e-4323-92de-d9594c044eb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-86612fa3-587b-4db2-8265-e277b109a67d req-9b24963d-fc90-402e-a6dd-4e4b891065d9 service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-86612fa3-587b-4db2-8265-e277b109a67d req-9b24963d-fc90-402e-a6dd-4e4b891065d9 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-86612fa3-587b-4db2-8265-e277b109a67d req-9b24963d-fc90-402e-a6dd-4e4b891065d9 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-86612fa3-587b-4db2-8265-e277b109a67d req-9b24963d-fc90-402e-a6dd-4e4b891065d9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-unplugged-ed05074c-e64e-4323-92de-d9594c044eb2 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-86612fa3-587b-4db2-8265-e277b109a67d req-9b24963d-fc90-402e-a6dd-4e4b891065d9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-unplugged-ed05074c-e64e-4323-92de-d9594c044eb2 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-8f7aca66-2100-4ffb-9ba6-b652e5f796ef req-60727af0-fa79-4851-92bb-3d27b7e239c4 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-unplugged-e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8f7aca66-2100-4ffb-9ba6-b652e5f796ef req-60727af0-fa79-4851-92bb-3d27b7e239c4 service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8f7aca66-2100-4ffb-9ba6-b652e5f796ef req-60727af0-fa79-4851-92bb-3d27b7e239c4 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8f7aca66-2100-4ffb-9ba6-b652e5f796ef req-60727af0-fa79-4851-92bb-3d27b7e239c4 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-8f7aca66-2100-4ffb-9ba6-b652e5f796ef req-60727af0-fa79-4851-92bb-3d27b7e239c4 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-unplugged-e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-8f7aca66-2100-4ffb-9ba6-b652e5f796ef req-60727af0-fa79-4851-92bb-3d27b7e239c4 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-unplugged-e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.662s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG nova.compute.manager [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG nova.compute.manager [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG nova.network.neutron [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:48:24 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:48:24 user nova-compute[72782]: DEBUG nova.compute.manager [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG nova.policy [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01da439b977447d9acd627af965122bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294f11708224e9a9a69ae37139b4d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG nova.compute.manager [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:48:24 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Creating image(s)
Aug 14 19:48:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "/opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "/opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.206s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.262s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/disk 1073741824" returned: 0 in 0.107s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.378s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-3d47d1f9-53de-46da-a7da-6b4da9d34f27 req-dac51033-ae39-4cd8-b8d8-0715e36398e1 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-unplugged-7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3d47d1f9-53de-46da-a7da-6b4da9d34f27 req-dac51033-ae39-4cd8-b8d8-0715e36398e1 service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3d47d1f9-53de-46da-a7da-6b4da9d34f27 req-dac51033-ae39-4cd8-b8d8-0715e36398e1 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3d47d1f9-53de-46da-a7da-6b4da9d34f27 req-dac51033-ae39-4cd8-b8d8-0715e36398e1 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-3d47d1f9-53de-46da-a7da-6b4da9d34f27 req-dac51033-ae39-4cd8-b8d8-0715e36398e1 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-unplugged-7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-3d47d1f9-53de-46da-a7da-6b4da9d34f27 req-dac51033-ae39-4cd8-b8d8-0715e36398e1 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-unplugged-7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-3d47d1f9-53de-46da-a7da-6b4da9d34f27 req-dac51033-ae39-4cd8-b8d8-0715e36398e1 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3d47d1f9-53de-46da-a7da-6b4da9d34f27 req-dac51033-ae39-4cd8-b8d8-0715e36398e1 service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3d47d1f9-53de-46da-a7da-6b4da9d34f27 req-dac51033-ae39-4cd8-b8d8-0715e36398e1 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3d47d1f9-53de-46da-a7da-6b4da9d34f27 req-dac51033-ae39-4cd8-b8d8-0715e36398e1 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-3d47d1f9-53de-46da-a7da-6b4da9d34f27 req-dac51033-ae39-4cd8-b8d8-0715e36398e1 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:25 user nova-compute[72782]: WARNING nova.compute.manager [req-3d47d1f9-53de-46da-a7da-6b4da9d34f27 req-dac51033-ae39-4cd8-b8d8-0715e36398e1 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b for instance with vm_state active and task_state deleting.
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.208s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:25 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Instance destroyed successfully.
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.objects.instance [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lazy-loading 'resources' on Instance uuid 00a09aca-9913-4fba-91c6-9702c0dc44bd {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "address": "fa:16:3e:7d:5e:0a", "network": {"id": "64006a4f-c433-4a4b-9eb1-9c01b1f92998", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-602656292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad9c25e-14", "ovs_interfaceid": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "address": "fa:16:3e:7d:5e:0a", "network": {"id": "64006a4f-c433-4a4b-9eb1-9c01b1f92998", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-602656292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad9c25e-14", "ovs_interfaceid": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:5e:0a,bridge_name='br-int',has_traffic_filtering=True,id=7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b,network=Network(64006a4f-c433-4a4b-9eb1-9c01b1f92998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ad9c25e-14') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG os_vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:5e:0a,bridge_name='br-int',has_traffic_filtering=True,id=7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b,network=Network(64006a4f-c433-4a4b-9eb1-9c01b1f92998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ad9c25e-14') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ad9c25e-14, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.network.neutron [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Successfully created port: adcfdaef-2180-4855-8971-ea5b45f9f730 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:25 user nova-compute[72782]: INFO os_vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:5e:0a,bridge_name='br-int',has_traffic_filtering=True,id=7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b,network=Network(64006a4f-c433-4a4b-9eb1-9c01b1f92998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ad9c25e-14')
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed05074c-e64e-4323-92de-d9594c044eb2", "address": "fa:16:3e:34:10:52", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped05074c-e6", "ovs_interfaceid": "ed05074c-e64e-4323-92de-d9594c044eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "ed05074c-e64e-4323-92de-d9594c044eb2", "address": "fa:16:3e:34:10:52", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped05074c-e6", "ovs_interfaceid": "ed05074c-e64e-4323-92de-d9594c044eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:10:52,bridge_name='br-int',has_traffic_filtering=True,id=ed05074c-e64e-4323-92de-d9594c044eb2,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped05074c-e6') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG os_vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:10:52,bridge_name='br-int',has_traffic_filtering=True,id=ed05074c-e64e-4323-92de-d9594c044eb2,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped05074c-e6') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped05074c-e6, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Cannot resize image /opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.objects.instance [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lazy-loading 'migration_context' on Instance uuid a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Ensure instance console log exists: /opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:25 user nova-compute[72782]: INFO os_vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:10:52,bridge_name='br-int',has_traffic_filtering=True,id=ed05074c-e64e-4323-92de-d9594c044eb2,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped05074c-e6')
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "address": "fa:16:3e:10:73:ae", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape703e10a-c7", "ovs_interfaceid": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "address": "fa:16:3e:10:73:ae", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape703e10a-c7", "ovs_interfaceid": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:73:ae,bridge_name='br-int',has_traffic_filtering=True,id=e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape703e10a-c7') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG os_vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:73:ae,bridge_name='br-int',has_traffic_filtering=True,id=e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape703e10a-c7') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape703e10a-c7, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:25 user nova-compute[72782]: INFO os_vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:73:ae,bridge_name='br-int',has_traffic_filtering=True,id=e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape703e10a-c7')
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "address": "fa:16:3e:3a:bb:18", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1deb99-9d", "ovs_interfaceid": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "address": "fa:16:3e:3a:bb:18", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1deb99-9d", "ovs_interfaceid": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:bb:18,bridge_name='br-int',has_traffic_filtering=True,id=4e1deb99-9d04-4e8a-9436-a65820a2852b,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e1deb99-9d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG os_vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:bb:18,bridge_name='br-int',has_traffic_filtering=True,id=4e1deb99-9d04-4e8a-9436-a65820a2852b,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e1deb99-9d') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e1deb99-9d, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:25 user nova-compute[72782]: INFO os_vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:bb:18,bridge_name='br-int',has_traffic_filtering=True,id=4e1deb99-9d04-4e8a-9436-a65820a2852b,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e1deb99-9d')
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26080d32-4bd6-4320-b80a-200076d568d5", "address": "fa:16:3e:af:e3:b1", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26080d32-4b", "ovs_interfaceid": "26080d32-4bd6-4320-b80a-200076d568d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "26080d32-4bd6-4320-b80a-200076d568d5", "address": "fa:16:3e:af:e3:b1", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26080d32-4b", "ovs_interfaceid": "26080d32-4bd6-4320-b80a-200076d568d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:e3:b1,bridge_name='br-int',has_traffic_filtering=True,id=26080d32-4bd6-4320-b80a-200076d568d5,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26080d32-4b') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG os_vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:e3:b1,bridge_name='br-int',has_traffic_filtering=True,id=26080d32-4bd6-4320-b80a-200076d568d5,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26080d32-4b') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26080d32-4b, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:26 user nova-compute[72782]: INFO os_vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:e3:b1,bridge_name='br-int',has_traffic_filtering=True,id=26080d32-4bd6-4320-b80a-200076d568d5,network=Network(c4d877ff-a88d-4c41-96a2-644514adfe4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26080d32-4b')
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "address": "fa:16:3e:35:0e:71", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbbd012-f8", "ovs_interfaceid": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "address": "fa:16:3e:35:0e:71", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbbd012-f8", "ovs_interfaceid": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:0e:71,bridge_name='br-int',has_traffic_filtering=True,id=5dbbd012-f83b-4066-8bbc-70425d5a95de,network=Network(76799c51-fdd0-42b2-b336-78eccfb25062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dbbd012-f8') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0e:71,bridge_name='br-int',has_traffic_filtering=True,id=5dbbd012-f83b-4066-8bbc-70425d5a95de,network=Network(76799c51-fdd0-42b2-b336-78eccfb25062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dbbd012-f8') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5dbbd012-f8, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:26 user nova-compute[72782]: INFO os_vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0e:71,bridge_name='br-int',has_traffic_filtering=True,id=5dbbd012-f83b-4066-8bbc-70425d5a95de,network=Network(76799c51-fdd0-42b2-b336-78eccfb25062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dbbd012-f8')
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1038532838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1038532838',id=9,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7w+ZmlcDmNE9vmsowxNJkOZqZ+//6xPReiZDmohJHazlmcdR4a9S7qrYnqoAfmPumrAFCHWdKFofkjxAZKvIsr+hv8pT+UIsf4ZhrDLHVQ0yDlQtmufGY6iqw4HYoGIw==',key_name='tempest-keypair-1466614465',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='833f54e960414f2d80ed0f069bcafba5',ramdisk_id='',reservation_id='r-tcrqfx73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2000979356',owner_user_name='tempest-TaggedBootDevicesTest_v242-2000979356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='624561a8bc094e8380135f5fbe91fb85',uuid=00a09aca-9913-4fba-91c6-9702c0dc44bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9302e1b4-e070-4dc6-afed-103549c16da0", "address": "fa:16:3e:41:db:4c", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9302e1b4-e0", "ovs_interfaceid": "9302e1b4-e070-4dc6-afed-103549c16da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converting VIF {"id": "9302e1b4-e070-4dc6-afed-103549c16da0", "address": "fa:16:3e:41:db:4c", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9302e1b4-e0", "ovs_interfaceid": "9302e1b4-e070-4dc6-afed-103549c16da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:db:4c,bridge_name='br-int',has_traffic_filtering=True,id=9302e1b4-e070-4dc6-afed-103549c16da0,network=Network(76799c51-fdd0-42b2-b336-78eccfb25062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9302e1b4-e0') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:db:4c,bridge_name='br-int',has_traffic_filtering=True,id=9302e1b4-e070-4dc6-afed-103549c16da0,network=Network(76799c51-fdd0-42b2-b336-78eccfb25062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9302e1b4-e0') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9302e1b4-e0, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:26 user nova-compute[72782]: INFO os_vif [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:db:4c,bridge_name='br-int',has_traffic_filtering=True,id=9302e1b4-e070-4dc6-afed-103549c16da0,network=Network(76799c51-fdd0-42b2-b336-78eccfb25062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9302e1b4-e0')
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztLqrNsk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:48:26 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca11f5be-af5e-4950-9f3a-ad5b937149cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e968ac51-e898-4227-a764-9c159fc2f6aa]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)
Aug 14 19:48:26 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:48:26 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:48:26 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:48:26 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:26 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)
Aug 14 19:48:26 user nova-compute[72782]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 (non-flash)
Aug 14 19:48:26 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:48:26 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:48:26 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:26 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e865ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af2bb85-1d1f-487e-a0dd-64adf6d3bbf6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aec533-3874-4205-9c4d-64dff3b9b39b]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4d4db9-d202-4b4f-9b2f-938abef4e278]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.071s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0156efd0-f909-4f38-8118-bccd9bac8ae4]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-5aba347e-8078-4ed2-8877-2251a4f838fd req-4c59c829-e81b-48e2-a8b1-219902ac4d8a service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-ed05074c-e64e-4323-92de-d9594c044eb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5aba347e-8078-4ed2-8877-2251a4f838fd req-4c59c829-e81b-48e2-a8b1-219902ac4d8a service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5aba347e-8078-4ed2-8877-2251a4f838fd req-4c59c829-e81b-48e2-a8b1-219902ac4d8a service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5aba347e-8078-4ed2-8877-2251a4f838fd req-4c59c829-e81b-48e2-a8b1-219902ac4d8a service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-5aba347e-8078-4ed2-8877-2251a4f838fd req-4c59c829-e81b-48e2-a8b1-219902ac4d8a service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-ed05074c-e64e-4323-92de-d9594c044eb2 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:26 user nova-compute[72782]: WARNING nova.compute.manager [req-5aba347e-8078-4ed2-8877-2251a4f838fd req-4c59c829-e81b-48e2-a8b1-219902ac4d8a service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-ed05074c-e64e-4323-92de-d9594c044eb2 for instance with vm_state active and task_state deleting.
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-5aba347e-8078-4ed2-8877-2251a4f838fd req-4c59c829-e81b-48e2-a8b1-219902ac4d8a service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-unplugged-9302e1b4-e070-4dc6-afed-103549c16da0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5aba347e-8078-4ed2-8877-2251a4f838fd req-4c59c829-e81b-48e2-a8b1-219902ac4d8a service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5aba347e-8078-4ed2-8877-2251a4f838fd req-4c59c829-e81b-48e2-a8b1-219902ac4d8a service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5aba347e-8078-4ed2-8877-2251a4f838fd req-4c59c829-e81b-48e2-a8b1-219902ac4d8a service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-5aba347e-8078-4ed2-8877-2251a4f838fd req-4c59c829-e81b-48e2-a8b1-219902ac4d8a service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-unplugged-9302e1b4-e070-4dc6-afed-103549c16da0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-5aba347e-8078-4ed2-8877-2251a4f838fd req-4c59c829-e81b-48e2-a8b1-219902ac4d8a service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-unplugged-9302e1b4-e070-4dc6-afed-103549c16da0 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-5aba347e-8078-4ed2-8877-2251a4f838fd req-4c59c829-e81b-48e2-a8b1-219902ac4d8a service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-9302e1b4-e070-4dc6-afed-103549c16da0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5aba347e-8078-4ed2-8877-2251a4f838fd req-4c59c829-e81b-48e2-a8b1-219902ac4d8a service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5aba347e-8078-4ed2-8877-2251a4f838fd req-4c59c829-e81b-48e2-a8b1-219902ac4d8a service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5aba347e-8078-4ed2-8877-2251a4f838fd req-4c59c829-e81b-48e2-a8b1-219902ac4d8a service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-5aba347e-8078-4ed2-8877-2251a4f838fd req-4c59c829-e81b-48e2-a8b1-219902ac4d8a service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-9302e1b4-e070-4dc6-afed-103549c16da0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:26 user nova-compute[72782]: WARNING nova.compute.manager [req-5aba347e-8078-4ed2-8877-2251a4f838fd req-4c59c829-e81b-48e2-a8b1-219902ac4d8a service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-9302e1b4-e070-4dc6-afed-103549c16da0 for instance with vm_state active and task_state deleting.
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[49aa79a5-22a0-499b-a846-636ae6977db4]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[459c108e-54b7-4620-ae55-c5188c538dff]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04, portal: 172.16.0.220,3260]
Aug 14 19:48:26 user nova-compute[72782]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04, portal: 172.16.0.220,3260] successful.
Aug 14 19:48:26 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e50f2a1-02a1-4f07-8bf6-2aad5c3afc04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a469b868-b1c6-4621-967b-448eb8ef242b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] <== disconnect_volume: return (355ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNyhpGvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:48:26 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[18721ddd-ad5c-4ff8-895b-c230eae84667]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a5b17a-f9b0-4273-b54c-bd2589520f45]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)
Aug 14 19:48:26 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:48:26 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:48:26 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:26 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)
Aug 14 19:48:26 user nova-compute[72782]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 (non-flash)
Aug 14 19:48:26 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:48:26 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:26 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e865ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950'): ({'sdc'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Removing single pathed devices sdc {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e643569a-2f59-4bea-a8d2-4508f8d9fcd5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a016ed-100d-48ef-b92d-39b29582aab5]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Flushing IO for device /dev/sdc {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[04552bdf-75af-4f5c-a2c4-bb4ca0f7e80b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:26 user nova-compute[72782]: WARNING nova.compute.manager [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd for instance with vm_state active and task_state deleting.
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-unplugged-4e1deb99-9d04-4e8a-9436-a65820a2852b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-unplugged-4e1deb99-9d04-4e8a-9436-a65820a2852b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-unplugged-4e1deb99-9d04-4e8a-9436-a65820a2852b for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-4e1deb99-9d04-4e8a-9436-a65820a2852b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-4e1deb99-9d04-4e8a-9436-a65820a2852b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:26 user nova-compute[72782]: WARNING nova.compute.manager [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-4e1deb99-9d04-4e8a-9436-a65820a2852b for instance with vm_state active and task_state deleting.
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-unplugged-26080d32-4bd6-4320-b80a-200076d568d5 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-unplugged-26080d32-4bd6-4320-b80a-200076d568d5 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-unplugged-26080d32-4bd6-4320-b80a-200076d568d5 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-26080d32-4bd6-4320-b80a-200076d568d5 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-26080d32-4bd6-4320-b80a-200076d568d5 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:26 user nova-compute[72782]: WARNING nova.compute.manager [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-26080d32-4bd6-4320-b80a-200076d568d5 for instance with vm_state active and task_state deleting.
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-unplugged-5dbbd012-f83b-4066-8bbc-70425d5a95de {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-unplugged-5dbbd012-f83b-4066-8bbc-70425d5a95de {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-cfad294a-3c8b-4250-afa0-d8d1df566e52 req-dc3b7c25-184a-4cd6-b3ee-85734fecf6c9 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-unplugged-5dbbd012-f83b-4066-8bbc-70425d5a95de for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.network.neutron [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Successfully updated port: adcfdaef-2180-4855-8971-ea5b45f9f730 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e16f8e-c54a-4194-8a4d-47b9f20f5158]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] SCSI volumes sdc have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "refresh_cache-a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquired lock "refresh_cache-a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.network.neutron [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[292bcc5b-5b7e-4ae0-b2e5-2ce9babb588e]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.network.neutron [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3059732-9c05-4bfd-a9bc-ec013154db2b]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950, portal: 172.16.0.220,3260]
Aug 14 19:48:26 user nova-compute[72782]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950, portal: 172.16.0.220,3260] successful.
Aug 14 19:48:26 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2520d4d3-9583-40a3-af3c-1e4eb5131950 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cb3fdd-af0f-49cf-83cd-d0780a74b537]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] <== disconnect_volume: return (387ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vReGOZni', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:48:26 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4d8017-a93b-43f6-ac96-0425eeca471d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f957c29a-a672-4b55-8bc4-fa63179fe2d0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)
Aug 14 19:48:26 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:48:26 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:26 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)
Aug 14 19:48:26 user nova-compute[72782]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b (non-flash)
Aug 14 19:48:26 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:26 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e865ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b'): ({'sde'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Removing single pathed devices sde {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[effc1006-b2a9-46a3-9fb0-63abd6aed888]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfabb656-3296-4dd2-abed-01aa35d4a060]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Flushing IO for device /dev/sde {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d99bfac-7552-4d4b-a54b-27921062bb50]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42ffab0-2774-4a26-ad0f-a83189072a36]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] SCSI volumes sde have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.network.neutron [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Updating instance_info_cache with network_info: [{"id": "adcfdaef-2180-4855-8971-ea5b45f9f730", "address": "fa:16:3e:d5:4a:31", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadcfdaef-21", "ovs_interfaceid": "adcfdaef-2180-4855-8971-ea5b45f9f730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bc5d9e-6a8f-47c9-b978-69bc9af4998a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Releasing lock "refresh_cache-a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.compute.manager [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Instance network_info: |[{"id": "adcfdaef-2180-4855-8971-ea5b45f9f730", "address": "fa:16:3e:d5:4a:31", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadcfdaef-21", "ovs_interfaceid": "adcfdaef-2180-4855-8971-ea5b45f9f730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Start _get_guest_xml network_info=[{"id": "adcfdaef-2180-4855-8971-ea5b45f9f730", "address": "fa:16:3e:d5:4a:31", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadcfdaef-21", "ovs_interfaceid": "adcfdaef-2180-4855-8971-ea5b45f9f730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:48:27 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:48:27 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-827845467',display_name='tempest-VolumesAdminNegativeTest-server-827845467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-827845467',id=14,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c294f11708224e9a9a69ae37139b4d06',ramdisk_id='',reservation_id='r-dxgly1h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-468605289',owner_user_name='tempest-VolumesAdminNegativeTest-468605289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:48:25Z,user_data=None,user_id='01da439b977447d9acd627af965122bd',uuid=a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adcfdaef-2180-4855-8971-ea5b45f9f730", "address": "fa:16:3e:d5:4a:31", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadcfdaef-21", "ovs_interfaceid": "adcfdaef-2180-4855-8971-ea5b45f9f730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Converting VIF {"id": "adcfdaef-2180-4855-8971-ea5b45f9f730", "address": "fa:16:3e:d5:4a:31", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadcfdaef-21", "ovs_interfaceid": "adcfdaef-2180-4855-8971-ea5b45f9f730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:31,bridge_name='br-int',has_traffic_filtering=True,id=adcfdaef-2180-4855-8971-ea5b45f9f730,network=Network(f55b2a79-f0a6-4b3f-991b-a93ae0ded8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadcfdaef-21') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.objects.instance [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lazy-loading 'pci_devices' on Instance uuid a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6482db9d-b643-4e84-be14-6ae424c342c6]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b, portal: 172.16.0.220,3260]
Aug 14 19:48:27 user nova-compute[72782]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b, portal: 172.16.0.220,3260] successful.
Aug 14 19:48:27 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:48:27 user nova-compute[72782]:   <uuid>a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da</uuid>
Aug 14 19:48:27 user nova-compute[72782]:   <name>instance-0000000e</name>
Aug 14 19:48:27 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:48:27 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:48:27 user nova-compute[72782]:   <metadata>
Aug 14 19:48:27 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:48:27 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:48:27 user nova-compute[72782]:       <nova:name>tempest-VolumesAdminNegativeTest-server-827845467</nova:name>
Aug 14 19:48:27 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:48:27</nova:creationTime>
Aug 14 19:48:27 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:48:27 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:48:27 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:48:27 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:48:27 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:48:27 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:48:27 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:48:27 user nova-compute[72782]:       <nova:owner>
Aug 14 19:48:27 user nova-compute[72782]:         <nova:user uuid="01da439b977447d9acd627af965122bd">tempest-VolumesAdminNegativeTest-468605289-project-member</nova:user>
Aug 14 19:48:27 user nova-compute[72782]:         <nova:project uuid="c294f11708224e9a9a69ae37139b4d06">tempest-VolumesAdminNegativeTest-468605289</nova:project>
Aug 14 19:48:27 user nova-compute[72782]:       </nova:owner>
Aug 14 19:48:27 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:48:27 user nova-compute[72782]:       <nova:ports>
Aug 14 19:48:27 user nova-compute[72782]:         <nova:port uuid="adcfdaef-2180-4855-8971-ea5b45f9f730">
Aug 14 19:48:27 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 19:48:27 user nova-compute[72782]:         </nova:port>
Aug 14 19:48:27 user nova-compute[72782]:       </nova:ports>
Aug 14 19:48:27 user nova-compute[72782]:     </nova:instance>
Aug 14 19:48:27 user nova-compute[72782]:   </metadata>
Aug 14 19:48:27 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:48:27 user nova-compute[72782]:     <system>
Aug 14 19:48:27 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:48:27 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:48:27 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:48:27 user nova-compute[72782]:       <entry name="serial">a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da</entry>
Aug 14 19:48:27 user nova-compute[72782]:       <entry name="uuid">a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da</entry>
Aug 14 19:48:27 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:48:27 user nova-compute[72782]:     </system>
Aug 14 19:48:27 user nova-compute[72782]:   </sysinfo>
Aug 14 19:48:27 user nova-compute[72782]:   <os>
Aug 14 19:48:27 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:48:27 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:48:27 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:48:27 user nova-compute[72782]:   </os>
Aug 14 19:48:27 user nova-compute[72782]:   <features>
Aug 14 19:48:27 user nova-compute[72782]:     <acpi/>
Aug 14 19:48:27 user nova-compute[72782]:     <apic/>
Aug 14 19:48:27 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:48:27 user nova-compute[72782]:   </features>
Aug 14 19:48:27 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:48:27 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:48:27 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:48:27 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:48:27 user nova-compute[72782]:   </clock>
Aug 14 19:48:27 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:48:27 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:48:27 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:48:27 user nova-compute[72782]:   </cpu>
Aug 14 19:48:27 user nova-compute[72782]:   <devices>
Aug 14 19:48:27 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:48:27 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:48:27 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/disk"/>
Aug 14 19:48:27 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:48:27 user nova-compute[72782]:     </disk>
Aug 14 19:48:27 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:48:27 user nova-compute[72782]:       <mac address="fa:16:3e:d5:4a:31"/>
Aug 14 19:48:27 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:48:27 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:48:27 user nova-compute[72782]:       <target dev="tapadcfdaef-21"/>
Aug 14 19:48:27 user nova-compute[72782]:     </interface>
Aug 14 19:48:27 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:48:27 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/console.log" append="off"/>
Aug 14 19:48:27 user nova-compute[72782]:     </serial>
Aug 14 19:48:27 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:48:27 user nova-compute[72782]:     <video>
Aug 14 19:48:27 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:48:27 user nova-compute[72782]:     </video>
Aug 14 19:48:27 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:48:27 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:48:27 user nova-compute[72782]:     </rng>
Aug 14 19:48:27 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:48:27 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:48:27 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:48:27 user nova-compute[72782]:     </memballoon>
Aug 14 19:48:27 user nova-compute[72782]:   </devices>
Aug 14 19:48:27 user nova-compute[72782]: </domain>
Aug 14 19:48:27 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-827845467',display_name='tempest-VolumesAdminNegativeTest-server-827845467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-827845467',id=14,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c294f11708224e9a9a69ae37139b4d06',ramdisk_id='',reservation_id='r-dxgly1h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-468605289',owner_user_name='tempest-VolumesAdminNegativeTest-468605289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:48:25Z,user_data=None,user_id='01da439b977447d9acd627af965122bd',uuid=a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adcfdaef-2180-4855-8971-ea5b45f9f730", "address": "fa:16:3e:d5:4a:31", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadcfdaef-21", "ovs_interfaceid": "adcfdaef-2180-4855-8971-ea5b45f9f730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Converting VIF {"id": "adcfdaef-2180-4855-8971-ea5b45f9f730", "address": "fa:16:3e:d5:4a:31", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadcfdaef-21", "ovs_interfaceid": "adcfdaef-2180-4855-8971-ea5b45f9f730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:31,bridge_name='br-int',has_traffic_filtering=True,id=adcfdaef-2180-4855-8971-ea5b45f9f730,network=Network(f55b2a79-f0a6-4b3f-991b-a93ae0ded8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadcfdaef-21') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG os_vif [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:31,bridge_name='br-int',has_traffic_filtering=True,id=adcfdaef-2180-4855-8971-ea5b45f9f730,network=Network(f55b2a79-f0a6-4b3f-991b-a93ae0ded8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadcfdaef-21') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadcfdaef-21, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapadcfdaef-21, col_values=(('external_ids', {'iface-id': 'adcfdaef-2180-4855-8971-ea5b45f9f730', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:4a:31', 'vm-uuid': 'a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6556a3c-a0de-4a83-bc13-cefbae62165b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a0d469-a32a-4ad7-9a0d-11f457323fa0]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] <== disconnect_volume: return (338ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:48:27 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Deleting instance files /opt/stack/data/nova/instances/00a09aca-9913-4fba-91c6-9702c0dc44bd_del
Aug 14 19:48:27 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Deletion of /opt/stack/data/nova/instances/00a09aca-9913-4fba-91c6-9702c0dc44bd_del complete
Aug 14 19:48:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:27 user nova-compute[72782]: INFO os_vif [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:31,bridge_name='br-int',has_traffic_filtering=True,id=adcfdaef-2180-4855-8971-ea5b45f9f730,network=Network(f55b2a79-f0a6-4b3f-991b-a93ae0ded8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadcfdaef-21')
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] No VIF found with MAC fa:16:3e:d5:4a:31, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:48:27 user nova-compute[72782]: INFO nova.compute.manager [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Took 3.50 seconds to destroy the instance on the hypervisor.
Aug 14 19:48:27 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:48:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG nova.compute.manager [req-f29d5e6f-3463-4b86-a170-6c21cd0232d0 req-31ba954b-97c8-421b-92ff-34040611edb3 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Received event network-changed-adcfdaef-2180-4855-8971-ea5b45f9f730 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG nova.compute.manager [req-f29d5e6f-3463-4b86-a170-6c21cd0232d0 req-31ba954b-97c8-421b-92ff-34040611edb3 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Refreshing instance network info cache due to event network-changed-adcfdaef-2180-4855-8971-ea5b45f9f730. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f29d5e6f-3463-4b86-a170-6c21cd0232d0 req-31ba954b-97c8-421b-92ff-34040611edb3 service nova] Acquiring lock "refresh_cache-a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f29d5e6f-3463-4b86-a170-6c21cd0232d0 req-31ba954b-97c8-421b-92ff-34040611edb3 service nova] Acquired lock "refresh_cache-a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG nova.network.neutron [req-f29d5e6f-3463-4b86-a170-6c21cd0232d0 req-31ba954b-97c8-421b-92ff-34040611edb3 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Refreshing network info cache for port adcfdaef-2180-4855-8971-ea5b45f9f730 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG nova.compute.manager [req-b0e0c0f4-a2f0-4d46-a43e-286079b09888 req-b7d3371d-e3a8-478d-95d4-9001a5db2029 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-plugged-5dbbd012-f83b-4066-8bbc-70425d5a95de {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b0e0c0f4-a2f0-4d46-a43e-286079b09888 req-b7d3371d-e3a8-478d-95d4-9001a5db2029 service nova] Acquiring lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b0e0c0f4-a2f0-4d46-a43e-286079b09888 req-b7d3371d-e3a8-478d-95d4-9001a5db2029 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b0e0c0f4-a2f0-4d46-a43e-286079b09888 req-b7d3371d-e3a8-478d-95d4-9001a5db2029 service nova] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG nova.compute.manager [req-b0e0c0f4-a2f0-4d46-a43e-286079b09888 req-b7d3371d-e3a8-478d-95d4-9001a5db2029 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] No waiting events found dispatching network-vif-plugged-5dbbd012-f83b-4066-8bbc-70425d5a95de {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:28 user nova-compute[72782]: WARNING nova.compute.manager [req-b0e0c0f4-a2f0-4d46-a43e-286079b09888 req-b7d3371d-e3a8-478d-95d4-9001a5db2029 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received unexpected event network-vif-plugged-5dbbd012-f83b-4066-8bbc-70425d5a95de for instance with vm_state active and task_state deleting.
Aug 14 19:48:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnCulVSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd51b224a-5167-40bf-8d3c-8426b420458c', 'attached_at': '', 'detached_at': '', 'volume_id': 'ddb56ed8-6a67-421d-bb15-f23b6a7cd241', 'serial': 'ddb56ed8-6a67-421d-bb15-f23b6a7cd241'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'plfkVnRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'b4896c6c-889e-4372-a34c-43256cbe0dc4'}, 'status': 'reserved', 'instance': 'd51b224a-5167-40bf-8d3c-8426b420458c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4896c6c-889e-4372-a34c-43256cbe0dc4', 'serial'} {{(pid=72782) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnCulVSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:48:28 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:48:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:48:28 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:48:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:48:28 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[060104a6-119d-468d-8e88-e41f4c38d0af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:48:28 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9eaa78-63e9-4aa6-92c7-0baf6a15c1e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241] added
Aug 14 19:48:28 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dadbfa9-509f-44f2-a15f-3e8ce0287d20]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d71230-2161-444b-b999-d5895bb0e68d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AnCulVSf {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AnCulVSf" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b421958a-f984-4a6b-b71f-86d456b7bff6]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AnCulVSf'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde5a399-5575-4377-8ff8-79618d736185]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6b72d7-27b6-43f0-a32a-8e056c1b6b56]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)
Aug 14 19:48:28 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:28 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)
Aug 14 19:48:28 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:28 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:48:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --login" returned: 0 in 0.164s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3722dea9-f736-42eb-95a5-c9b3988c22a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241, portal: 172.16.0.220,3260]
Aug 14 19:48:29 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241, portal: 172.16.0.220,3260] successful.
Aug 14 19:48:29 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6834c2fc-6b02-4b71-b98f-d7ac85ab9c36]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5a82c4-102e-4607-9794-a5925ef6422a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)
Aug 14 19:48:29 user nova-compute[72782]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:48:29 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:29 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)
Aug 14 19:48:29 user nova-compute[72782]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:48:29 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:29 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.405s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[549c6a38-49bb-4537-8ce3-06f55398c9f4]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnCulVSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG nova.network.neutron [req-f29d5e6f-3463-4b86-a170-6c21cd0232d0 req-31ba954b-97c8-421b-92ff-34040611edb3 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Updated VIF entry in instance network info cache for port adcfdaef-2180-4855-8971-ea5b45f9f730. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG nova.network.neutron [req-f29d5e6f-3463-4b86-a170-6c21cd0232d0 req-31ba954b-97c8-421b-92ff-34040611edb3 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Updating instance_info_cache with network_info: [{"id": "adcfdaef-2180-4855-8971-ea5b45f9f730", "address": "fa:16:3e:d5:4a:31", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadcfdaef-21", "ovs_interfaceid": "adcfdaef-2180-4855-8971-ea5b45f9f730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:48:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f29d5e6f-3463-4b86-a170-6c21cd0232d0 req-31ba954b-97c8-421b-92ff-34040611edb3 service nova] Releasing lock "refresh_cache-a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:48:30 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:48:30 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '23031363539343863', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:48:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031363539343863', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:48:30 user nova-compute[72782]: DEBUG nova.objects.instance [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Lazy-loading 'flavor' on Instance uuid d51b224a-5167-40bf-8d3c-8426b420458c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:48:30 user nova-compute[72782]: DEBUG nova.compute.manager [req-4d6f7be0-d45e-4031-8d68-e23cb1b5f4b1 req-aeeee171-c47c-4fc5-96b4-b207b777dc8e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-deleted-26080d32-4bd6-4320-b80a-200076d568d5 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:30 user nova-compute[72782]: INFO nova.compute.manager [req-4d6f7be0-d45e-4031-8d68-e23cb1b5f4b1 req-aeeee171-c47c-4fc5-96b4-b207b777dc8e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Neutron deleted interface 26080d32-4bd6-4320-b80a-200076d568d5; detaching it from the instance and deleting it from the info cache
Aug 14 19:48:30 user nova-compute[72782]: DEBUG nova.network.neutron [req-4d6f7be0-d45e-4031-8d68-e23cb1b5f4b1 req-aeeee171-c47c-4fc5-96b4-b207b777dc8e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Updating instance_info_cache with network_info: [{"id": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "address": "fa:16:3e:7d:5e:0a", "network": {"id": "64006a4f-c433-4a4b-9eb1-9c01b1f92998", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-602656292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad9c25e-14", "ovs_interfaceid": "7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed05074c-e64e-4323-92de-d9594c044eb2", "address": "fa:16:3e:34:10:52", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped05074c-e6", "ovs_interfaceid": "ed05074c-e64e-4323-92de-d9594c044eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "address": "fa:16:3e:10:73:ae", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape703e10a-c7", "ovs_interfaceid": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "address": "fa:16:3e:3a:bb:18", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1deb99-9d", "ovs_interfaceid": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "address": "fa:16:3e:35:0e:71", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbbd012-f8", "ovs_interfaceid": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9302e1b4-e070-4dc6-afed-103549c16da0", "address": "fa:16:3e:41:db:4c", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9302e1b4-e0", "ovs_interfaceid": "9302e1b4-e070-4dc6-afed-103549c16da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:48:30 user nova-compute[72782]: DEBUG nova.compute.manager [req-4d6f7be0-d45e-4031-8d68-e23cb1b5f4b1 req-aeeee171-c47c-4fc5-96b4-b207b777dc8e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Detach interface failed, port_id=26080d32-4bd6-4320-b80a-200076d568d5, reason: Instance 00a09aca-9913-4fba-91c6-9702c0dc44bd could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 19:48:30 user nova-compute[72782]: DEBUG nova.compute.manager [req-4d6f7be0-d45e-4031-8d68-e23cb1b5f4b1 req-aeeee171-c47c-4fc5-96b4-b207b777dc8e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-deleted-7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:30 user nova-compute[72782]: INFO nova.compute.manager [req-4d6f7be0-d45e-4031-8d68-e23cb1b5f4b1 req-aeeee171-c47c-4fc5-96b4-b207b777dc8e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Neutron deleted interface 7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b; detaching it from the instance and deleting it from the info cache
Aug 14 19:48:30 user nova-compute[72782]: DEBUG nova.network.neutron [req-4d6f7be0-d45e-4031-8d68-e23cb1b5f4b1 req-aeeee171-c47c-4fc5-96b4-b207b777dc8e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Updating instance_info_cache with network_info: [{"id": "ed05074c-e64e-4323-92de-d9594c044eb2", "address": "fa:16:3e:34:10:52", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped05074c-e6", "ovs_interfaceid": "ed05074c-e64e-4323-92de-d9594c044eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "address": "fa:16:3e:10:73:ae", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape703e10a-c7", "ovs_interfaceid": "e703e10a-c7ce-4e72-b7b0-1e40f7ddb2fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "address": "fa:16:3e:3a:bb:18", "network": {"id": "c4d877ff-a88d-4c41-96a2-644514adfe4f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1033561915", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e1deb99-9d", "ovs_interfaceid": "4e1deb99-9d04-4e8a-9436-a65820a2852b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "address": "fa:16:3e:35:0e:71", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dbbd012-f8", "ovs_interfaceid": "5dbbd012-f83b-4066-8bbc-70425d5a95de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9302e1b4-e070-4dc6-afed-103549c16da0", "address": "fa:16:3e:41:db:4c", "network": {"id": "76799c51-fdd0-42b2-b336-78eccfb25062", "bridge": "br-int", "label": "tempest-device-tagging-net2-654737341", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "833f54e960414f2d80ed0f069bcafba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9302e1b4-e0", "ovs_interfaceid": "9302e1b4-e070-4dc6-afed-103549c16da0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:48:30 user nova-compute[72782]: DEBUG nova.compute.manager [req-4d6f7be0-d45e-4031-8d68-e23cb1b5f4b1 req-aeeee171-c47c-4fc5-96b4-b207b777dc8e service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Detach interface failed, port_id=7ad9c25e-14ee-4b57-a7a5-f5212f7fb48b, reason: Instance 00a09aca-9913-4fba-91c6-9702c0dc44bd could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 19:48:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:48:30 user nova-compute[72782]: DEBUG nova.compute.manager [req-4df4a393-0df3-43e2-ace9-45530aa410c7 req-f2ff8176-931a-4833-9f1d-7ebabdc25470 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Received event network-vif-plugged-adcfdaef-2180-4855-8971-ea5b45f9f730 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4df4a393-0df3-43e2-ace9-45530aa410c7 req-f2ff8176-931a-4833-9f1d-7ebabdc25470 service nova] Acquiring lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4df4a393-0df3-43e2-ace9-45530aa410c7 req-f2ff8176-931a-4833-9f1d-7ebabdc25470 service nova] Lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4df4a393-0df3-43e2-ace9-45530aa410c7 req-f2ff8176-931a-4833-9f1d-7ebabdc25470 service nova] Lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:30 user nova-compute[72782]: DEBUG nova.compute.manager [req-4df4a393-0df3-43e2-ace9-45530aa410c7 req-f2ff8176-931a-4833-9f1d-7ebabdc25470 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] No waiting events found dispatching network-vif-plugged-adcfdaef-2180-4855-8971-ea5b45f9f730 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:30 user nova-compute[72782]: WARNING nova.compute.manager [req-4df4a393-0df3-43e2-ace9-45530aa410c7 req-f2ff8176-931a-4833-9f1d-7ebabdc25470 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Received unexpected event network-vif-plugged-adcfdaef-2180-4855-8971-ea5b45f9f730 for instance with vm_state building and task_state spawning.
Aug 14 19:48:30 user nova-compute[72782]: DEBUG nova.compute.manager [req-4df4a393-0df3-43e2-ace9-45530aa410c7 req-f2ff8176-931a-4833-9f1d-7ebabdc25470 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Received event network-vif-plugged-adcfdaef-2180-4855-8971-ea5b45f9f730 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4df4a393-0df3-43e2-ace9-45530aa410c7 req-f2ff8176-931a-4833-9f1d-7ebabdc25470 service nova] Acquiring lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4df4a393-0df3-43e2-ace9-45530aa410c7 req-f2ff8176-931a-4833-9f1d-7ebabdc25470 service nova] Lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4df4a393-0df3-43e2-ace9-45530aa410c7 req-f2ff8176-931a-4833-9f1d-7ebabdc25470 service nova] Lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:30 user nova-compute[72782]: DEBUG nova.compute.manager [req-4df4a393-0df3-43e2-ace9-45530aa410c7 req-f2ff8176-931a-4833-9f1d-7ebabdc25470 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] No waiting events found dispatching network-vif-plugged-adcfdaef-2180-4855-8971-ea5b45f9f730 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:30 user nova-compute[72782]: WARNING nova.compute.manager [req-4df4a393-0df3-43e2-ace9-45530aa410c7 req-f2ff8176-931a-4833-9f1d-7ebabdc25470 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Received unexpected event network-vif-plugged-adcfdaef-2180-4855-8971-ea5b45f9f730 for instance with vm_state building and task_state spawning.
Aug 14 19:48:30 user nova-compute[72782]: DEBUG nova.compute.manager [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:48:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:48:31 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042511.007305, a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:48:31 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] VM Resumed (Lifecycle Event)
Aug 14 19:48:31 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Instance spawned successfully.
Aug 14 19:48:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:48:31 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:48:31 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:48:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:48:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:48:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:48:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:48:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:48:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:48:31 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:48:31 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042511.0074532, a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:48:31 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] VM Started (Lifecycle Event)
Aug 14 19:48:31 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:48:31 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:48:31 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:48:31 user nova-compute[72782]: INFO nova.compute.manager [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Took 6.41 seconds to spawn the instance on the hypervisor.
Aug 14 19:48:31 user nova-compute[72782]: DEBUG nova.compute.manager [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:48:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] COPY block job progress, current cursor: 161480704 final cursor: 1073741824 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:48:31 user nova-compute[72782]: INFO nova.compute.manager [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Took 7.53 seconds to build instance.
Aug 14 19:48:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-49ba8cad-5a44-4bfa-835a-11483c3a6215 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.691s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] COPY block job progress, current cursor: 303038464 final cursor: 1073741824 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:48:31 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:48:31 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Took 4.54 seconds to deallocate network for instance.
Aug 14 19:48:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] COPY block job progress, current cursor: 460324864 final cursor: 1073741824 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:48:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:32 user nova-compute[72782]: DEBUG nova.compute.manager [req-e975b955-cc54-4071-a5eb-3de1cb32fa31 req-3a969449-f944-44cb-9f8a-87d756dab9a3 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-deleted-9302e1b4-e070-4dc6-afed-103549c16da0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:32 user nova-compute[72782]: DEBUG nova.compute.manager [req-e975b955-cc54-4071-a5eb-3de1cb32fa31 req-3a969449-f944-44cb-9f8a-87d756dab9a3 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-deleted-5dbbd012-f83b-4066-8bbc-70425d5a95de {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:32 user nova-compute[72782]: DEBUG nova.compute.manager [req-e975b955-cc54-4071-a5eb-3de1cb32fa31 req-3a969449-f944-44cb-9f8a-87d756dab9a3 service nova] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Received event network-vif-deleted-4e1deb99-9d04-4e8a-9436-a65820a2852b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] COPY block job progress, current cursor: 602931200 final cursor: 1073741824 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:48:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] COPY block job progress, current cursor: 751828992 final cursor: 1073741824 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:48:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] COPY block job progress, current cursor: 899678208 final cursor: 1073741824 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] COPY block job progress, current cursor: 1045430272 final cursor: 1073741824 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'plfkVnRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'b4896c6c-889e-4372-a34c-43256cbe0dc4'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:48:34 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:48:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c1a46f-a45f-46d7-bac2-8d8db0b9bd10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bed36c-4a18-4258-8ca5-1b65e5871d0d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)
Aug 14 19:48:34 user nova-compute[72782]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:48:34 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:34 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 (non-flash)
Aug 14 19:48:34 user nova-compute[72782]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:48:34 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:34 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f64087dab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4'): ({'sdd'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Removing single pathed devices sdd {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfb8fc7-37ae-43f8-a10c-12659aed20c1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0158db14-7af2-4691-9798-937688975ee3]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Flushing IO for device /dev/sdd {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:48:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a07324-23b6-4e07-a713-482df685c97c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:48:35 user nova-compute[72782]: INFO nova.compute.manager [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Took 3.23 seconds to detach 3 volumes for instance.
Aug 14 19:48:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[158d088a-f4b3-44ec-b5d9-5c4f3db2d891]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[684f6101-7679-4c5b-affc-89188bdf77df]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f357e6a9-67bb-4e30-8055-50a22faacfc7]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4, portal: 172.16.0.220,3260]
Aug 14 19:48:35 user nova-compute[72782]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4, portal: 172.16.0.220,3260] successful.
Aug 14 19:48:35 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4896c6c-889e-4372-a34c-43256cbe0dc4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[15404cda-1dbe-4bd5-af10-4f01af019856]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] <== disconnect_volume: return (313ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnCulVSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd51b224a-5167-40bf-8d3c-8426b420458c', 'attached_at': '', 'detached_at': '', 'volume_id': 'ddb56ed8-6a67-421d-bb15-f23b6a7cd241', 'serial'} {{(pid=72782) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] swap_volume: removing Cinder connection for volume b4896c6c-889e-4372-a34c-43256cbe0dc4 {{(pid=72782) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:48:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:35 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Deleted allocations for instance 00a09aca-9913-4fba-91c6-9702c0dc44bd
Aug 14 19:48:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b2b99963-ff41-4785-9894-116ea09af186 tempest-TaggedBootDevicesTest_v242-2000979356 tempest-TaggedBootDevicesTest_v242-2000979356-project-member] Lock "00a09aca-9913-4fba-91c6-9702c0dc44bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.861s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] swap_volume: Updating volume b4896c6c-889e-4372-a34c-43256cbe0dc4 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "AnCulVSf", "auth_password": "y5zG691IgHZJd8", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "ddb56ed8-6a67-421d-bb15-f23b6a7cd241"}, "status": "reserved", "instance": "d51b224a-5167-40bf-8d3c-8426b420458c", "attached_at": "", "detached_at": "", "volume_id": "ddb56ed8-6a67-421d-bb15-f23b6a7cd241", "serial": "ddb56ed8-6a67-421d-bb15-f23b6a7cd241"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ddb56ed8-6a67-421d-bb15-f23b6a7cd241', 'no_device': None, 'attachment_id': 'c39bb6d2-e10f-4416-a519-90939b2eaa78'} {{(pid=72782) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 14 19:48:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9b103605-6a19-4f4d-8e00-9881d8a4c719 tempest-TestVolumeSwap-1362353015 tempest-TestVolumeSwap-1362353015-project-admin] Lock "d51b224a-5167-40bf-8d3c-8426b420458c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.122s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Acquiring lock "d51b224a-5167-40bf-8d3c-8426b420458c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "d51b224a-5167-40bf-8d3c-8426b420458c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:36 user nova-compute[72782]: INFO nova.compute.manager [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Detaching volume ddb56ed8-6a67-421d-bb15-f23b6a7cd241
Aug 14 19:48:37 user nova-compute[72782]: INFO nova.virt.block_device [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Attempting to driver detach volume ddb56ed8-6a67-421d-bb15-f23b6a7cd241 from mountpoint /dev/vdb
Aug 14 19:48:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Attempting to detach device vdb from instance d51b224a-5167-40bf-8d3c-8426b420458c from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:48:37 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:48:37 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 19:48:37 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:48:37 user nova-compute[72782]:   <serial>ddb56ed8-6a67-421d-bb15-f23b6a7cd241</serial>
Aug 14 19:48:37 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:48:37 user nova-compute[72782]: </disk>
Aug 14 19:48:37 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:48:37 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Successfully detached device vdb from instance d51b224a-5167-40bf-8d3c-8426b420458c from the persistent domain config.
Aug 14 19:48:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d51b224a-5167-40bf-8d3c-8426b420458c from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:48:37 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:48:37 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 19:48:37 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:48:37 user nova-compute[72782]:   <serial>ddb56ed8-6a67-421d-bb15-f23b6a7cd241</serial>
Aug 14 19:48:37 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:48:37 user nova-compute[72782]: </disk>
Aug 14 19:48:37 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692042517.4628284, d51b224a-5167-40bf-8d3c-8426b420458c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d51b224a-5167-40bf-8d3c-8426b420458c {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:48:37 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Successfully detached device vdb from instance d51b224a-5167-40bf-8d3c-8426b420458c from the live domain config.
Aug 14 19:48:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnCulVSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'ddb56ed8-6a67-421d-bb15-f23b6a7cd241'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:48:37 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:48:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a9fc3f-9fcc-4d41-95f1-ef17c7bd75e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e916d5-b47d-4fe9-894e-9abb7f239f4e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:48:37 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:37 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 (non-flash)
Aug 14 19:48:37 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:48:37 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f641994f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dda4a24-41f2-49a0-b984-7c288410efd1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52a57c8-d69b-4c8b-a19e-567760fb0c18]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[588e5a0c-1e4b-4122-983e-d22cc056417e]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c312176b-09d2-4f50-89a5-ccdda95a2b3d]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3faa4a4-8eff-4468-9d57-286e2ef5c6c0]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[799f9e05-af48-4606-a8be-14ef1957547d]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241, portal: 172.16.0.220,3260]
Aug 14 19:48:37 user nova-compute[72782]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241, portal: 172.16.0.220,3260] successful.
Aug 14 19:48:37 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb56ed8-6a67-421d-bb15-f23b6a7cd241 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c37a3a-5231-4672-82b3-c6d66b944801]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.239s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] <== disconnect_volume: return (239ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:48:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:48:38 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lazy-loading 'flavor' on Instance uuid d51b224a-5167-40bf-8d3c-8426b420458c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:48:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d87cf38-2680-44ee-a277-8519f597b11c tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "d51b224a-5167-40bf-8d3c-8426b420458c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.533s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:40 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042505.6194663, 00a09aca-9913-4fba-91c6-9702c0dc44bd => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:48:40 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] VM Stopped (Lifecycle Event)
Aug 14 19:48:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cfe01d03-088f-4248-83b4-d51047cea47f None None] [instance: 00a09aca-9913-4fba-91c6-9702c0dc44bd] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:48:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-02cb47f4-c265-4e83-b16e-69cf83304556 req-dbe81fd1-9acb-4b10-aff1-128dd0d9cbb1 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Received event network-changed-2dad6c60-4f31-4548-bfe7-31c85495c454 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-02cb47f4-c265-4e83-b16e-69cf83304556 req-dbe81fd1-9acb-4b10-aff1-128dd0d9cbb1 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Refreshing instance network info cache due to event network-changed-2dad6c60-4f31-4548-bfe7-31c85495c454. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-02cb47f4-c265-4e83-b16e-69cf83304556 req-dbe81fd1-9acb-4b10-aff1-128dd0d9cbb1 service nova] Acquiring lock "refresh_cache-28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-02cb47f4-c265-4e83-b16e-69cf83304556 req-dbe81fd1-9acb-4b10-aff1-128dd0d9cbb1 service nova] Acquired lock "refresh_cache-28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG nova.network.neutron [req-02cb47f4-c265-4e83-b16e-69cf83304556 req-dbe81fd1-9acb-4b10-aff1-128dd0d9cbb1 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Refreshing network info cache for port 2dad6c60-4f31-4548-bfe7-31c85495c454 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Acquiring lock "04969095-d5d4-4581-bb3e-df44e21d33d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Acquiring lock "04969095-d5d4-4581-bb3e-df44e21d33d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:52 user nova-compute[72782]: INFO nova.compute.manager [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Terminating instance
Aug 14 19:48:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-2a4e98af-7b88-491e-b57b-aeb6a3c773d2 req-c50850db-ec7e-49ad-83ea-e8beaa9983d8 service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Received event network-vif-unplugged-4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2a4e98af-7b88-491e-b57b-aeb6a3c773d2 req-c50850db-ec7e-49ad-83ea-e8beaa9983d8 service nova] Acquiring lock "04969095-d5d4-4581-bb3e-df44e21d33d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2a4e98af-7b88-491e-b57b-aeb6a3c773d2 req-c50850db-ec7e-49ad-83ea-e8beaa9983d8 service nova] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2a4e98af-7b88-491e-b57b-aeb6a3c773d2 req-c50850db-ec7e-49ad-83ea-e8beaa9983d8 service nova] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-2a4e98af-7b88-491e-b57b-aeb6a3c773d2 req-c50850db-ec7e-49ad-83ea-e8beaa9983d8 service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] No waiting events found dispatching network-vif-unplugged-4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-2a4e98af-7b88-491e-b57b-aeb6a3c773d2 req-c50850db-ec7e-49ad-83ea-e8beaa9983d8 service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Received event network-vif-unplugged-4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG nova.network.neutron [req-02cb47f4-c265-4e83-b16e-69cf83304556 req-dbe81fd1-9acb-4b10-aff1-128dd0d9cbb1 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Updated VIF entry in instance network info cache for port 2dad6c60-4f31-4548-bfe7-31c85495c454. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG nova.network.neutron [req-02cb47f4-c265-4e83-b16e-69cf83304556 req-dbe81fd1-9acb-4b10-aff1-128dd0d9cbb1 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Updating instance_info_cache with network_info: [{"id": "2dad6c60-4f31-4548-bfe7-31c85495c454", "address": "fa:16:3e:57:2a:1c", "network": {"id": "16825893-d7a0-4b45-8921-c96e6333c811", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1870839756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1bf9f154f641798504207c6db32799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad6c60-4f", "ovs_interfaceid": "2dad6c60-4f31-4548-bfe7-31c85495c454", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-02cb47f4-c265-4e83-b16e-69cf83304556 req-dbe81fd1-9acb-4b10-aff1-128dd0d9cbb1 service nova] Releasing lock "refresh_cache-28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:48:52 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Instance destroyed successfully.
Aug 14 19:48:52 user nova-compute[72782]: DEBUG nova.objects.instance [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lazy-loading 'resources' on Instance uuid 04969095-d5d4-4581-bb3e-df44e21d33d6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-569501847',display_name='tempest-VolumesAssistedSnapshotsTest-server-569501847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-569501847',id=6,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1V7dhIA/ejhdC/cA3Eqkg9ufttwNTvIY8TNM3tVem9xv9msNzew8DlaAbAfZWENqaowec7lkjIxMcgNA/QJpl3IcV40NN3J25SO7w89D19ziCBktXSj6JAcHVfGqonLQ==',key_name='tempest-keypair-883895863',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:45:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a94fb20b4e2489987bc77c5e1e5bb00',ramdisk_id='',reservation_id='r-3trfk3s8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1508355202',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1508355202-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:45:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56e463c57d63481ca33d5b9a94362ae5',uuid=04969095-d5d4-4581-bb3e-df44e21d33d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "address": "fa:16:3e:ac:8b:14", "network": {"id": "b106d629-341a-464c-abfc-c9d9fbd4105f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-208648938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a94fb20b4e2489987bc77c5e1e5bb00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccbc9f5-29", "ovs_interfaceid": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Converting VIF {"id": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "address": "fa:16:3e:ac:8b:14", "network": {"id": "b106d629-341a-464c-abfc-c9d9fbd4105f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-208648938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a94fb20b4e2489987bc77c5e1e5bb00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ccbc9f5-29", "ovs_interfaceid": "4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:8b:14,bridge_name='br-int',has_traffic_filtering=True,id=4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226,network=Network(b106d629-341a-464c-abfc-c9d9fbd4105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccbc9f5-29') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:48:52 user nova-compute[72782]: DEBUG os_vif [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:8b:14,bridge_name='br-int',has_traffic_filtering=True,id=4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226,network=Network(b106d629-341a-464c-abfc-c9d9fbd4105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccbc9f5-29') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:48:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ccbc9f5-29, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:48:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:48:53 user nova-compute[72782]: INFO os_vif [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:8b:14,bridge_name='br-int',has_traffic_filtering=True,id=4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226,network=Network(b106d629-341a-464c-abfc-c9d9fbd4105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ccbc9f5-29')
Aug 14 19:48:53 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Deleting instance files /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6_del
Aug 14 19:48:53 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Deletion of /opt/stack/data/nova/instances/04969095-d5d4-4581-bb3e-df44e21d33d6_del complete
Aug 14 19:48:53 user nova-compute[72782]: INFO nova.compute.manager [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 14 19:48:53 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:48:53 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:48:53 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:48:53 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:48:53 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Took 0.89 seconds to deallocate network for instance.
Aug 14 19:48:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:54 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:48:54 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:48:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:54 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Deleted allocations for instance 04969095-d5d4-4581-bb3e-df44e21d33d6
Aug 14 19:48:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-80903a0e-ae37-4539-ae65-2681243cf7ae tempest-VolumesAssistedSnapshotsTest-1508355202 tempest-VolumesAssistedSnapshotsTest-1508355202-project-member] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.359s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-9c85de85-920a-4f0c-836f-6ce75c9a60be req-0cf6d2c9-fff9-4640-9c87-21860dfb5728 service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Received event network-vif-plugged-4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9c85de85-920a-4f0c-836f-6ce75c9a60be req-0cf6d2c9-fff9-4640-9c87-21860dfb5728 service nova] Acquiring lock "04969095-d5d4-4581-bb3e-df44e21d33d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9c85de85-920a-4f0c-836f-6ce75c9a60be req-0cf6d2c9-fff9-4640-9c87-21860dfb5728 service nova] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9c85de85-920a-4f0c-836f-6ce75c9a60be req-0cf6d2c9-fff9-4640-9c87-21860dfb5728 service nova] Lock "04969095-d5d4-4581-bb3e-df44e21d33d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-9c85de85-920a-4f0c-836f-6ce75c9a60be req-0cf6d2c9-fff9-4640-9c87-21860dfb5728 service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] No waiting events found dispatching network-vif-plugged-4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:54 user nova-compute[72782]: WARNING nova.compute.manager [req-9c85de85-920a-4f0c-836f-6ce75c9a60be req-0cf6d2c9-fff9-4640-9c87-21860dfb5728 service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Received unexpected event network-vif-plugged-4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 for instance with vm_state deleted and task_state None.
Aug 14 19:48:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-9c85de85-920a-4f0c-836f-6ce75c9a60be req-0cf6d2c9-fff9-4640-9c87-21860dfb5728 service nova] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Received event network-vif-deleted-4ccbc9f5-29ea-4d5a-a94d-4b1496a2f226 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG nova.objects.instance [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lazy-loading 'flavor' on Instance uuid 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:56 user nova-compute[72782]: INFO nova.compute.manager [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Attaching volume 998146dc-a405-4d02-b3b7-6b1a500350f5 to /dev/vdb
Aug 14 19:48:56 user nova-compute[72782]: DEBUG os_brick.utils [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c381fac-9299-4293-9f14-e6bc74515085]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffaceb0-122f-49ae-86c9-ec72d752a86f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7857ead-2c61-46e2-81a5-3d79edfc6534]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5809756-abe9-4d5d-bfdd-6f0198c44006]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:48:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:48:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:48:57 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:48:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d243e6-0368-41e6-8fa2-ead384bb877b]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:48:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:48:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:48:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:48:57 user nova-compute[72782]: DEBUG os_brick.utils [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:48:57 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Updating existing volume attachment record: 285504ee-8716-43bd-b5e5-20b83828eb8d {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:48:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "5d532038-555f-42d3-b35a-9e6f0350b023" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "5d532038-555f-42d3-b35a-9e6f0350b023" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:58 user nova-compute[72782]: INFO nova.compute.manager [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Terminating instance
Aug 14 19:48:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG nova.compute.manager [req-66fcfe3b-4f5f-40a6-a547-bc05f6be6842 req-f5e56af5-a2bb-4851-832f-066d58efd978 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received event network-vif-unplugged-1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-66fcfe3b-4f5f-40a6-a547-bc05f6be6842 req-f5e56af5-a2bb-4851-832f-066d58efd978 service nova] Acquiring lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-66fcfe3b-4f5f-40a6-a547-bc05f6be6842 req-f5e56af5-a2bb-4851-832f-066d58efd978 service nova] Lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-66fcfe3b-4f5f-40a6-a547-bc05f6be6842 req-f5e56af5-a2bb-4851-832f-066d58efd978 service nova] Lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG nova.compute.manager [req-66fcfe3b-4f5f-40a6-a547-bc05f6be6842 req-f5e56af5-a2bb-4851-832f-066d58efd978 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] No waiting events found dispatching network-vif-unplugged-1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG nova.compute.manager [req-66fcfe3b-4f5f-40a6-a547-bc05f6be6842 req-f5e56af5-a2bb-4851-832f-066d58efd978 service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received event network-vif-unplugged-1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:48:58 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Instance destroyed successfully.
Aug 14 19:48:58 user nova-compute[72782]: DEBUG nova.objects.instance [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lazy-loading 'resources' on Instance uuid 5d532038-555f-42d3-b35a-9e6f0350b023 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-205293026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-205293026',id=5,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBUAZVMa4gIP2YmvcmOx5iou8wFV659Y2z9FXeRWhphzcOnzkYKBYpe1JczET+ExPwbJu9nwpHcQhAkzlPTFrALtNgdc28pKtERMGb/9tfusWIUd9XgIsvq2vJiC3QUAw==',key_name='tempest-keypair-190172691',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:45:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4de6c5ad7cf54432b6e2704cd3c0201c',ramdisk_id='',reservation_id='r-py4qploq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2072296078',owner_user_name='tempest-TaggedAttachmentsTest-2072296078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5283c6441c04ba497e3c89403bb2d87',uuid=5d532038-555f-42d3-b35a-9e6f0350b023,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "address": "fa:16:3e:0c:34:c8", "network": {"id": "6e75566e-5f3a-4d09-97c7-580d9c7c8db1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2064496785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec76c6a-a5", "ovs_interfaceid": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Converting VIF {"id": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "address": "fa:16:3e:0c:34:c8", "network": {"id": "6e75566e-5f3a-4d09-97c7-580d9c7c8db1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2064496785-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4de6c5ad7cf54432b6e2704cd3c0201c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec76c6a-a5", "ovs_interfaceid": "1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:34:c8,bridge_name='br-int',has_traffic_filtering=True,id=1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e,network=Network(6e75566e-5f3a-4d09-97c7-580d9c7c8db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec76c6a-a5') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG os_vif [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:34:c8,bridge_name='br-int',has_traffic_filtering=True,id=1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e,network=Network(6e75566e-5f3a-4d09-97c7-580d9c7c8db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec76c6a-a5') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ec76c6a-a5, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:48:58 user nova-compute[72782]: INFO os_vif [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:34:c8,bridge_name='br-int',has_traffic_filtering=True,id=1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e,network=Network(6e75566e-5f3a-4d09-97c7-580d9c7c8db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec76c6a-a5')
Aug 14 19:48:58 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Deleting instance files /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023_del
Aug 14 19:48:58 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Deletion of /opt/stack/data/nova/instances/5d532038-555f-42d3-b35a-9e6f0350b023_del complete
Aug 14 19:48:59 user nova-compute[72782]: INFO nova.compute.manager [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 19:48:59 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:48:59 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:48:59 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:49:00 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:49:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-f0018bb3-f944-4345-8e58-a1f56eae3678 req-08378dd7-9788-47b3-9136-3eeb10b68e0e service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received event network-vif-deleted-1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:49:00 user nova-compute[72782]: INFO nova.compute.manager [req-f0018bb3-f944-4345-8e58-a1f56eae3678 req-08378dd7-9788-47b3-9136-3eeb10b68e0e service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Neutron deleted interface 1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e; detaching it from the instance and deleting it from the info cache
Aug 14 19:49:00 user nova-compute[72782]: DEBUG nova.network.neutron [req-f0018bb3-f944-4345-8e58-a1f56eae3678 req-08378dd7-9788-47b3-9136-3eeb10b68e0e service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:49:00 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Took 1.11 seconds to deallocate network for instance.
Aug 14 19:49:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-f0018bb3-f944-4345-8e58-a1f56eae3678 req-08378dd7-9788-47b3-9136-3eeb10b68e0e service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Detach interface failed, port_id=1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e, reason: Instance 5d532038-555f-42d3-b35a-9e6f0350b023 could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 19:49:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:00 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:49:00 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:49:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:00 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Deleted allocations for instance 5d532038-555f-42d3-b35a-9e6f0350b023
Aug 14 19:49:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-50fdc44d-ad26-4d4b-80dd-ac415e19c555 tempest-TaggedAttachmentsTest-2072296078 tempest-TaggedAttachmentsTest-2072296078-project-member] Lock "5d532038-555f-42d3-b35a-9e6f0350b023" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.547s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-a49db39a-670e-44a6-9fec-0bf71cbb307d req-9c19ba48-086c-4a7b-8b57-8b2e22c8e13a service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received event network-vif-plugged-1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:49:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a49db39a-670e-44a6-9fec-0bf71cbb307d req-9c19ba48-086c-4a7b-8b57-8b2e22c8e13a service nova] Acquiring lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a49db39a-670e-44a6-9fec-0bf71cbb307d req-9c19ba48-086c-4a7b-8b57-8b2e22c8e13a service nova] Lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a49db39a-670e-44a6-9fec-0bf71cbb307d req-9c19ba48-086c-4a7b-8b57-8b2e22c8e13a service nova] Lock "5d532038-555f-42d3-b35a-9e6f0350b023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-a49db39a-670e-44a6-9fec-0bf71cbb307d req-9c19ba48-086c-4a7b-8b57-8b2e22c8e13a service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] No waiting events found dispatching network-vif-plugged-1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:49:00 user nova-compute[72782]: WARNING nova.compute.manager [req-a49db39a-670e-44a6-9fec-0bf71cbb307d req-9c19ba48-086c-4a7b-8b57-8b2e22c8e13a service nova] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Received unexpected event network-vif-plugged-1ec76c6a-a514-45f5-b3ad-f8dedbdeb54e for instance with vm_state deleted and task_state None.
Aug 14 19:49:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:49:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:05 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:49:05 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:49:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7426MB free_disk=25.747730255126953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:49:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:49:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:49:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance d51b224a-5167-40bf-8d3c-8426b420458c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:49:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:49:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0dfd5674-7b67-45ee-9847-40c76ac4ada9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:49:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 132b9b0b-9556-4aaf-a9ad-577e18215e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:49:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:49:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:49:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:49:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:49:05 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:49:05 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:49:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:49:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:07 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042532.9692914, 04969095-d5d4-4581-bb3e-df44e21d33d6 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:49:07 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] VM Stopped (Lifecycle Event)
Aug 14 19:49:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-d426935b-5d96-4e15-b5a2-2a47eeb2baad None None] [instance: 04969095-d5d4-4581-bb3e-df44e21d33d6] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:49:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uGJWfoRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:49:13 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:49:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:49:13 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:49:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:49:13 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff5c4e0-8550-4136-938b-6213656dd5d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:49:13 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4aa4d1-2d8e-41ab-aa7d-00871efce05f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5] added
Aug 14 19:49:13 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac231b26-0640-4b77-824e-84f77ee7b844]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042538.928242, 5d532038-555f-42d3-b35a-9e6f0350b023 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:49:13 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] VM Stopped (Lifecycle Event)
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8604282-d527-459b-98aa-27a4cfae309e]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uGJWfoRy {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6f5e7ee7-5150-449a-9b93-da048c5b6e46 None None] [instance: 5d532038-555f-42d3-b35a-9e6f0350b023] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uGJWfoRy" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a3e628-e7ac-4c22-add9-c17a4de91c31]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uGJWfoRy'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[add6564f-6a57-4110-b6a4-bd181f55c9d9]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:49:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2505313-0dc0-415f-bd0f-ea15c482d58e]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:49:14 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:49:14 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf84f364-a752-4b63-a2a6-372ba62671a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5, portal: 172.16.0.220,3260]
Aug 14 19:49:14 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5, portal: 172.16.0.220,3260] successful.
Aug 14 19:49:14 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e40c492-b5bd-435d-bd23-de79f21829c7]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[188c43e5-15e8-49c2-86d2-ef3f33eb48e3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 (non-flash)
Aug 14 19:49:14 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:49:14 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 (non-flash)
Aug 14 19:49:14 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:49:14 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc59024-ff1a-45d2-b545-c1826562f31b]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:14 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:49:15 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:49:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uGJWfoRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:49:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:49:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26135383330336165', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:49:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135383330336165', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:49:15 user nova-compute[72782]: DEBUG nova.objects.instance [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lazy-loading 'flavor' on Instance uuid 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:49:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:49:15 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:49:15 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 19:49:15 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:49:15 user nova-compute[72782]:   <serial>998146dc-a405-4d02-b3b7-6b1a500350f5</serial>
Aug 14 19:49:15 user nova-compute[72782]: </disk>
Aug 14 19:49:15 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:49:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:49:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:49:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] No VIF found with MAC fa:16:3e:57:2a:1c, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:49:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9f1855ba-304c-4813-a09d-c4ba276502d0 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.983s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Acquiring lock "d51b224a-5167-40bf-8d3c-8426b420458c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "d51b224a-5167-40bf-8d3c-8426b420458c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Acquiring lock "d51b224a-5167-40bf-8d3c-8426b420458c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "d51b224a-5167-40bf-8d3c-8426b420458c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "d51b224a-5167-40bf-8d3c-8426b420458c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:27 user nova-compute[72782]: INFO nova.compute.manager [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Terminating instance
Aug 14 19:49:27 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:49:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-cd1e5a2b-9c7b-40e2-b1c5-bfbf198d228a req-2b26d7c8-3066-48e9-9ee2-be0399730ca3 service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Received event network-vif-unplugged-028b6a27-22aa-41b4-887c-984dc24826be {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:49:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cd1e5a2b-9c7b-40e2-b1c5-bfbf198d228a req-2b26d7c8-3066-48e9-9ee2-be0399730ca3 service nova] Acquiring lock "d51b224a-5167-40bf-8d3c-8426b420458c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cd1e5a2b-9c7b-40e2-b1c5-bfbf198d228a req-2b26d7c8-3066-48e9-9ee2-be0399730ca3 service nova] Lock "d51b224a-5167-40bf-8d3c-8426b420458c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cd1e5a2b-9c7b-40e2-b1c5-bfbf198d228a req-2b26d7c8-3066-48e9-9ee2-be0399730ca3 service nova] Lock "d51b224a-5167-40bf-8d3c-8426b420458c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-cd1e5a2b-9c7b-40e2-b1c5-bfbf198d228a req-2b26d7c8-3066-48e9-9ee2-be0399730ca3 service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] No waiting events found dispatching network-vif-unplugged-028b6a27-22aa-41b4-887c-984dc24826be {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:49:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-cd1e5a2b-9c7b-40e2-b1c5-bfbf198d228a req-2b26d7c8-3066-48e9-9ee2-be0399730ca3 service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Received event network-vif-unplugged-028b6a27-22aa-41b4-887c-984dc24826be for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG nova.compute.manager [req-4890ebea-7f20-4277-ac48-0f4f9f2bd56e req-3b740d43-948c-4cea-88fd-b46abbc59fea service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Received event network-changed-ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG nova.compute.manager [req-4890ebea-7f20-4277-ac48-0f4f9f2bd56e req-3b740d43-948c-4cea-88fd-b46abbc59fea service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Refreshing instance network info cache due to event network-changed-ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4890ebea-7f20-4277-ac48-0f4f9f2bd56e req-3b740d43-948c-4cea-88fd-b46abbc59fea service nova] Acquiring lock "refresh_cache-0dfd5674-7b67-45ee-9847-40c76ac4ada9" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4890ebea-7f20-4277-ac48-0f4f9f2bd56e req-3b740d43-948c-4cea-88fd-b46abbc59fea service nova] Acquired lock "refresh_cache-0dfd5674-7b67-45ee-9847-40c76ac4ada9" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG nova.network.neutron [req-4890ebea-7f20-4277-ac48-0f4f9f2bd56e req-3b740d43-948c-4cea-88fd-b46abbc59fea service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Refreshing network info cache for port ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:49:28 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Instance destroyed successfully.
Aug 14 19:49:28 user nova-compute[72782]: DEBUG nova.objects.instance [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lazy-loading 'resources' on Instance uuid d51b224a-5167-40bf-8d3c-8426b420458c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1066984814',display_name='tempest-TestVolumeSwap-server-1066984814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1066984814',id=7,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYDWtxtIuspPTg040UMvo53oL7TfWErkeKKYI2KRNxTBRRa3TSxh9ow15Ufk4/RWPb2qaVUaeptJBcIE/gVDHdb8Yak2izUDSk626w88oFM+iuuYGaoXfDJeJAperLwEQ==',key_name='tempest-keypair-1291533056',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:45:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0351b1b7deb4c9da4ad0a4021ca4b4b',ramdisk_id='',reservation_id='r-1x7s504c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1118217115',owner_user_name='tempest-TestVolumeSwap-1118217115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:45:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='823e33d164fc4ba48769ac612971f1a2',uuid=d51b224a-5167-40bf-8d3c-8426b420458c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "028b6a27-22aa-41b4-887c-984dc24826be", "address": "fa:16:3e:ac:9b:7b", "network": {"id": "05421250-9ad9-4d5a-97c0-3bcd1d423709", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1416606760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0351b1b7deb4c9da4ad0a4021ca4b4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028b6a27-22", "ovs_interfaceid": "028b6a27-22aa-41b4-887c-984dc24826be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Converting VIF {"id": "028b6a27-22aa-41b4-887c-984dc24826be", "address": "fa:16:3e:ac:9b:7b", "network": {"id": "05421250-9ad9-4d5a-97c0-3bcd1d423709", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1416606760-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0351b1b7deb4c9da4ad0a4021ca4b4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap028b6a27-22", "ovs_interfaceid": "028b6a27-22aa-41b4-887c-984dc24826be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=028b6a27-22aa-41b4-887c-984dc24826be,network=Network(05421250-9ad9-4d5a-97c0-3bcd1d423709),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap028b6a27-22') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG os_vif [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=028b6a27-22aa-41b4-887c-984dc24826be,network=Network(05421250-9ad9-4d5a-97c0-3bcd1d423709),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap028b6a27-22') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap028b6a27-22, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:49:28 user nova-compute[72782]: INFO os_vif [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=028b6a27-22aa-41b4-887c-984dc24826be,network=Network(05421250-9ad9-4d5a-97c0-3bcd1d423709),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap028b6a27-22')
Aug 14 19:49:28 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Deleting instance files /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c_del
Aug 14 19:49:28 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Deletion of /opt/stack/data/nova/instances/d51b224a-5167-40bf-8d3c-8426b420458c_del complete
Aug 14 19:49:28 user nova-compute[72782]: INFO nova.compute.manager [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 14 19:49:28 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:28 user nova-compute[72782]: INFO nova.compute.manager [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Terminating instance
Aug 14 19:49:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:29 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Instance destroyed successfully.
Aug 14 19:49:29 user nova-compute[72782]: DEBUG nova.objects.instance [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'resources' on Instance uuid 0dfd5674-7b67-45ee-9847-40c76ac4ada9 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1413059343',display_name='tempest-AttachVolumeNegativeTest-server-1413059343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1413059343',id=11,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo2XTl+w1FDGSD4ZqP5pY/zxxU6KWlLkYODDapqnU6+Wa3+lS58VB7z2v6DydjWOy8j1KF62isD2vHG9ksLyxRdsf0dZtQldXLYreIsHvSafKvrFCRarbYhBIpvMOvpYA==',key_name='tempest-keypair-1561677291',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:47:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2c26e0199de48ee8c48dde8177bc519',ramdisk_id='',reservation_id='r-4urqzlst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1229463629',owner_user_name='tempest-AttachVolumeNegativeTest-1229463629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:47:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0cada11ffdb4ebc8d9e80218818ec3b',uuid=0dfd5674-7b67-45ee-9847-40c76ac4ada9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "address": "fa:16:3e:32:9b:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec251a71-c6", "ovs_interfaceid": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converting VIF {"id": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "address": "fa:16:3e:32:9b:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec251a71-c6", "ovs_interfaceid": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:9b:61,bridge_name='br-int',has_traffic_filtering=True,id=ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec251a71-c6') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG os_vif [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:9b:61,bridge_name='br-int',has_traffic_filtering=True,id=ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec251a71-c6') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec251a71-c6, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:49:29 user nova-compute[72782]: INFO os_vif [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:9b:61,bridge_name='br-int',has_traffic_filtering=True,id=ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec251a71-c6')
Aug 14 19:49:29 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Deleting instance files /opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9_del
Aug 14 19:49:29 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Deletion of /opt/stack/data/nova/instances/0dfd5674-7b67-45ee-9847-40c76ac4ada9_del complete
Aug 14 19:49:29 user nova-compute[72782]: INFO nova.compute.manager [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Took 0.76 seconds to destroy the instance on the hypervisor.
Aug 14 19:49:29 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-59a7c3bd-a416-4331-b8fe-3210ae32bc6f req-b08971f3-8672-4612-9152-3455a43f48f0 service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Received event network-vif-unplugged-ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-59a7c3bd-a416-4331-b8fe-3210ae32bc6f req-b08971f3-8672-4612-9152-3455a43f48f0 service nova] Acquiring lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-59a7c3bd-a416-4331-b8fe-3210ae32bc6f req-b08971f3-8672-4612-9152-3455a43f48f0 service nova] Lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-59a7c3bd-a416-4331-b8fe-3210ae32bc6f req-b08971f3-8672-4612-9152-3455a43f48f0 service nova] Lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-59a7c3bd-a416-4331-b8fe-3210ae32bc6f req-b08971f3-8672-4612-9152-3455a43f48f0 service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] No waiting events found dispatching network-vif-unplugged-ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-59a7c3bd-a416-4331-b8fe-3210ae32bc6f req-b08971f3-8672-4612-9152-3455a43f48f0 service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Received event network-vif-unplugged-ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG nova.network.neutron [req-4890ebea-7f20-4277-ac48-0f4f9f2bd56e req-3b740d43-948c-4cea-88fd-b46abbc59fea service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Updated VIF entry in instance network info cache for port ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG nova.network.neutron [req-4890ebea-7f20-4277-ac48-0f4f9f2bd56e req-3b740d43-948c-4cea-88fd-b46abbc59fea service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Updating instance_info_cache with network_info: [{"id": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "address": "fa:16:3e:32:9b:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec251a71-c6", "ovs_interfaceid": "ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4890ebea-7f20-4277-ac48-0f4f9f2bd56e req-3b740d43-948c-4cea-88fd-b46abbc59fea service nova] Releasing lock "refresh_cache-0dfd5674-7b67-45ee-9847-40c76ac4ada9" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-673193c0-054f-4e5a-88ab-2df04f311f3d req-99dbefa7-2776-40f4-9026-2e7c6bcf2a78 service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Received event network-vif-plugged-028b6a27-22aa-41b4-887c-984dc24826be {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-673193c0-054f-4e5a-88ab-2df04f311f3d req-99dbefa7-2776-40f4-9026-2e7c6bcf2a78 service nova] Acquiring lock "d51b224a-5167-40bf-8d3c-8426b420458c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-673193c0-054f-4e5a-88ab-2df04f311f3d req-99dbefa7-2776-40f4-9026-2e7c6bcf2a78 service nova] Lock "d51b224a-5167-40bf-8d3c-8426b420458c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-673193c0-054f-4e5a-88ab-2df04f311f3d req-99dbefa7-2776-40f4-9026-2e7c6bcf2a78 service nova] Lock "d51b224a-5167-40bf-8d3c-8426b420458c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-673193c0-054f-4e5a-88ab-2df04f311f3d req-99dbefa7-2776-40f4-9026-2e7c6bcf2a78 service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] No waiting events found dispatching network-vif-plugged-028b6a27-22aa-41b4-887c-984dc24826be {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:49:29 user nova-compute[72782]: WARNING nova.compute.manager [req-673193c0-054f-4e5a-88ab-2df04f311f3d req-99dbefa7-2776-40f4-9026-2e7c6bcf2a78 service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Received unexpected event network-vif-plugged-028b6a27-22aa-41b4-887c-984dc24826be for instance with vm_state active and task_state deleting.
Aug 14 19:49:30 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:49:30 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Took 2.20 seconds to deallocate network for instance.
Aug 14 19:49:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:30 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:49:30 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Took 1.31 seconds to deallocate network for instance.
Aug 14 19:49:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:30 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:49:30 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:49:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.224s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:30 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Deleted allocations for instance d51b224a-5167-40bf-8d3c-8426b420458c
Aug 14 19:49:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1f6b4465-9f84-4f5a-8c65-d0d554228e38 tempest-TestVolumeSwap-1118217115 tempest-TestVolumeSwap-1118217115-project-member] Lock "d51b224a-5167-40bf-8d3c-8426b420458c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.733s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:31 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:49:31 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:49:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:31 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Deleted allocations for instance 0dfd5674-7b67-45ee-9847-40c76ac4ada9
Aug 14 19:49:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05e6439e-f6a6-4ce3-ae73-8bcfefb4c53f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.849s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:31 user nova-compute[72782]: DEBUG nova.compute.manager [req-67a0e806-bb29-4621-ab27-b0b102f02887 req-11902e07-7984-4261-983e-f4ca027bd654 service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Received event network-vif-plugged-ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:49:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-67a0e806-bb29-4621-ab27-b0b102f02887 req-11902e07-7984-4261-983e-f4ca027bd654 service nova] Acquiring lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-67a0e806-bb29-4621-ab27-b0b102f02887 req-11902e07-7984-4261-983e-f4ca027bd654 service nova] Lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-67a0e806-bb29-4621-ab27-b0b102f02887 req-11902e07-7984-4261-983e-f4ca027bd654 service nova] Lock "0dfd5674-7b67-45ee-9847-40c76ac4ada9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:31 user nova-compute[72782]: DEBUG nova.compute.manager [req-67a0e806-bb29-4621-ab27-b0b102f02887 req-11902e07-7984-4261-983e-f4ca027bd654 service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] No waiting events found dispatching network-vif-plugged-ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:49:31 user nova-compute[72782]: WARNING nova.compute.manager [req-67a0e806-bb29-4621-ab27-b0b102f02887 req-11902e07-7984-4261-983e-f4ca027bd654 service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Received unexpected event network-vif-plugged-ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 for instance with vm_state deleted and task_state None.
Aug 14 19:49:31 user nova-compute[72782]: DEBUG nova.compute.manager [req-67a0e806-bb29-4621-ab27-b0b102f02887 req-11902e07-7984-4261-983e-f4ca027bd654 service nova] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Received event network-vif-deleted-028b6a27-22aa-41b4-887c-984dc24826be {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:49:31 user nova-compute[72782]: DEBUG nova.compute.manager [req-bc9f8a58-156c-4f34-9895-d726879ad7cc req-10ceaed8-9e3a-4c4e-85f6-9d376a8ae963 service nova] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Received event network-vif-deleted-ec251a71-c6b4-4f5c-aa34-4a7f18f8d7e0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:49:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:49:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:40 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:49:40 user nova-compute[72782]: INFO nova.compute.claims [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Claim successful on node user
Aug 14 19:49:40 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:49:40 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:49:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:49:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:49:40 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:49:40 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:49:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:49:41 user nova-compute[72782]: INFO nova.virt.block_device [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Booting with volume 2b993f06-57e2-4344-962e-8c9db32e0cba at /dev/vda
Aug 14 19:49:41 user nova-compute[72782]: DEBUG os_brick.utils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ec653f-55d6-4f9a-b451-1be3b9bfc282]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG nova.policy [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '860c5b3f201f421488b838ff368b692e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fcb670ad7a401d93224e690fc674a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[78601c49-b770-409b-8f87-390ac8099080]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[15473c58-34fd-4ff9-b873-d7d794f50b83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0d7609-e613-4fc4-bd7b-9799221fe88a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:49:41 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:49:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[21be59b9-3e89-42a3-8ad8-483fc598df1d]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG os_brick.utils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updating existing volume attachment record: 2b95557e-51b3-4846-99f9-7d6ac6c5e398 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:49:41 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Successfully created port: 57339d04-6d3a-4eec-9ca2-bcd028028335 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:49:42 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Successfully created port: 73b00bb4-1307-466c-9ab7-098e44c86981 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:49:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:43 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Successfully created port: 15ef3b6e-7de5-4089-96fd-3b41433c9738 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:49:43 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042568.1545105, d51b224a-5167-40bf-8d3c-8426b420458c => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:49:43 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] VM Stopped (Lifecycle Event)
Aug 14 19:49:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-76896df5-e79d-4d60-a502-5e2476c8c85e None None] [instance: d51b224a-5167-40bf-8d3c-8426b420458c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:49:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:43 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Successfully created port: 613cc4e1-ffff-4180-b0da-0ec02646f55c {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:49:44 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042569.2105913, 0dfd5674-7b67-45ee-9847-40c76ac4ada9 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:49:44 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] VM Stopped (Lifecycle Event)
Aug 14 19:49:44 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f1cb3bb1-bbbb-443e-9a86-a5cae79b78a8 None None] [instance: 0dfd5674-7b67-45ee-9847-40c76ac4ada9] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:49:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:44 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Successfully created port: a10f0761-24bb-4ad9-bb7a-bc9961c576fc {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:45 user nova-compute[72782]: INFO nova.compute.manager [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Detaching volume 998146dc-a405-4d02-b3b7-6b1a500350f5
Aug 14 19:49:45 user nova-compute[72782]: INFO nova.virt.block_device [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Attempting to driver detach volume 998146dc-a405-4d02-b3b7-6b1a500350f5 from mountpoint /dev/vdb
Aug 14 19:49:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Attempting to detach device vdb from instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:49:45 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:49:45 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 19:49:45 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:49:45 user nova-compute[72782]:   <serial>998146dc-a405-4d02-b3b7-6b1a500350f5</serial>
Aug 14 19:49:45 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:49:45 user nova-compute[72782]: </disk>
Aug 14 19:49:45 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:49:45 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Successfully detached device vdb from instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f from the persistent domain config.
Aug 14 19:49:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:49:45 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:49:45 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 19:49:45 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:49:45 user nova-compute[72782]:   <serial>998146dc-a405-4d02-b3b7-6b1a500350f5</serial>
Aug 14 19:49:45 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:49:45 user nova-compute[72782]: </disk>
Aug 14 19:49:45 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Successfully updated port: 57339d04-6d3a-4eec-9ca2-bcd028028335 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG nova.compute.manager [req-88271924-0fec-4c1d-82ae-a23c7834ba19 req-0d11278f-97c3-44ed-ba3b-1d5f14b9e4a4 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-changed-57339d04-6d3a-4eec-9ca2-bcd028028335 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG nova.compute.manager [req-88271924-0fec-4c1d-82ae-a23c7834ba19 req-0d11278f-97c3-44ed-ba3b-1d5f14b9e4a4 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Refreshing instance network info cache due to event network-changed-57339d04-6d3a-4eec-9ca2-bcd028028335. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-88271924-0fec-4c1d-82ae-a23c7834ba19 req-0d11278f-97c3-44ed-ba3b-1d5f14b9e4a4 service nova] Acquiring lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-88271924-0fec-4c1d-82ae-a23c7834ba19 req-0d11278f-97c3-44ed-ba3b-1d5f14b9e4a4 service nova] Acquired lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG nova.network.neutron [req-88271924-0fec-4c1d-82ae-a23c7834ba19 req-0d11278f-97c3-44ed-ba3b-1d5f14b9e4a4 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Refreshing network info cache for port 57339d04-6d3a-4eec-9ca2-bcd028028335 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG nova.network.neutron [req-88271924-0fec-4c1d-82ae-a23c7834ba19 req-0d11278f-97c3-44ed-ba3b-1d5f14b9e4a4 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692042585.8224719, 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:49:45 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Successfully detached device vdb from instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f from the live domain config.
Aug 14 19:49:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uGJWfoRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:49:45 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:49:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1079103-3d6f-4195-b451-697a9cf303f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db86d34-09b7-495c-8259-7e23521b3e76]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 (non-flash)
Aug 14 19:49:45 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:49:45 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 (non-flash)
Aug 14 19:49:45 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:49:45 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6408798ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f98c8e7-c0c8-4386-b267-b95f5e5b8278]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5758cc7-3a11-4b05-9897-7b47c9ead5dc]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ef47ef-f5e0-4bc1-b20a-8fb75d62ee42]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:49:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[419d7f60-47a7-4b10-bb5d-85a437c3f1eb]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6140c1-2652-44b5-93eb-41bb1e219897]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac56f55b-e8c1-4746-ac8a-092d13fe81e0]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5, portal: 172.16.0.220,3260]
Aug 14 19:49:46 user nova-compute[72782]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5, portal: 172.16.0.220,3260] successful.
Aug 14 19:49:46 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998146dc-a405-4d02-b3b7-6b1a500350f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7635a700-1202-42f4-a154-6b54aa0081ae]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] <== disconnect_volume: return (319ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG nova.network.neutron [req-88271924-0fec-4c1d-82ae-a23c7834ba19 req-0d11278f-97c3-44ed-ba3b-1d5f14b9e4a4 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-88271924-0fec-4c1d-82ae-a23c7834ba19 req-0d11278f-97c3-44ed-ba3b-1d5f14b9e4a4 service nova] Releasing lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG nova.compute.manager [req-d9aa3ba5-4487-465a-8cdb-7274da36ce2e req-b4ccfe7c-4006-41c2-a3fe-7d18be6dd595 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Received event network-changed-5b0452fc-96f1-4844-afe9-290b93c90fda {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG nova.compute.manager [req-d9aa3ba5-4487-465a-8cdb-7274da36ce2e req-b4ccfe7c-4006-41c2-a3fe-7d18be6dd595 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Refreshing instance network info cache due to event network-changed-5b0452fc-96f1-4844-afe9-290b93c90fda. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d9aa3ba5-4487-465a-8cdb-7274da36ce2e req-b4ccfe7c-4006-41c2-a3fe-7d18be6dd595 service nova] Acquiring lock "refresh_cache-132b9b0b-9556-4aaf-a9ad-577e18215e84" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d9aa3ba5-4487-465a-8cdb-7274da36ce2e req-b4ccfe7c-4006-41c2-a3fe-7d18be6dd595 service nova] Acquired lock "refresh_cache-132b9b0b-9556-4aaf-a9ad-577e18215e84" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG nova.network.neutron [req-d9aa3ba5-4487-465a-8cdb-7274da36ce2e req-b4ccfe7c-4006-41c2-a3fe-7d18be6dd595 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Refreshing network info cache for port 5b0452fc-96f1-4844-afe9-290b93c90fda {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:49:46 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Successfully updated port: 55021cb8-5aac-42d2-898b-13b28995d3d8 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG nova.network.neutron [req-d9aa3ba5-4487-465a-8cdb-7274da36ce2e req-b4ccfe7c-4006-41c2-a3fe-7d18be6dd595 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Updated VIF entry in instance network info cache for port 5b0452fc-96f1-4844-afe9-290b93c90fda. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG nova.network.neutron [req-d9aa3ba5-4487-465a-8cdb-7274da36ce2e req-b4ccfe7c-4006-41c2-a3fe-7d18be6dd595 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Updating instance_info_cache with network_info: [{"id": "5b0452fc-96f1-4844-afe9-290b93c90fda", "address": "fa:16:3e:6a:36:8a", "network": {"id": "2e677476-9a97-4e6d-a259-3c1427e62a6e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-607049029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab27e735104a3caad51ab1049677a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0452fc-96", "ovs_interfaceid": "5b0452fc-96f1-4844-afe9-290b93c90fda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lazy-loading 'flavor' on Instance uuid 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d9aa3ba5-4487-465a-8cdb-7274da36ce2e req-b4ccfe7c-4006-41c2-a3fe-7d18be6dd595 service nova] Releasing lock "refresh_cache-132b9b0b-9556-4aaf-a9ad-577e18215e84" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5f556983-c11f-431c-b150-6712e6976aec tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.976s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG nova.objects.instance [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lazy-loading 'flavor' on Instance uuid 132b9b0b-9556-4aaf-a9ad-577e18215e84 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:49:47 user nova-compute[72782]: INFO nova.compute.manager [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Attaching volume 00bc3052-85b8-4a79-b0e7-83799a0f4d07 to /dev/vdb
Aug 14 19:49:47 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Successfully updated port: 14864729-c342-452f-8bb9-94895ac93ac3 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG os_brick.utils [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbf6e33-2e54-4f61-8374-bc6c8ca22e8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[de64c04e-ae69-47e4-8911-66e90d06bea3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f9f111-0283-4ce6-8f66-e7b45fb67cec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[827c08ee-0369-43b0-8aa3-34cb33781efd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:49:47 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4c7a8f-16ec-41d2-a545-c0d39c8995df]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG os_brick.utils [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Updating existing volume attachment record: 7be240bb-a482-4b41-85de-217bfa363e18 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG nova.compute.manager [req-374219ab-1e22-4a17-b92f-137908c67e64 req-4f8cb56d-5c8f-4c2a-9b8d-2901086ddb37 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-changed-55021cb8-5aac-42d2-898b-13b28995d3d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG nova.compute.manager [req-374219ab-1e22-4a17-b92f-137908c67e64 req-4f8cb56d-5c8f-4c2a-9b8d-2901086ddb37 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Refreshing instance network info cache due to event network-changed-55021cb8-5aac-42d2-898b-13b28995d3d8. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-374219ab-1e22-4a17-b92f-137908c67e64 req-4f8cb56d-5c8f-4c2a-9b8d-2901086ddb37 service nova] Acquiring lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-374219ab-1e22-4a17-b92f-137908c67e64 req-4f8cb56d-5c8f-4c2a-9b8d-2901086ddb37 service nova] Acquired lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG nova.network.neutron [req-374219ab-1e22-4a17-b92f-137908c67e64 req-4f8cb56d-5c8f-4c2a-9b8d-2901086ddb37 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Refreshing network info cache for port 55021cb8-5aac-42d2-898b-13b28995d3d8 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:49:47 user nova-compute[72782]: DEBUG nova.network.neutron [req-374219ab-1e22-4a17-b92f-137908c67e64 req-4f8cb56d-5c8f-4c2a-9b8d-2901086ddb37 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:49:48 user nova-compute[72782]: DEBUG nova.network.neutron [req-374219ab-1e22-4a17-b92f-137908c67e64 req-4f8cb56d-5c8f-4c2a-9b8d-2901086ddb37 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:49:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-374219ab-1e22-4a17-b92f-137908c67e64 req-4f8cb56d-5c8f-4c2a-9b8d-2901086ddb37 service nova] Releasing lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:49:48 user nova-compute[72782]: DEBUG nova.compute.manager [req-374219ab-1e22-4a17-b92f-137908c67e64 req-4f8cb56d-5c8f-4c2a-9b8d-2901086ddb37 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-changed-14864729-c342-452f-8bb9-94895ac93ac3 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:49:48 user nova-compute[72782]: DEBUG nova.compute.manager [req-374219ab-1e22-4a17-b92f-137908c67e64 req-4f8cb56d-5c8f-4c2a-9b8d-2901086ddb37 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Refreshing instance network info cache due to event network-changed-14864729-c342-452f-8bb9-94895ac93ac3. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:49:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-374219ab-1e22-4a17-b92f-137908c67e64 req-4f8cb56d-5c8f-4c2a-9b8d-2901086ddb37 service nova] Acquiring lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:49:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-374219ab-1e22-4a17-b92f-137908c67e64 req-4f8cb56d-5c8f-4c2a-9b8d-2901086ddb37 service nova] Acquired lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:49:48 user nova-compute[72782]: DEBUG nova.network.neutron [req-374219ab-1e22-4a17-b92f-137908c67e64 req-4f8cb56d-5c8f-4c2a-9b8d-2901086ddb37 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Refreshing network info cache for port 14864729-c342-452f-8bb9-94895ac93ac3 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:49:48 user nova-compute[72782]: DEBUG nova.network.neutron [req-374219ab-1e22-4a17-b92f-137908c67e64 req-4f8cb56d-5c8f-4c2a-9b8d-2901086ddb37 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:49:48 user nova-compute[72782]: DEBUG nova.network.neutron [req-374219ab-1e22-4a17-b92f-137908c67e64 req-4f8cb56d-5c8f-4c2a-9b8d-2901086ddb37 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:49:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-374219ab-1e22-4a17-b92f-137908c67e64 req-4f8cb56d-5c8f-4c2a-9b8d-2901086ddb37 service nova] Releasing lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:49:48 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Successfully updated port: 73b00bb4-1307-466c-9ab7-098e44c86981 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:49:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:49 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Successfully updated port: 15ef3b6e-7de5-4089-96fd-3b41433c9738 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:49:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-f853d465-d32c-45fb-9f59-5c45d7dac949 req-57fcca35-0034-4394-8669-3e33fdfb16ca service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-changed-73b00bb4-1307-466c-9ab7-098e44c86981 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:49:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-f853d465-d32c-45fb-9f59-5c45d7dac949 req-57fcca35-0034-4394-8669-3e33fdfb16ca service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Refreshing instance network info cache due to event network-changed-73b00bb4-1307-466c-9ab7-098e44c86981. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:49:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f853d465-d32c-45fb-9f59-5c45d7dac949 req-57fcca35-0034-4394-8669-3e33fdfb16ca service nova] Acquiring lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:49:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f853d465-d32c-45fb-9f59-5c45d7dac949 req-57fcca35-0034-4394-8669-3e33fdfb16ca service nova] Acquired lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:49:49 user nova-compute[72782]: DEBUG nova.network.neutron [req-f853d465-d32c-45fb-9f59-5c45d7dac949 req-57fcca35-0034-4394-8669-3e33fdfb16ca service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Refreshing network info cache for port 73b00bb4-1307-466c-9ab7-098e44c86981 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:49:49 user nova-compute[72782]: DEBUG nova.network.neutron [req-f853d465-d32c-45fb-9f59-5c45d7dac949 req-57fcca35-0034-4394-8669-3e33fdfb16ca service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:49:50 user nova-compute[72782]: DEBUG nova.network.neutron [req-f853d465-d32c-45fb-9f59-5c45d7dac949 req-57fcca35-0034-4394-8669-3e33fdfb16ca service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:49:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f853d465-d32c-45fb-9f59-5c45d7dac949 req-57fcca35-0034-4394-8669-3e33fdfb16ca service nova] Releasing lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:49:50 user nova-compute[72782]: DEBUG nova.compute.manager [req-f853d465-d32c-45fb-9f59-5c45d7dac949 req-57fcca35-0034-4394-8669-3e33fdfb16ca service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-changed-15ef3b6e-7de5-4089-96fd-3b41433c9738 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:49:50 user nova-compute[72782]: DEBUG nova.compute.manager [req-f853d465-d32c-45fb-9f59-5c45d7dac949 req-57fcca35-0034-4394-8669-3e33fdfb16ca service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Refreshing instance network info cache due to event network-changed-15ef3b6e-7de5-4089-96fd-3b41433c9738. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:49:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f853d465-d32c-45fb-9f59-5c45d7dac949 req-57fcca35-0034-4394-8669-3e33fdfb16ca service nova] Acquiring lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:49:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f853d465-d32c-45fb-9f59-5c45d7dac949 req-57fcca35-0034-4394-8669-3e33fdfb16ca service nova] Acquired lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:49:50 user nova-compute[72782]: DEBUG nova.network.neutron [req-f853d465-d32c-45fb-9f59-5c45d7dac949 req-57fcca35-0034-4394-8669-3e33fdfb16ca service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Refreshing network info cache for port 15ef3b6e-7de5-4089-96fd-3b41433c9738 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:49:50 user nova-compute[72782]: DEBUG nova.network.neutron [req-f853d465-d32c-45fb-9f59-5c45d7dac949 req-57fcca35-0034-4394-8669-3e33fdfb16ca service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:49:50 user nova-compute[72782]: DEBUG nova.network.neutron [req-f853d465-d32c-45fb-9f59-5c45d7dac949 req-57fcca35-0034-4394-8669-3e33fdfb16ca service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:49:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f853d465-d32c-45fb-9f59-5c45d7dac949 req-57fcca35-0034-4394-8669-3e33fdfb16ca service nova] Releasing lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:49:51 user nova-compute[72782]: INFO nova.virt.block_device [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Booting with volume c50a685a-247d-4bbd-b1de-6cf0cb96b725 at /dev/vdb
Aug 14 19:49:51 user nova-compute[72782]: DEBUG os_brick.utils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c4989d-bf1a-4422-aeed-93292b111fe0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccd3363-7dd4-4ecf-99d8-a530f40c7c15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Successfully updated port: 613cc4e1-ffff-4180-b0da-0ec02646f55c {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e881e7-2864-45c4-8df6-9832717995a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fb0800-69d5-4a54-b668-9148843e6fd5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:49:51 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:49:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd2c850-7306-4598-aedc-5373f0644060]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG os_brick.utils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updating existing volume attachment record: 2f4062f2-a44f-4e29-a650-39d4b75d23c5 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG nova.compute.manager [req-8302c2e6-87f3-4b3c-b427-53b2a8c34e8e req-dd00bd19-c967-4242-bbe6-6cb6a73bea55 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-changed-613cc4e1-ffff-4180-b0da-0ec02646f55c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG nova.compute.manager [req-8302c2e6-87f3-4b3c-b427-53b2a8c34e8e req-dd00bd19-c967-4242-bbe6-6cb6a73bea55 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Refreshing instance network info cache due to event network-changed-613cc4e1-ffff-4180-b0da-0ec02646f55c. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8302c2e6-87f3-4b3c-b427-53b2a8c34e8e req-dd00bd19-c967-4242-bbe6-6cb6a73bea55 service nova] Acquiring lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8302c2e6-87f3-4b3c-b427-53b2a8c34e8e req-dd00bd19-c967-4242-bbe6-6cb6a73bea55 service nova] Acquired lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:49:51 user nova-compute[72782]: DEBUG nova.network.neutron [req-8302c2e6-87f3-4b3c-b427-53b2a8c34e8e req-dd00bd19-c967-4242-bbe6-6cb6a73bea55 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Refreshing network info cache for port 613cc4e1-ffff-4180-b0da-0ec02646f55c {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:49:52 user nova-compute[72782]: DEBUG nova.network.neutron [req-8302c2e6-87f3-4b3c-b427-53b2a8c34e8e req-dd00bd19-c967-4242-bbe6-6cb6a73bea55 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:49:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:52 user nova-compute[72782]: DEBUG nova.network.neutron [req-8302c2e6-87f3-4b3c-b427-53b2a8c34e8e req-dd00bd19-c967-4242-bbe6-6cb6a73bea55 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:49:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8302c2e6-87f3-4b3c-b427-53b2a8c34e8e req-dd00bd19-c967-4242-bbe6-6cb6a73bea55 service nova] Releasing lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:49:52 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Successfully updated port: a10f0761-24bb-4ad9-bb7a-bc9961c576fc {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:49:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Acquiring lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:49:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Acquired lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:49:52 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:49:52 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:49:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-fad69d31-3fc7-4756-81b1-624fe8fc7667 req-0115d0fa-f116-49d5-be1c-2ea8af69c18f service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-changed-a10f0761-24bb-4ad9-bb7a-bc9961c576fc {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:49:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-fad69d31-3fc7-4756-81b1-624fe8fc7667 req-0115d0fa-f116-49d5-be1c-2ea8af69c18f service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Refreshing instance network info cache due to event network-changed-a10f0761-24bb-4ad9-bb7a-bc9961c576fc. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:49:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fad69d31-3fc7-4756-81b1-624fe8fc7667 req-0115d0fa-f116-49d5-be1c-2ea8af69c18f service nova] Acquiring lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:49:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:54 user nova-compute[72782]: DEBUG nova.network.neutron [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updating instance_info_cache with network_info: [{"id": "57339d04-6d3a-4eec-9ca2-bcd028028335", "address": "fa:16:3e:b3:73:cf", "network": {"id": "c9bb353d-5f85-45cd-9f62-a069db7c3dfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-255362601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57339d04-6d", "ovs_interfaceid": "57339d04-6d3a-4eec-9ca2-bcd028028335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55021cb8-5aac-42d2-898b-13b28995d3d8", "address": "fa:16:3e:ad:b1:39", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55021cb8-5a", "ovs_interfaceid": "55021cb8-5aac-42d2-898b-13b28995d3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14864729-c342-452f-8bb9-94895ac93ac3", "address": "fa:16:3e:b7:12:96", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14864729-c3", "ovs_interfaceid": "14864729-c342-452f-8bb9-94895ac93ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73b00bb4-1307-466c-9ab7-098e44c86981", "address": "fa:16:3e:56:b6:55", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b00bb4-13", "ovs_interfaceid": "73b00bb4-1307-466c-9ab7-098e44c86981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "address": "fa:16:3e:c6:ce:13", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ef3b6e-7d", "ovs_interfaceid": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "address": "fa:16:3e:df:c6:8f", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap613cc4e1-ff", "ovs_interfaceid": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "address": "fa:16:3e:9c:65:37", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10f0761-24", "ovs_interfaceid": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:49:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Releasing lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:49:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Instance network_info: |[{"id": "57339d04-6d3a-4eec-9ca2-bcd028028335", "address": "fa:16:3e:b3:73:cf", "network": {"id": "c9bb353d-5f85-45cd-9f62-a069db7c3dfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-255362601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57339d04-6d", "ovs_interfaceid": "57339d04-6d3a-4eec-9ca2-bcd028028335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55021cb8-5aac-42d2-898b-13b28995d3d8", "address": "fa:16:3e:ad:b1:39", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55021cb8-5a", "ovs_interfaceid": "55021cb8-5aac-42d2-898b-13b28995d3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14864729-c342-452f-8bb9-94895ac93ac3", "address": "fa:16:3e:b7:12:96", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14864729-c3", "ovs_interfaceid": "14864729-c342-452f-8bb9-94895ac93ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73b00bb4-1307-466c-9ab7-098e44c86981", "address": "fa:16:3e:56:b6:55", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b00bb4-13", "ovs_interfaceid": "73b00bb4-1307-466c-9ab7-098e44c86981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "address": "fa:16:3e:c6:ce:13", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ef3b6e-7d", "ovs_interfaceid": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "address": "fa:16:3e:df:c6:8f", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap613cc4e1-ff", "ovs_interfaceid": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "address": "fa:16:3e:9c:65:37", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10f0761-24", "ovs_interfaceid": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:49:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fad69d31-3fc7-4756-81b1-624fe8fc7667 req-0115d0fa-f116-49d5-be1c-2ea8af69c18f service nova] Acquired lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:49:54 user nova-compute[72782]: DEBUG nova.network.neutron [req-fad69d31-3fc7-4756-81b1-624fe8fc7667 req-0115d0fa-f116-49d5-be1c-2ea8af69c18f service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Refreshing network info cache for port a10f0761-24bb-4ad9-bb7a-bc9961c576fc {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:49:55 user nova-compute[72782]: DEBUG nova.network.neutron [req-fad69d31-3fc7-4756-81b1-624fe8fc7667 req-0115d0fa-f116-49d5-be1c-2ea8af69c18f service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updated VIF entry in instance network info cache for port a10f0761-24bb-4ad9-bb7a-bc9961c576fc. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:49:55 user nova-compute[72782]: DEBUG nova.network.neutron [req-fad69d31-3fc7-4756-81b1-624fe8fc7667 req-0115d0fa-f116-49d5-be1c-2ea8af69c18f service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updating instance_info_cache with network_info: [{"id": "57339d04-6d3a-4eec-9ca2-bcd028028335", "address": "fa:16:3e:b3:73:cf", "network": {"id": "c9bb353d-5f85-45cd-9f62-a069db7c3dfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-255362601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57339d04-6d", "ovs_interfaceid": "57339d04-6d3a-4eec-9ca2-bcd028028335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55021cb8-5aac-42d2-898b-13b28995d3d8", "address": "fa:16:3e:ad:b1:39", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55021cb8-5a", "ovs_interfaceid": "55021cb8-5aac-42d2-898b-13b28995d3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14864729-c342-452f-8bb9-94895ac93ac3", "address": "fa:16:3e:b7:12:96", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14864729-c3", "ovs_interfaceid": "14864729-c342-452f-8bb9-94895ac93ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73b00bb4-1307-466c-9ab7-098e44c86981", "address": "fa:16:3e:56:b6:55", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b00bb4-13", "ovs_interfaceid": "73b00bb4-1307-466c-9ab7-098e44c86981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "address": "fa:16:3e:c6:ce:13", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ef3b6e-7d", "ovs_interfaceid": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "address": "fa:16:3e:df:c6:8f", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap613cc4e1-ff", "ovs_interfaceid": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "address": "fa:16:3e:9c:65:37", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10f0761-24", "ovs_interfaceid": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:49:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fad69d31-3fc7-4756-81b1-624fe8fc7667 req-0115d0fa-f116-49d5-be1c-2ea8af69c18f service nova] Releasing lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:49:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:49:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:01 user nova-compute[72782]: INFO nova.virt.block_device [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Booting with volume 09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 at /dev/vdc
Aug 14 19:50:01 user nova-compute[72782]: DEBUG os_brick.utils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6b55d9-1d94-409c-b797-e3c832484def]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c017178-a7c7-45d7-b10d-b6ae7633e523]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3bf296-1f72-4201-a80e-dc0677389615]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[847b38a4-fddc-42f8-a45c-9a0164ded49f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:50:01 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:50:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7954719a-b77e-4bdd-9161-488629d4d572]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG os_brick.utils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:50:01 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updating existing volume attachment record: 768fb53e-da48-4b79-8c42-ec0d27539a32 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:50:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:05 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:05 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:50:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 19:50:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Skipping network cache update for instance because it is Building. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nuShmHab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:50:06 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:50:06 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:50:06 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7fac5a-3bec-4623-af72-53f3974f28ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:50:06 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3c6bf6-fadf-48e9-a265-057407acec42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07] added
Aug 14 19:50:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d85656a-4355-463d-a3b0-7b912ad1968d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f872b5d-50ee-4065-8810-c2b0f4add990]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nuShmHab {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nuShmHab" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[675754e2-7c40-44d8-9b42-b7e0b0d51408]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nuShmHab'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94c30c8-ae5c-4ec7-ac5c-894dbb810808]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[812d9781-0437-4367-81bc-2f2149e641f2]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:50:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:50:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ea19b8-8f03-41c2-b9db-b39026e982c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07, portal: 172.16.0.220,3260]
Aug 14 19:50:06 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07, portal: 172.16.0.220,3260] successful.
Aug 14 19:50:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d77a009-b3dd-4dfb-9dee-07718d71e715]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4397fb6c-e23f-4e29-af6f-c3b8189df089]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:06 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:50:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:06 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:50:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[090ce7a9-c5d3-4f91-8c12-47b7d3e8c104]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:50:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nuShmHab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:50:07 user nova-compute[72782]: INFO nova.compute.claims [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Claim successful on node user
Aug 14 19:50:07 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Updating instance_info_cache with network_info: [{"id": "935f7dd0-e151-47aa-bcaf-a214f5854759", "address": "fa:16:3e:9a:a4:fc", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935f7dd0-e1", "ovs_interfaceid": "935f7dd0-e151-47aa-bcaf-a214f5854759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26230373630366131', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230373630366131', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG nova.objects.instance [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lazy-loading 'flavor' on Instance uuid 132b9b0b-9556-4aaf-a9ad-577e18215e84 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:50:07 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:50:07 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 19:50:07 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:50:07 user nova-compute[72782]:   <serial>00bc3052-85b8-4a79-b0e7-83799a0f4d07</serial>
Aug 14 19:50:07 user nova-compute[72782]: </disk>
Aug 14 19:50:07 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.378s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:50:07 user nova-compute[72782]: DEBUG nova.network.neutron [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:50:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:50:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:50:08 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Creating image(s)
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "/opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "/opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "/opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] No VIF found with MAC fa:16:3e:6a:36:8a, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG nova.policy [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa289079a7d841e98ee102cd64235e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298cebe33d4c4fc8bbe40ba77d058f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.251s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-71819167-4151-4645-b3b0-6ff755826da2 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.986s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.182s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-e47cee1b-2cb3-4696-88a2-23c0e84749a5 req-99e10757-ca6d-441e-99c3-87d0e7026a90 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Received event network-changed-35b9955c-a82a-42b9-a936-5f3429cda375 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-e47cee1b-2cb3-4696-88a2-23c0e84749a5 req-99e10757-ca6d-441e-99c3-87d0e7026a90 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Refreshing instance network info cache due to event network-changed-35b9955c-a82a-42b9-a936-5f3429cda375. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e47cee1b-2cb3-4696-88a2-23c0e84749a5 req-99e10757-ca6d-441e-99c3-87d0e7026a90 service nova] Acquiring lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e47cee1b-2cb3-4696-88a2-23c0e84749a5 req-99e10757-ca6d-441e-99c3-87d0e7026a90 service nova] Acquired lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG nova.network.neutron [req-e47cee1b-2cb3-4696-88a2-23c0e84749a5 req-99e10757-ca6d-441e-99c3-87d0e7026a90 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Refreshing network info cache for port 35b9955c-a82a-42b9-a936-5f3429cda375 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk 1073741824" returned: 0 in 0.060s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Checking if we can resize image /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Cannot resize image /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG nova.objects.instance [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lazy-loading 'migration_context' on Instance uuid 792f31f1-4079-4443-81f2-b1e364a9ee14 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Ensure instance console log exists: /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG nova.network.neutron [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Successfully created port: 5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG nova.network.neutron [req-e47cee1b-2cb3-4696-88a2-23c0e84749a5 req-99e10757-ca6d-441e-99c3-87d0e7026a90 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Updated VIF entry in instance network info cache for port 35b9955c-a82a-42b9-a936-5f3429cda375. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG nova.network.neutron [req-e47cee1b-2cb3-4696-88a2-23c0e84749a5 req-99e10757-ca6d-441e-99c3-87d0e7026a90 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Updating instance_info_cache with network_info: [{"id": "35b9955c-a82a-42b9-a936-5f3429cda375", "address": "fa:16:3e:36:7a:36", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b9955c-a8", "ovs_interfaceid": "35b9955c-a82a-42b9-a936-5f3429cda375", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e47cee1b-2cb3-4696-88a2-23c0e84749a5 req-99e10757-ca6d-441e-99c3-87d0e7026a90 service nova] Releasing lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG nova.network.neutron [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Successfully updated port: 5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquired lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:50:09 user nova-compute[72782]: DEBUG nova.network.neutron [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-3af541f0-d2d7-4297-a328-dea5c4130a61 req-ae7e99ef-e6b4-4b1d-8144-24f847549349 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received event network-changed-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-3af541f0-d2d7-4297-a328-dea5c4130a61 req-ae7e99ef-e6b4-4b1d-8144-24f847549349 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Refreshing instance network info cache due to event network-changed-5fae61f6-03b8-4f93-8719-be8733d8590c. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3af541f0-d2d7-4297-a328-dea5c4130a61 req-ae7e99ef-e6b4-4b1d-8144-24f847549349 service nova] Acquiring lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.network.neutron [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.network.neutron [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Updating instance_info_cache with network_info: [{"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Releasing lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.compute.manager [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Instance network_info: |[{"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3af541f0-d2d7-4297-a328-dea5c4130a61 req-ae7e99ef-e6b4-4b1d-8144-24f847549349 service nova] Acquired lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.network.neutron [req-3af541f0-d2d7-4297-a328-dea5c4130a61 req-ae7e99ef-e6b4-4b1d-8144-24f847549349 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Refreshing network info cache for port 5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Start _get_guest_xml network_info=[{"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:50:10 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:50:10 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:50:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1266743551',display_name='tempest-ServerStableDeviceRescueTest-server-1266743551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1266743551',id=16,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSok8m3pECKylKQt4YbbZRBTqI/K6QdxgBYm6xS5vItg57TPvNxoDIiZG9IxLRCkXCktrW8ZYajxM3mSjn3o49kO+4ovNEETfwGQPkB2hcGmJRPHkPrqcDv4Htsp18h0Q==',key_name='tempest-keypair-18432526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='298cebe33d4c4fc8bbe40ba77d058f64',ramdisk_id='',reservation_id='r-isa0e3fk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2103058258',owner_user_name='tempest-ServerStableDeviceRescueTest-2103058258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa289079a7d841e98ee102cd64235e92',uuid=792f31f1-4079-4443-81f2-b1e364a9ee14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Converting VIF {"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:85:34,bridge_name='br-int',has_traffic_filtering=True,id=5fae61f6-03b8-4f93-8719-be8733d8590c,network=Network(86853807-fa05-438d-9f70-cca7e9ed06bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fae61f6-03') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.objects.instance [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lazy-loading 'pci_devices' on Instance uuid 792f31f1-4079-4443-81f2-b1e364a9ee14 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:50:10 user nova-compute[72782]:   <uuid>792f31f1-4079-4443-81f2-b1e364a9ee14</uuid>
Aug 14 19:50:10 user nova-compute[72782]:   <name>instance-00000010</name>
Aug 14 19:50:10 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:50:10 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:50:10 user nova-compute[72782]:   <metadata>
Aug 14 19:50:10 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:50:10 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:50:10 user nova-compute[72782]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1266743551</nova:name>
Aug 14 19:50:10 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:50:10</nova:creationTime>
Aug 14 19:50:10 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:50:10 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:50:10 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:50:10 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:50:10 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:50:10 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:50:10 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:50:10 user nova-compute[72782]:       <nova:owner>
Aug 14 19:50:10 user nova-compute[72782]:         <nova:user uuid="aa289079a7d841e98ee102cd64235e92">tempest-ServerStableDeviceRescueTest-2103058258-project-member</nova:user>
Aug 14 19:50:10 user nova-compute[72782]:         <nova:project uuid="298cebe33d4c4fc8bbe40ba77d058f64">tempest-ServerStableDeviceRescueTest-2103058258</nova:project>
Aug 14 19:50:10 user nova-compute[72782]:       </nova:owner>
Aug 14 19:50:10 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:50:10 user nova-compute[72782]:       <nova:ports>
Aug 14 19:50:10 user nova-compute[72782]:         <nova:port uuid="5fae61f6-03b8-4f93-8719-be8733d8590c">
Aug 14 19:50:10 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 19:50:10 user nova-compute[72782]:         </nova:port>
Aug 14 19:50:10 user nova-compute[72782]:       </nova:ports>
Aug 14 19:50:10 user nova-compute[72782]:     </nova:instance>
Aug 14 19:50:10 user nova-compute[72782]:   </metadata>
Aug 14 19:50:10 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:50:10 user nova-compute[72782]:     <system>
Aug 14 19:50:10 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:50:10 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:50:10 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:50:10 user nova-compute[72782]:       <entry name="serial">792f31f1-4079-4443-81f2-b1e364a9ee14</entry>
Aug 14 19:50:10 user nova-compute[72782]:       <entry name="uuid">792f31f1-4079-4443-81f2-b1e364a9ee14</entry>
Aug 14 19:50:10 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:50:10 user nova-compute[72782]:     </system>
Aug 14 19:50:10 user nova-compute[72782]:   </sysinfo>
Aug 14 19:50:10 user nova-compute[72782]:   <os>
Aug 14 19:50:10 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:50:10 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:50:10 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:50:10 user nova-compute[72782]:   </os>
Aug 14 19:50:10 user nova-compute[72782]:   <features>
Aug 14 19:50:10 user nova-compute[72782]:     <acpi/>
Aug 14 19:50:10 user nova-compute[72782]:     <apic/>
Aug 14 19:50:10 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:50:10 user nova-compute[72782]:   </features>
Aug 14 19:50:10 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:50:10 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:50:10 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:50:10 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:50:10 user nova-compute[72782]:   </clock>
Aug 14 19:50:10 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:50:10 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:50:10 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:50:10 user nova-compute[72782]:   </cpu>
Aug 14 19:50:10 user nova-compute[72782]:   <devices>
Aug 14 19:50:10 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:50:10 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:50:10 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk"/>
Aug 14 19:50:10 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:50:10 user nova-compute[72782]:     </disk>
Aug 14 19:50:10 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:50:10 user nova-compute[72782]:       <mac address="fa:16:3e:5d:85:34"/>
Aug 14 19:50:10 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:50:10 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:50:10 user nova-compute[72782]:       <target dev="tap5fae61f6-03"/>
Aug 14 19:50:10 user nova-compute[72782]:     </interface>
Aug 14 19:50:10 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:50:10 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/console.log" append="off"/>
Aug 14 19:50:10 user nova-compute[72782]:     </serial>
Aug 14 19:50:10 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:50:10 user nova-compute[72782]:     <video>
Aug 14 19:50:10 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:50:10 user nova-compute[72782]:     </video>
Aug 14 19:50:10 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:50:10 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:50:10 user nova-compute[72782]:     </rng>
Aug 14 19:50:10 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:50:10 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:50:10 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:50:10 user nova-compute[72782]:     </memballoon>
Aug 14 19:50:10 user nova-compute[72782]:   </devices>
Aug 14 19:50:10 user nova-compute[72782]: </domain>
Aug 14 19:50:10 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:50:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1266743551',display_name='tempest-ServerStableDeviceRescueTest-server-1266743551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1266743551',id=16,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSok8m3pECKylKQt4YbbZRBTqI/K6QdxgBYm6xS5vItg57TPvNxoDIiZG9IxLRCkXCktrW8ZYajxM3mSjn3o49kO+4ovNEETfwGQPkB2hcGmJRPHkPrqcDv4Htsp18h0Q==',key_name='tempest-keypair-18432526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='298cebe33d4c4fc8bbe40ba77d058f64',ramdisk_id='',reservation_id='r-isa0e3fk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2103058258',owner_user_name='tempest-ServerStableDeviceRescueTest-2103058258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa289079a7d841e98ee102cd64235e92',uuid=792f31f1-4079-4443-81f2-b1e364a9ee14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Converting VIF {"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:85:34,bridge_name='br-int',has_traffic_filtering=True,id=5fae61f6-03b8-4f93-8719-be8733d8590c,network=Network(86853807-fa05-438d-9f70-cca7e9ed06bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fae61f6-03') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG os_vif [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:85:34,bridge_name='br-int',has_traffic_filtering=True,id=5fae61f6-03b8-4f93-8719-be8733d8590c,network=Network(86853807-fa05-438d-9f70-cca7e9ed06bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fae61f6-03') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fae61f6-03, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5fae61f6-03, col_values=(('external_ids', {'iface-id': '5fae61f6-03b8-4f93-8719-be8733d8590c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:85:34', 'vm-uuid': '792f31f1-4079-4443-81f2-b1e364a9ee14'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:10 user nova-compute[72782]: INFO os_vif [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:85:34,bridge_name='br-int',has_traffic_filtering=True,id=5fae61f6-03b8-4f93-8719-be8733d8590c,network=Network(86853807-fa05-438d-9f70-cca7e9ed06bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fae61f6-03')
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] No VIF found with MAC fa:16:3e:5d:85:34, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:50:14 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042614.673412, 792f31f1-4079-4443-81f2-b1e364a9ee14 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:50:14 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] VM Resumed (Lifecycle Event)
Aug 14 19:50:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-895d7028-acf0-48fc-9610-a032bac667b8 req-8d491ace-1e8e-4926-8fff-84bc509e46b8 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received event network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-895d7028-acf0-48fc-9610-a032bac667b8 req-8d491ace-1e8e-4926-8fff-84bc509e46b8 service nova] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-895d7028-acf0-48fc-9610-a032bac667b8 req-8d491ace-1e8e-4926-8fff-84bc509e46b8 service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-895d7028-acf0-48fc-9610-a032bac667b8 req-8d491ace-1e8e-4926-8fff-84bc509e46b8 service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-895d7028-acf0-48fc-9610-a032bac667b8 req-8d491ace-1e8e-4926-8fff-84bc509e46b8 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] No waiting events found dispatching network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:14 user nova-compute[72782]: WARNING nova.compute.manager [req-895d7028-acf0-48fc-9610-a032bac667b8 req-8d491ace-1e8e-4926-8fff-84bc509e46b8 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received unexpected event network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c for instance with vm_state building and task_state spawning.
Aug 14 19:50:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:50:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:50:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:50:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:14 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Instance spawned successfully.
Aug 14 19:50:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:50:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:50:14 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:50:14 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:50:14 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7849MB free_disk=25.787132263183594GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:50:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.objects.instance [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lazy-loading 'flavor' on Instance uuid 132b9b0b-9556-4aaf-a9ad-577e18215e84 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:50:15 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042614.673602, 792f31f1-4079-4443-81f2-b1e364a9ee14 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:50:15 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] VM Started (Lifecycle Event)
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:15 user nova-compute[72782]: INFO nova.compute.manager [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Took 6.98 seconds to spawn the instance on the hypervisor.
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:50:15 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:50:15 user nova-compute[72782]: INFO nova.compute.manager [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Took 7.91 seconds to build instance.
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 132b9b0b-9556-4aaf-a9ad-577e18215e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance d334dc9b-8b50-41bb-b0e8-73dda305f590 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 792f31f1-4079-4443-81f2-b1e364a9ee14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28697f19-8b78-4c22-b40c-2ea331d339a2 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.041s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.compute.manager [req-9ee637dd-4a94-4ea5-9c6d-e2d56a601c2a req-e574a0bc-d23a-4172-b8e4-b31ee22023fc service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received event network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9ee637dd-4a94-4ea5-9c6d-e2d56a601c2a req-e574a0bc-d23a-4172-b8e4-b31ee22023fc service nova] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9ee637dd-4a94-4ea5-9c6d-e2d56a601c2a req-e574a0bc-d23a-4172-b8e4-b31ee22023fc service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9ee637dd-4a94-4ea5-9c6d-e2d56a601c2a req-e574a0bc-d23a-4172-b8e4-b31ee22023fc service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.compute.manager [req-9ee637dd-4a94-4ea5-9c6d-e2d56a601c2a req-e574a0bc-d23a-4172-b8e4-b31ee22023fc service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] No waiting events found dispatching network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:15 user nova-compute[72782]: WARNING nova.compute.manager [req-9ee637dd-4a94-4ea5-9c6d-e2d56a601c2a req-e574a0bc-d23a-4172-b8e4-b31ee22023fc service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received unexpected event network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c for instance with vm_state active and task_state None.
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:50:15 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Creating image(s)
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Did not create local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Ensure instance console log exists: /opt/stack/data/nova/instances/d334dc9b-8b50-41bb-b0e8-73dda305f590/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Start _get_guest_xml network_info=[{"id": "57339d04-6d3a-4eec-9ca2-bcd028028335", "address": "fa:16:3e:b3:73:cf", "network": {"id": "c9bb353d-5f85-45cd-9f62-a069db7c3dfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-255362601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57339d04-6d", "ovs_interfaceid": "57339d04-6d3a-4eec-9ca2-bcd028028335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55021cb8-5aac-42d2-898b-13b28995d3d8", "address": "fa:16:3e:ad:b1:39", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55021cb8-5a", "ovs_interfaceid": "55021cb8-5aac-42d2-898b-13b28995d3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14864729-c342-452f-8bb9-94895ac93ac3", "address": "fa:16:3e:b7:12:96", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14864729-c3", "ovs_interfaceid": "14864729-c342-452f-8bb9-94895ac93ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73b00bb4-1307-466c-9ab7-098e44c86981", "address": "fa:16:3e:56:b6:55", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b00bb4-13", "ovs_interfaceid": "73b00bb4-1307-466c-9ab7-098e44c86981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "address": "fa:16:3e:c6:ce:13", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ef3b6e-7d", "ovs_interfaceid": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "address": "fa:16:3e:df:c6:8f", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap613cc4e1-ff", "ovs_interfaceid": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "address": "fa:16:3e:9c:65:37", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10f0761-24", "ovs_interfaceid": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '2b95557e-51b3-4846-99f9-7d6ac6c5e398', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpiKMSwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd334dc9b-8b50-41bb-b0e8-73dda305f590', 'attached_at': '', 'detached_at': '', 'volume_id': '2b993f06-57e2-4344-962e-8c9db32e0cba', 'serial': '2b993f06-57e2-4344-962e-8c9db32e0cba'}, 'volume_type': None}, {'guest_format': None, 'attachment_id': '2f4062f2-a44f-4e29-a650-39d4b75d23c5', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': 1, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfvNYxkq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd334dc9b-8b50-41bb-b0e8-73dda305f590', 'attached_at': '', 'detached_at': '', 'volume_id': 'c50a685a-247d-4bbd-b1de-6cf0cb96b725', 'serial': 'c50a685a-247d-4bbd-b1de-6cf0cb96b725'}, 'volume_type': None}, {'guest_format': None, 'attachment_id': '768fb53e-da48-4b79-8c42-ec0d27539a32', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'boot_index': 2, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kRJiMjND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd334dc9b-8b50-41bb-b0e8-73dda305f590', 'attached_at': '', 'detached_at': '', 'volume_id': '09a74c20-8f91-4d9a-a6f5-e92efef3a5a2', 'serial': '09a74c20-8f91-4d9a-a6f5-e92efef3a5a2'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:15 user nova-compute[72782]: INFO nova.compute.manager [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Attaching volume 8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 to /dev/vdc
Aug 14 19:50:15 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:50:15 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpiKMSwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:50:15 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:50:15 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:50:15 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.utils [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7146412e-f160-45ae-b8d0-2ae03d82df4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.033s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a926257-b39d-4f4a-ac67-e6a6060359b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:50:15 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[606b4e59-a695-46f1-aa1e-0621d8bf5747]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba] added
Aug 14 19:50:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.036s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[36262426-1e5c-43d0-b472-bc362121c055]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2a4c26-d93c-4235-8e39-ab6b60c27a08]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[953e2189-5b5a-44c1-886c-862d169bd367]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7149bed3-ab60-4c9f-8027-e9ebe9c660b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd037eae-b9b0-47aa-80c6-65fe130bbfac]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bpiKMSwm {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:50:15 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[616b4670-2a67-4cfd-ba60-2b73ed397bc9]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.utils [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] <== get_connector_properties: return (220ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Updating existing volume attachment record: eb51aa88-50ca-4c32-bb8d-3e28d2c81878 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bpiKMSwm" returned: 0 in 0.036s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[743ccc53-f710-4f6a-8ab6-9c07db6c7fcf]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bpiKMSwm'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8737c0b9-3864-4929-bebe-71e0de5c9f82]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.network.neutron [req-3af541f0-d2d7-4297-a328-dea5c4130a61 req-ae7e99ef-e6b4-4b1d-8144-24f847549349 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Updated VIF entry in instance network info cache for port 5fae61f6-03b8-4f93-8719-be8733d8590c. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.network.neutron [req-3af541f0-d2d7-4297-a328-dea5c4130a61 req-ae7e99ef-e6b4-4b1d-8144-24f847549349 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Updating instance_info_cache with network_info: [{"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b27f90f-525a-4e1b-9430-77d6ba9eede8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:15 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:50:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:15 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:50:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3af541f0-d2d7-4297-a328-dea5c4130a61 req-ae7e99ef-e6b4-4b1d-8144-24f847549349 service nova] Releasing lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b33dd2-c8b6-4b7f-938a-0bb4f4c5e396]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba, portal: 172.16.0.220,3260]
Aug 14 19:50:15 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba, portal: 172.16.0.220,3260] successful.
Aug 14 19:50:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.806s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ce4813-a810-4ffe-b752-4341f1e3f229]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a982be2-89d7-4415-890c-024a6e1e3eb4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:15 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:15 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:50:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:15 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:15 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:50:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.465s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa1f4ae-1508-42d8-a8da-ff37e9558c95]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:50:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpiKMSwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:50:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.514s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:50:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] <== connect_volume: return (1517ms) {'type': 'block', 'scsi_wwn': '23633666565643136', 'path': '/dev/sdc'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:50:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633666565643136', 'path': '/dev/sdc'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:50:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:50:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfvNYxkq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:50:16 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:50:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:50:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:50:16 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:50:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:50:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:50:16 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:50:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:16 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae076f9-85a9-4214-aff1-4b3d5dc397ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:50:16 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[85905bea-4741-4c9e-93e9-56298ed09ff8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725] added
Aug 14 19:50:17 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce342697-784d-4608-b05f-96a1520c9613]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[335d15d0-ea28-4501-8b83-96d5e6049bd5]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KfvNYxkq {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KfvNYxkq" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e397b96-f3ba-4f18-a64a-fe092ed3b7dc]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KfvNYxkq'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e0fbf4-490c-44cf-bb61-8c17ec4b9618]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f5a23e-7523-4386-8b01-b839d95c4e06]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:17 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:17 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:50:17 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:17 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:17 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:50:17 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[98127ef1-b55b-47f9-9871-0e1174ac6202]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725, portal: 172.16.0.220,3260]
Aug 14 19:50:17 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725, portal: 172.16.0.220,3260] successful.
Aug 14 19:50:17 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e4ad07-d551-451c-b3a8-395740c4aee9]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[904783a4-f6fc-4394-b674-c8c7dc43fb30]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:17 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:17 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:17 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:50:17 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:17 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:17 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:17 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:50:17 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.033s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[32617ba6-a54f-4e15-907f-d325d1cad509]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: None {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfvNYxkq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '23539396334316235', 'path': '/dev/sdd'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539396334316235', 'path': '/dev/sdd'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kRJiMjND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:50:18 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:50:18 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:50:18 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a690b8c5-f964-40f4-977c-69c6b7335b60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:50:18 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6377fab-c886-4720-ada9-1751bb16dbe6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2] added
Aug 14 19:50:18 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c85adc-4277-4840-bb4a-343f54cfb17b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ad81d3-333c-4ab7-ab81-2ba5b719f5fe]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kRJiMjND {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kRJiMjND" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e07923-c316-4a53-812e-c4ecf317dbb8]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kRJiMjND'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6035f1e-a148-4340-ac08-d89fae3c4540]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fda0417-ebce-46a7-a20b-791e67baddbc]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:18 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:18 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:18 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:50:18 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:18 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:18 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:18 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:50:18 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc16eb1-eded-4797-bea2-3eeff702a894]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2, portal: 172.16.0.220,3260]
Aug 14 19:50:18 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2, portal: 172.16.0.220,3260] successful.
Aug 14 19:50:18 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[13810f89-16af-467f-9d8d-0103b93f4406]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a227ee5f-5aed-4664-9ba0-f2df0acb24bf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:18 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:18 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:18 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:50:18 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:50:18 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:18 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:18 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:18 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:50:18 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:50:18 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.434s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ed661d-9efe-4ee7-9dd7-6ec4fc0fab03]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:50:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kRJiMjND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] <== connect_volume: return (1490ms) {'type': 'block', 'scsi_wwn': '26639343561623734', 'path': '/dev/sde'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639343561623734', 'path': '/dev/sde'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57339d04-6d3a-4eec-9ca2-bcd028028335", "address": "fa:16:3e:b3:73:cf", "network": {"id": "c9bb353d-5f85-45cd-9f62-a069db7c3dfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-255362601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57339d04-6d", "ovs_interfaceid": "57339d04-6d3a-4eec-9ca2-bcd028028335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "57339d04-6d3a-4eec-9ca2-bcd028028335", "address": "fa:16:3e:b3:73:cf", "network": {"id": "c9bb353d-5f85-45cd-9f62-a069db7c3dfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-255362601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57339d04-6d", "ovs_interfaceid": "57339d04-6d3a-4eec-9ca2-bcd028028335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:73:cf,bridge_name='br-int',has_traffic_filtering=True,id=57339d04-6d3a-4eec-9ca2-bcd028028335,network=Network(c9bb353d-5f85-45cd-9f62-a069db7c3dfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57339d04-6d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55021cb8-5aac-42d2-898b-13b28995d3d8", "address": "fa:16:3e:ad:b1:39", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55021cb8-5a", "ovs_interfaceid": "55021cb8-5aac-42d2-898b-13b28995d3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "55021cb8-5aac-42d2-898b-13b28995d3d8", "address": "fa:16:3e:ad:b1:39", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55021cb8-5a", "ovs_interfaceid": "55021cb8-5aac-42d2-898b-13b28995d3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=55021cb8-5aac-42d2-898b-13b28995d3d8,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55021cb8-5a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14864729-c342-452f-8bb9-94895ac93ac3", "address": "fa:16:3e:b7:12:96", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14864729-c3", "ovs_interfaceid": "14864729-c342-452f-8bb9-94895ac93ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "14864729-c342-452f-8bb9-94895ac93ac3", "address": "fa:16:3e:b7:12:96", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14864729-c3", "ovs_interfaceid": "14864729-c342-452f-8bb9-94895ac93ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:12:96,bridge_name='br-int',has_traffic_filtering=True,id=14864729-c342-452f-8bb9-94895ac93ac3,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14864729-c3') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73b00bb4-1307-466c-9ab7-098e44c86981", "address": "fa:16:3e:56:b6:55", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b00bb4-13", "ovs_interfaceid": "73b00bb4-1307-466c-9ab7-098e44c86981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "73b00bb4-1307-466c-9ab7-098e44c86981", "address": "fa:16:3e:56:b6:55", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b00bb4-13", "ovs_interfaceid": "73b00bb4-1307-466c-9ab7-098e44c86981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:b6:55,bridge_name='br-int',has_traffic_filtering=True,id=73b00bb4-1307-466c-9ab7-098e44c86981,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b00bb4-13') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "address": "fa:16:3e:c6:ce:13", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ef3b6e-7d", "ovs_interfaceid": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "address": "fa:16:3e:c6:ce:13", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ef3b6e-7d", "ovs_interfaceid": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ce:13,bridge_name='br-int',has_traffic_filtering=True,id=15ef3b6e-7de5-4089-96fd-3b41433c9738,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15ef3b6e-7d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "address": "fa:16:3e:df:c6:8f", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap613cc4e1-ff", "ovs_interfaceid": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "address": "fa:16:3e:df:c6:8f", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap613cc4e1-ff", "ovs_interfaceid": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:c6:8f,bridge_name='br-int',has_traffic_filtering=True,id=613cc4e1-ffff-4180-b0da-0ec02646f55c,network=Network(67f03e30-a12c-4777-9054-42ea6e22f1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap613cc4e1-ff') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "address": "fa:16:3e:9c:65:37", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10f0761-24", "ovs_interfaceid": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "address": "fa:16:3e:9c:65:37", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10f0761-24", "ovs_interfaceid": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:65:37,bridge_name='br-int',has_traffic_filtering=True,id=a10f0761-24bb-4ad9-bb7a-bc9961c576fc,network=Network(67f03e30-a12c-4777-9054-42ea6e22f1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa10f0761-24') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.objects.instance [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lazy-loading 'pci_devices' on Instance uuid d334dc9b-8b50-41bb-b0e8-73dda305f590 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:50:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:50:19 user nova-compute[72782]:   <uuid>d334dc9b-8b50-41bb-b0e8-73dda305f590</uuid>
Aug 14 19:50:19 user nova-compute[72782]:   <name>instance-0000000f</name>
Aug 14 19:50:19 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:50:19 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:50:19 user nova-compute[72782]:   <metadata>
Aug 14 19:50:19 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:50:19 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:50:19 user nova-compute[72782]:       <nova:name>tempest-device-tagging-server-1114133347</nova:name>
Aug 14 19:50:19 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:50:15</nova:creationTime>
Aug 14 19:50:19 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:50:19 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:50:19 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:50:19 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:50:19 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:50:19 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:50:19 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:50:19 user nova-compute[72782]:       <nova:owner>
Aug 14 19:50:19 user nova-compute[72782]:         <nova:user uuid="860c5b3f201f421488b838ff368b692e">tempest-TaggedBootDevicesTest-1869060357-project-member</nova:user>
Aug 14 19:50:19 user nova-compute[72782]:         <nova:project uuid="b6fcb670ad7a401d93224e690fc674a1">tempest-TaggedBootDevicesTest-1869060357</nova:project>
Aug 14 19:50:19 user nova-compute[72782]:       </nova:owner>
Aug 14 19:50:19 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:50:19 user nova-compute[72782]:       <nova:ports>
Aug 14 19:50:19 user nova-compute[72782]:         <nova:port uuid="57339d04-6d3a-4eec-9ca2-bcd028028335">
Aug 14 19:50:19 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 19:50:19 user nova-compute[72782]:         </nova:port>
Aug 14 19:50:19 user nova-compute[72782]:         <nova:port uuid="55021cb8-5aac-42d2-898b-13b28995d3d8">
Aug 14 19:50:19 user nova-compute[72782]:           <nova:ip type="fixed" address="10.1.1.147" ipVersion="4"/>
Aug 14 19:50:19 user nova-compute[72782]:         </nova:port>
Aug 14 19:50:19 user nova-compute[72782]:         <nova:port uuid="14864729-c342-452f-8bb9-94895ac93ac3">
Aug 14 19:50:19 user nova-compute[72782]:           <nova:ip type="fixed" address="10.1.1.130" ipVersion="4"/>
Aug 14 19:50:19 user nova-compute[72782]:         </nova:port>
Aug 14 19:50:19 user nova-compute[72782]:         <nova:port uuid="73b00bb4-1307-466c-9ab7-098e44c86981">
Aug 14 19:50:19 user nova-compute[72782]:           <nova:ip type="fixed" address="10.1.1.145" ipVersion="4"/>
Aug 14 19:50:19 user nova-compute[72782]:         </nova:port>
Aug 14 19:50:19 user nova-compute[72782]:         <nova:port uuid="15ef3b6e-7de5-4089-96fd-3b41433c9738">
Aug 14 19:50:19 user nova-compute[72782]:           <nova:ip type="fixed" address="10.1.1.198" ipVersion="4"/>
Aug 14 19:50:19 user nova-compute[72782]:         </nova:port>
Aug 14 19:50:19 user nova-compute[72782]:         <nova:port uuid="613cc4e1-ffff-4180-b0da-0ec02646f55c">
Aug 14 19:50:19 user nova-compute[72782]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 14 19:50:19 user nova-compute[72782]:         </nova:port>
Aug 14 19:50:19 user nova-compute[72782]:         <nova:port uuid="a10f0761-24bb-4ad9-bb7a-bc9961c576fc">
Aug 14 19:50:19 user nova-compute[72782]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 14 19:50:19 user nova-compute[72782]:         </nova:port>
Aug 14 19:50:19 user nova-compute[72782]:       </nova:ports>
Aug 14 19:50:19 user nova-compute[72782]:     </nova:instance>
Aug 14 19:50:19 user nova-compute[72782]:   </metadata>
Aug 14 19:50:19 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:50:19 user nova-compute[72782]:     <system>
Aug 14 19:50:19 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:50:19 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:50:19 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:50:19 user nova-compute[72782]:       <entry name="serial">d334dc9b-8b50-41bb-b0e8-73dda305f590</entry>
Aug 14 19:50:19 user nova-compute[72782]:       <entry name="uuid">d334dc9b-8b50-41bb-b0e8-73dda305f590</entry>
Aug 14 19:50:19 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:50:19 user nova-compute[72782]:     </system>
Aug 14 19:50:19 user nova-compute[72782]:   </sysinfo>
Aug 14 19:50:19 user nova-compute[72782]:   <os>
Aug 14 19:50:19 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:50:19 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:50:19 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:50:19 user nova-compute[72782]:   </os>
Aug 14 19:50:19 user nova-compute[72782]:   <features>
Aug 14 19:50:19 user nova-compute[72782]:     <acpi/>
Aug 14 19:50:19 user nova-compute[72782]:     <apic/>
Aug 14 19:50:19 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:50:19 user nova-compute[72782]:   </features>
Aug 14 19:50:19 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:50:19 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:50:19 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:50:19 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:50:19 user nova-compute[72782]:   </clock>
Aug 14 19:50:19 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:50:19 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:50:19 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:50:19 user nova-compute[72782]:   </cpu>
Aug 14 19:50:19 user nova-compute[72782]:   <devices>
Aug 14 19:50:19 user nova-compute[72782]:     <disk type="file" device="cdrom">
Aug 14 19:50:19 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 19:50:19 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/d334dc9b-8b50-41bb-b0e8-73dda305f590/disk.config"/>
Aug 14 19:50:19 user nova-compute[72782]:       <target dev="hda" bus="ide"/>
Aug 14 19:50:19 user nova-compute[72782]:     </disk>
Aug 14 19:50:19 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 19:50:19 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:50:19 user nova-compute[72782]:       <source dev="/dev/sdc"/>
Aug 14 19:50:19 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:50:19 user nova-compute[72782]:       <serial>2b993f06-57e2-4344-962e-8c9db32e0cba</serial>
Aug 14 19:50:19 user nova-compute[72782]:     </disk>
Aug 14 19:50:19 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 19:50:19 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:50:19 user nova-compute[72782]:       <source dev="/dev/sdd"/>
Aug 14 19:50:19 user nova-compute[72782]:       <target dev="vdb" bus="virtio"/>
Aug 14 19:50:19 user nova-compute[72782]:       <serial>c50a685a-247d-4bbd-b1de-6cf0cb96b725</serial>
Aug 14 19:50:19 user nova-compute[72782]:     </disk>
Aug 14 19:50:19 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 19:50:19 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:50:19 user nova-compute[72782]:       <source dev="/dev/sde"/>
Aug 14 19:50:19 user nova-compute[72782]:       <target dev="vdc" bus="virtio"/>
Aug 14 19:50:19 user nova-compute[72782]:       <serial>09a74c20-8f91-4d9a-a6f5-e92efef3a5a2</serial>
Aug 14 19:50:19 user nova-compute[72782]:     </disk>
Aug 14 19:50:19 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:50:19 user nova-compute[72782]:       <mac address="fa:16:3e:b3:73:cf"/>
Aug 14 19:50:19 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:50:19 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:50:19 user nova-compute[72782]:       <target dev="tap57339d04-6d"/>
Aug 14 19:50:19 user nova-compute[72782]:     </interface>
Aug 14 19:50:19 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:50:19 user nova-compute[72782]:       <mac address="fa:16:3e:ad:b1:39"/>
Aug 14 19:50:19 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:50:19 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:50:19 user nova-compute[72782]:       <target dev="tap55021cb8-5a"/>
Aug 14 19:50:19 user nova-compute[72782]:     </interface>
Aug 14 19:50:19 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:50:19 user nova-compute[72782]:       <mac address="fa:16:3e:b7:12:96"/>
Aug 14 19:50:19 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:50:19 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:50:19 user nova-compute[72782]:       <target dev="tap14864729-c3"/>
Aug 14 19:50:19 user nova-compute[72782]:     </interface>
Aug 14 19:50:19 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:50:19 user nova-compute[72782]:       <mac address="fa:16:3e:56:b6:55"/>
Aug 14 19:50:19 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:50:19 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:50:19 user nova-compute[72782]:       <target dev="tap73b00bb4-13"/>
Aug 14 19:50:19 user nova-compute[72782]:     </interface>
Aug 14 19:50:19 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:50:19 user nova-compute[72782]:       <mac address="fa:16:3e:c6:ce:13"/>
Aug 14 19:50:19 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:50:19 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:50:19 user nova-compute[72782]:       <target dev="tap15ef3b6e-7d"/>
Aug 14 19:50:19 user nova-compute[72782]:     </interface>
Aug 14 19:50:19 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:50:19 user nova-compute[72782]:       <mac address="fa:16:3e:df:c6:8f"/>
Aug 14 19:50:19 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:50:19 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:50:19 user nova-compute[72782]:       <target dev="tap613cc4e1-ff"/>
Aug 14 19:50:19 user nova-compute[72782]:     </interface>
Aug 14 19:50:19 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:50:19 user nova-compute[72782]:       <mac address="fa:16:3e:9c:65:37"/>
Aug 14 19:50:19 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:50:19 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:50:19 user nova-compute[72782]:       <target dev="tapa10f0761-24"/>
Aug 14 19:50:19 user nova-compute[72782]:     </interface>
Aug 14 19:50:19 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:50:19 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/d334dc9b-8b50-41bb-b0e8-73dda305f590/console.log" append="off"/>
Aug 14 19:50:19 user nova-compute[72782]:     </serial>
Aug 14 19:50:19 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:50:19 user nova-compute[72782]:     <video>
Aug 14 19:50:19 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:50:19 user nova-compute[72782]:     </video>
Aug 14 19:50:19 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:50:19 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:50:19 user nova-compute[72782]:     </rng>
Aug 14 19:50:19 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:50:19 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:50:19 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:50:19 user nova-compute[72782]:     </memballoon>
Aug 14 19:50:19 user nova-compute[72782]:   </devices>
Aug 14 19:50:19 user nova-compute[72782]: </domain>
Aug 14 19:50:19 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57339d04-6d3a-4eec-9ca2-bcd028028335", "address": "fa:16:3e:b3:73:cf", "network": {"id": "c9bb353d-5f85-45cd-9f62-a069db7c3dfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-255362601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57339d04-6d", "ovs_interfaceid": "57339d04-6d3a-4eec-9ca2-bcd028028335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "57339d04-6d3a-4eec-9ca2-bcd028028335", "address": "fa:16:3e:b3:73:cf", "network": {"id": "c9bb353d-5f85-45cd-9f62-a069db7c3dfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-255362601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57339d04-6d", "ovs_interfaceid": "57339d04-6d3a-4eec-9ca2-bcd028028335", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:73:cf,bridge_name='br-int',has_traffic_filtering=True,id=57339d04-6d3a-4eec-9ca2-bcd028028335,network=Network(c9bb353d-5f85-45cd-9f62-a069db7c3dfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57339d04-6d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG os_vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:73:cf,bridge_name='br-int',has_traffic_filtering=True,id=57339d04-6d3a-4eec-9ca2-bcd028028335,network=Network(c9bb353d-5f85-45cd-9f62-a069db7c3dfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57339d04-6d') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57339d04-6d, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap57339d04-6d, col_values=(('external_ids', {'iface-id': '57339d04-6d3a-4eec-9ca2-bcd028028335', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:73:cf', 'vm-uuid': 'd334dc9b-8b50-41bb-b0e8-73dda305f590'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: INFO os_vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:73:cf,bridge_name='br-int',has_traffic_filtering=True,id=57339d04-6d3a-4eec-9ca2-bcd028028335,network=Network(c9bb353d-5f85-45cd-9f62-a069db7c3dfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57339d04-6d')
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55021cb8-5aac-42d2-898b-13b28995d3d8", "address": "fa:16:3e:ad:b1:39", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55021cb8-5a", "ovs_interfaceid": "55021cb8-5aac-42d2-898b-13b28995d3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "55021cb8-5aac-42d2-898b-13b28995d3d8", "address": "fa:16:3e:ad:b1:39", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55021cb8-5a", "ovs_interfaceid": "55021cb8-5aac-42d2-898b-13b28995d3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=55021cb8-5aac-42d2-898b-13b28995d3d8,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55021cb8-5a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG os_vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=55021cb8-5aac-42d2-898b-13b28995d3d8,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55021cb8-5a') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55021cb8-5a, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55021cb8-5a, col_values=(('external_ids', {'iface-id': '55021cb8-5aac-42d2-898b-13b28995d3d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:b1:39', 'vm-uuid': 'd334dc9b-8b50-41bb-b0e8-73dda305f590'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: INFO os_vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=55021cb8-5aac-42d2-898b-13b28995d3d8,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55021cb8-5a')
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14864729-c342-452f-8bb9-94895ac93ac3", "address": "fa:16:3e:b7:12:96", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14864729-c3", "ovs_interfaceid": "14864729-c342-452f-8bb9-94895ac93ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "14864729-c342-452f-8bb9-94895ac93ac3", "address": "fa:16:3e:b7:12:96", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14864729-c3", "ovs_interfaceid": "14864729-c342-452f-8bb9-94895ac93ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:12:96,bridge_name='br-int',has_traffic_filtering=True,id=14864729-c342-452f-8bb9-94895ac93ac3,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14864729-c3') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG os_vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:12:96,bridge_name='br-int',has_traffic_filtering=True,id=14864729-c342-452f-8bb9-94895ac93ac3,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14864729-c3') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14864729-c3, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap14864729-c3, col_values=(('external_ids', {'iface-id': '14864729-c342-452f-8bb9-94895ac93ac3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:12:96', 'vm-uuid': 'd334dc9b-8b50-41bb-b0e8-73dda305f590'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: INFO os_vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:12:96,bridge_name='br-int',has_traffic_filtering=True,id=14864729-c342-452f-8bb9-94895ac93ac3,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14864729-c3')
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73b00bb4-1307-466c-9ab7-098e44c86981", "address": "fa:16:3e:56:b6:55", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b00bb4-13", "ovs_interfaceid": "73b00bb4-1307-466c-9ab7-098e44c86981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "73b00bb4-1307-466c-9ab7-098e44c86981", "address": "fa:16:3e:56:b6:55", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b00bb4-13", "ovs_interfaceid": "73b00bb4-1307-466c-9ab7-098e44c86981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:b6:55,bridge_name='br-int',has_traffic_filtering=True,id=73b00bb4-1307-466c-9ab7-098e44c86981,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b00bb4-13') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG os_vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:b6:55,bridge_name='br-int',has_traffic_filtering=True,id=73b00bb4-1307-466c-9ab7-098e44c86981,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b00bb4-13') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73b00bb4-13, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73b00bb4-13, col_values=(('external_ids', {'iface-id': '73b00bb4-1307-466c-9ab7-098e44c86981', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:b6:55', 'vm-uuid': 'd334dc9b-8b50-41bb-b0e8-73dda305f590'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: INFO os_vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:b6:55,bridge_name='br-int',has_traffic_filtering=True,id=73b00bb4-1307-466c-9ab7-098e44c86981,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b00bb4-13')
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "address": "fa:16:3e:c6:ce:13", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ef3b6e-7d", "ovs_interfaceid": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "address": "fa:16:3e:c6:ce:13", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ef3b6e-7d", "ovs_interfaceid": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ce:13,bridge_name='br-int',has_traffic_filtering=True,id=15ef3b6e-7de5-4089-96fd-3b41433c9738,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15ef3b6e-7d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG os_vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ce:13,bridge_name='br-int',has_traffic_filtering=True,id=15ef3b6e-7de5-4089-96fd-3b41433c9738,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15ef3b6e-7d') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15ef3b6e-7d, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15ef3b6e-7d, col_values=(('external_ids', {'iface-id': '15ef3b6e-7de5-4089-96fd-3b41433c9738', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:ce:13', 'vm-uuid': 'd334dc9b-8b50-41bb-b0e8-73dda305f590'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: INFO os_vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ce:13,bridge_name='br-int',has_traffic_filtering=True,id=15ef3b6e-7de5-4089-96fd-3b41433c9738,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15ef3b6e-7d')
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "address": "fa:16:3e:df:c6:8f", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap613cc4e1-ff", "ovs_interfaceid": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "address": "fa:16:3e:df:c6:8f", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap613cc4e1-ff", "ovs_interfaceid": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:c6:8f,bridge_name='br-int',has_traffic_filtering=True,id=613cc4e1-ffff-4180-b0da-0ec02646f55c,network=Network(67f03e30-a12c-4777-9054-42ea6e22f1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap613cc4e1-ff') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG os_vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:c6:8f,bridge_name='br-int',has_traffic_filtering=True,id=613cc4e1-ffff-4180-b0da-0ec02646f55c,network=Network(67f03e30-a12c-4777-9054-42ea6e22f1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap613cc4e1-ff') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap613cc4e1-ff, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap613cc4e1-ff, col_values=(('external_ids', {'iface-id': '613cc4e1-ffff-4180-b0da-0ec02646f55c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:c6:8f', 'vm-uuid': 'd334dc9b-8b50-41bb-b0e8-73dda305f590'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: INFO os_vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:c6:8f,bridge_name='br-int',has_traffic_filtering=True,id=613cc4e1-ffff-4180-b0da-0ec02646f55c,network=Network(67f03e30-a12c-4777-9054-42ea6e22f1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap613cc4e1-ff')
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "address": "fa:16:3e:9c:65:37", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10f0761-24", "ovs_interfaceid": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "address": "fa:16:3e:9c:65:37", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10f0761-24", "ovs_interfaceid": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:65:37,bridge_name='br-int',has_traffic_filtering=True,id=a10f0761-24bb-4ad9-bb7a-bc9961c576fc,network=Network(67f03e30-a12c-4777-9054-42ea6e22f1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa10f0761-24') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG os_vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:65:37,bridge_name='br-int',has_traffic_filtering=True,id=a10f0761-24bb-4ad9-bb7a-bc9961c576fc,network=Network(67f03e30-a12c-4777-9054-42ea6e22f1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa10f0761-24') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa10f0761-24, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa10f0761-24, col_values=(('external_ids', {'iface-id': 'a10f0761-24bb-4ad9-bb7a-bc9961c576fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:65:37', 'vm-uuid': 'd334dc9b-8b50-41bb-b0e8-73dda305f590'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:20 user nova-compute[72782]: INFO os_vif [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:65:37,bridge_name='br-int',has_traffic_filtering=True,id=a10f0761-24bb-4ad9-bb7a-bc9961c576fc,network=Network(67f03e30-a12c-4777-9054-42ea6e22f1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa10f0761-24')
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] No BDM found with device name hda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] No VIF found with MAC fa:16:3e:b3:73:cf, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] No VIF found with MAC fa:16:3e:c6:ce:13, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:50:20 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Using config drive
Aug 14 19:50:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:20 user nova-compute[72782]: INFO nova.compute.manager [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Detaching volume 114e53d3-d652-4c90-9e16-2c52a44e1c96
Aug 14 19:50:20 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Creating config drive at /opt/stack/data/nova/instances/d334dc9b-8b50-41bb-b0e8-73dda305f590/disk.config
Aug 14 19:50:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d334dc9b-8b50-41bb-b0e8-73dda305f590/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7nul3fzx {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d334dc9b-8b50-41bb-b0e8-73dda305f590/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7nul3fzx" returned: 0 in 0.070s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:21 user nova-compute[72782]: INFO nova.virt.block_device [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Attempting to driver detach volume 114e53d3-d652-4c90-9e16-2c52a44e1c96 from mountpoint /dev/vdb
Aug 14 19:50:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Attempting to detach device vdb from instance 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:50:21 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:50:21 user nova-compute[72782]:   <source dev="/dev/sdg"/>
Aug 14 19:50:21 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:50:21 user nova-compute[72782]:   <serial>114e53d3-d652-4c90-9e16-2c52a44e1c96</serial>
Aug 14 19:50:21 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:50:21 user nova-compute[72782]: </disk>
Aug 14 19:50:21 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:50:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Successfully detached device vdb from instance 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 from the persistent domain config.
Aug 14 19:50:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:50:21 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:50:21 user nova-compute[72782]:   <source dev="/dev/sdg"/>
Aug 14 19:50:21 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:50:21 user nova-compute[72782]:   <serial>114e53d3-d652-4c90-9e16-2c52a44e1c96</serial>
Aug 14 19:50:21 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:50:21 user nova-compute[72782]: </disk>
Aug 14 19:50:21 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "c748103b-a37c-47c5-8394-ea54749f27eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG nova.compute.manager [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:50:21 user nova-compute[72782]: INFO nova.compute.claims [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Claim successful on node user
Aug 14 19:50:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692042621.7545257, 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:50:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Successfully detached device vdb from instance 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 from the live domain config.
Aug 14 19:50:21 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smUtcMYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:50:21 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:50:21 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4e6d02-3c66-45b4-95e6-a85991889e04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG nova.compute.manager [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8136b7b3-d385-484d-a1a8-a813e5945cc7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:21 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:21 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:21 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:50:21 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:50:21 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:21 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:21 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:21 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:50:21 user nova-compute[72782]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 (non-flash)
Aug 14 19:50:21 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e8692cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96'): ({'sdg'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Removing single pathed devices sdg {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bdf259-77e5-4d4d-a9c4-a240f17c3a20]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG nova.compute.manager [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG nova.network.neutron [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.028s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5eb4eb0-e938-4892-8250-43ff2b4eac8e]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Flushing IO for device /dev/sdg {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2be1ed8-747d-4abb-913b-389c295b1dcd]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:50:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG nova.compute.manager [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.088s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[00463eff-0007-43b3-8d2f-0ccce6f99dc4]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] SCSI volumes sdg have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4634cefa-c769-49b9-ba3c-b199ed0b8de6]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG nova.policy [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '613ae0366fc5462081f877c1f2c40c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b283da9d5774739a1749f7684439c35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG nova.compute.manager [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:50:22 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Creating image(s)
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "/opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "/opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "/opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a580bb73-bc2f-481d-b411-96b86ec113c0]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96, portal: 172.16.0.220,3260]
Aug 14 19:50:22 user nova-compute[72782]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96, portal: 172.16.0.220,3260] successful.
Aug 14 19:50:22 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114e53d3-d652-4c90-9e16-2c52a44e1c96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc0fcbb-a668-4ae1-8129-1d4033f2104d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.496s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] <== disconnect_volume: return (500ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.215s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.217s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk 1073741824" returned: 0 in 0.051s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG nova.network.neutron [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Successfully created port: 356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Cannot resize image /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG nova.objects.instance [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lazy-loading 'migration_context' on Instance uuid c748103b-a37c-47c5-8394-ea54749f27eb {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Ensure instance console log exists: /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-7cd919a9-7a4f-4213-a74a-7b1ff573b239 req-c0f9ad2b-d61d-4115-926c-a958fd7c8174 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-57339d04-6d3a-4eec-9ca2-bcd028028335 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7cd919a9-7a4f-4213-a74a-7b1ff573b239 req-c0f9ad2b-d61d-4115-926c-a958fd7c8174 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7cd919a9-7a4f-4213-a74a-7b1ff573b239 req-c0f9ad2b-d61d-4115-926c-a958fd7c8174 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7cd919a9-7a4f-4213-a74a-7b1ff573b239 req-c0f9ad2b-d61d-4115-926c-a958fd7c8174 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-7cd919a9-7a4f-4213-a74a-7b1ff573b239 req-c0f9ad2b-d61d-4115-926c-a958fd7c8174 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-57339d04-6d3a-4eec-9ca2-bcd028028335 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:23 user nova-compute[72782]: WARNING nova.compute.manager [req-7cd919a9-7a4f-4213-a74a-7b1ff573b239 req-c0f9ad2b-d61d-4115-926c-a958fd7c8174 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-57339d04-6d3a-4eec-9ca2-bcd028028335 for instance with vm_state building and task_state spawning.
Aug 14 19:50:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.network.neutron [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Successfully updated port: 356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquired lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.network.neutron [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.network.neutron [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-632aeff6-f586-4f1f-9374-d147dc33af43 req-bebb9369-83a9-4251-9192-9c7037ecdec8 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received event network-changed-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-632aeff6-f586-4f1f-9374-d147dc33af43 req-bebb9369-83a9-4251-9192-9c7037ecdec8 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Refreshing instance network info cache due to event network-changed-356eefe9-57d0-4af1-b7bd-842e2cfa33d0. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-632aeff6-f586-4f1f-9374-d147dc33af43 req-bebb9369-83a9-4251-9192-9c7037ecdec8 service nova] Acquiring lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.network.neutron [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Updating instance_info_cache with network_info: [{"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Releasing lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.compute.manager [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Instance network_info: |[{"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-632aeff6-f586-4f1f-9374-d147dc33af43 req-bebb9369-83a9-4251-9192-9c7037ecdec8 service nova] Acquired lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.network.neutron [req-632aeff6-f586-4f1f-9374-d147dc33af43 req-bebb9369-83a9-4251-9192-9c7037ecdec8 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Refreshing network info cache for port 356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Start _get_guest_xml network_info=[{"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:24 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:50:24 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:50:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-541757814',display_name='tempest-ServerActionsTestOtherB-server-541757814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-541757814',id=17,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAarAxn7T7X51FB9WvWO3LMKvuHfCnYFXmKg73GAqFcCk71N2M9odae+ScSuYIAVSuzCKRu92FXDYUypvnCOyLRjSrxNpiNed5PJ7CB2bOBIRMco4NgzPsIxo+nrGJWEGg==',key_name='tempest-keypair-1073189448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b283da9d5774739a1749f7684439c35',ramdisk_id='',reservation_id='r-2esch0g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1314711059',owner_user_name='tempest-ServerActionsTestOtherB-1314711059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:50:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613ae0366fc5462081f877c1f2c40c7e',uuid=c748103b-a37c-47c5-8394-ea54749f27eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Converting VIF {"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.objects.instance [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lazy-loading 'pci_devices' on Instance uuid c748103b-a37c-47c5-8394-ea54749f27eb {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:50:25 user nova-compute[72782]:   <uuid>c748103b-a37c-47c5-8394-ea54749f27eb</uuid>
Aug 14 19:50:25 user nova-compute[72782]:   <name>instance-00000011</name>
Aug 14 19:50:25 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:50:25 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:50:25 user nova-compute[72782]:   <metadata>
Aug 14 19:50:25 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:50:25 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:50:25 user nova-compute[72782]:       <nova:name>tempest-ServerActionsTestOtherB-server-541757814</nova:name>
Aug 14 19:50:25 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:50:24</nova:creationTime>
Aug 14 19:50:25 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:50:25 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:50:25 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:50:25 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:50:25 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:50:25 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:50:25 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:50:25 user nova-compute[72782]:       <nova:owner>
Aug 14 19:50:25 user nova-compute[72782]:         <nova:user uuid="613ae0366fc5462081f877c1f2c40c7e">tempest-ServerActionsTestOtherB-1314711059-project-member</nova:user>
Aug 14 19:50:25 user nova-compute[72782]:         <nova:project uuid="7b283da9d5774739a1749f7684439c35">tempest-ServerActionsTestOtherB-1314711059</nova:project>
Aug 14 19:50:25 user nova-compute[72782]:       </nova:owner>
Aug 14 19:50:25 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:50:25 user nova-compute[72782]:       <nova:ports>
Aug 14 19:50:25 user nova-compute[72782]:         <nova:port uuid="356eefe9-57d0-4af1-b7bd-842e2cfa33d0">
Aug 14 19:50:25 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 19:50:25 user nova-compute[72782]:         </nova:port>
Aug 14 19:50:25 user nova-compute[72782]:       </nova:ports>
Aug 14 19:50:25 user nova-compute[72782]:     </nova:instance>
Aug 14 19:50:25 user nova-compute[72782]:   </metadata>
Aug 14 19:50:25 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:50:25 user nova-compute[72782]:     <system>
Aug 14 19:50:25 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:50:25 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:50:25 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:50:25 user nova-compute[72782]:       <entry name="serial">c748103b-a37c-47c5-8394-ea54749f27eb</entry>
Aug 14 19:50:25 user nova-compute[72782]:       <entry name="uuid">c748103b-a37c-47c5-8394-ea54749f27eb</entry>
Aug 14 19:50:25 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:50:25 user nova-compute[72782]:     </system>
Aug 14 19:50:25 user nova-compute[72782]:   </sysinfo>
Aug 14 19:50:25 user nova-compute[72782]:   <os>
Aug 14 19:50:25 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:50:25 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:50:25 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:50:25 user nova-compute[72782]:   </os>
Aug 14 19:50:25 user nova-compute[72782]:   <features>
Aug 14 19:50:25 user nova-compute[72782]:     <acpi/>
Aug 14 19:50:25 user nova-compute[72782]:     <apic/>
Aug 14 19:50:25 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:50:25 user nova-compute[72782]:   </features>
Aug 14 19:50:25 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:50:25 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:50:25 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:50:25 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:50:25 user nova-compute[72782]:   </clock>
Aug 14 19:50:25 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:50:25 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:50:25 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:50:25 user nova-compute[72782]:   </cpu>
Aug 14 19:50:25 user nova-compute[72782]:   <devices>
Aug 14 19:50:25 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:50:25 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:50:25 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk"/>
Aug 14 19:50:25 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:50:25 user nova-compute[72782]:     </disk>
Aug 14 19:50:25 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:50:25 user nova-compute[72782]:       <mac address="fa:16:3e:5f:41:29"/>
Aug 14 19:50:25 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:50:25 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:50:25 user nova-compute[72782]:       <target dev="tap356eefe9-57"/>
Aug 14 19:50:25 user nova-compute[72782]:     </interface>
Aug 14 19:50:25 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:50:25 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/console.log" append="off"/>
Aug 14 19:50:25 user nova-compute[72782]:     </serial>
Aug 14 19:50:25 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:50:25 user nova-compute[72782]:     <video>
Aug 14 19:50:25 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:50:25 user nova-compute[72782]:     </video>
Aug 14 19:50:25 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:50:25 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:50:25 user nova-compute[72782]:     </rng>
Aug 14 19:50:25 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:50:25 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:50:25 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:50:25 user nova-compute[72782]:     </memballoon>
Aug 14 19:50:25 user nova-compute[72782]:   </devices>
Aug 14 19:50:25 user nova-compute[72782]: </domain>
Aug 14 19:50:25 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-541757814',display_name='tempest-ServerActionsTestOtherB-server-541757814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-541757814',id=17,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAarAxn7T7X51FB9WvWO3LMKvuHfCnYFXmKg73GAqFcCk71N2M9odae+ScSuYIAVSuzCKRu92FXDYUypvnCOyLRjSrxNpiNed5PJ7CB2bOBIRMco4NgzPsIxo+nrGJWEGg==',key_name='tempest-keypair-1073189448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b283da9d5774739a1749f7684439c35',ramdisk_id='',reservation_id='r-2esch0g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1314711059',owner_user_name='tempest-ServerActionsTestOtherB-1314711059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:50:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613ae0366fc5462081f877c1f2c40c7e',uuid=c748103b-a37c-47c5-8394-ea54749f27eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Converting VIF {"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG os_vif [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap356eefe9-57, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap356eefe9-57, col_values=(('external_ids', {'iface-id': '356eefe9-57d0-4af1-b7bd-842e2cfa33d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:41:29', 'vm-uuid': 'c748103b-a37c-47c5-8394-ea54749f27eb'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:25 user nova-compute[72782]: INFO os_vif [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57')
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] No VIF found with MAC fa:16:3e:5f:41:29, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-0e9bb418-9ac5-4cf5-95a0-d5b1b6a2413f req-78c5150b-a4b4-48c3-ac1a-0a5c7678e294 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-a10f0761-24bb-4ad9-bb7a-bc9961c576fc {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0e9bb418-9ac5-4cf5-95a0-d5b1b6a2413f req-78c5150b-a4b4-48c3-ac1a-0a5c7678e294 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0e9bb418-9ac5-4cf5-95a0-d5b1b6a2413f req-78c5150b-a4b4-48c3-ac1a-0a5c7678e294 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0e9bb418-9ac5-4cf5-95a0-d5b1b6a2413f req-78c5150b-a4b4-48c3-ac1a-0a5c7678e294 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-0e9bb418-9ac5-4cf5-95a0-d5b1b6a2413f req-78c5150b-a4b4-48c3-ac1a-0a5c7678e294 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-a10f0761-24bb-4ad9-bb7a-bc9961c576fc {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:25 user nova-compute[72782]: WARNING nova.compute.manager [req-0e9bb418-9ac5-4cf5-95a0-d5b1b6a2413f req-78c5150b-a4b4-48c3-ac1a-0a5c7678e294 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-a10f0761-24bb-4ad9-bb7a-bc9961c576fc for instance with vm_state building and task_state spawning.
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.network.neutron [req-632aeff6-f586-4f1f-9374-d147dc33af43 req-bebb9369-83a9-4251-9192-9c7037ecdec8 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Updated VIF entry in instance network info cache for port 356eefe9-57d0-4af1-b7bd-842e2cfa33d0. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.network.neutron [req-632aeff6-f586-4f1f-9374-d147dc33af43 req-bebb9369-83a9-4251-9192-9c7037ecdec8 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Updating instance_info_cache with network_info: [{"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-632aeff6-f586-4f1f-9374-d147dc33af43 req-bebb9369-83a9-4251-9192-9c7037ecdec8 service nova] Releasing lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-57339d04-6d3a-4eec-9ca2-bcd028028335 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-57339d04-6d3a-4eec-9ca2-bcd028028335 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:25 user nova-compute[72782]: WARNING nova.compute.manager [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-57339d04-6d3a-4eec-9ca2-bcd028028335 for instance with vm_state building and task_state spawning.
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-55021cb8-5aac-42d2-898b-13b28995d3d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-55021cb8-5aac-42d2-898b-13b28995d3d8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:25 user nova-compute[72782]: WARNING nova.compute.manager [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-55021cb8-5aac-42d2-898b-13b28995d3d8 for instance with vm_state building and task_state spawning.
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-55021cb8-5aac-42d2-898b-13b28995d3d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-55021cb8-5aac-42d2-898b-13b28995d3d8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:25 user nova-compute[72782]: WARNING nova.compute.manager [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-55021cb8-5aac-42d2-898b-13b28995d3d8 for instance with vm_state building and task_state spawning.
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-14864729-c342-452f-8bb9-94895ac93ac3 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-14864729-c342-452f-8bb9-94895ac93ac3 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:25 user nova-compute[72782]: WARNING nova.compute.manager [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-14864729-c342-452f-8bb9-94895ac93ac3 for instance with vm_state building and task_state spawning.
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-14864729-c342-452f-8bb9-94895ac93ac3 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-14864729-c342-452f-8bb9-94895ac93ac3 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:25 user nova-compute[72782]: WARNING nova.compute.manager [req-4accde71-e060-4045-be80-4fef5c0bd16d req-1d826cd2-9021-4b97-b17f-160ae690c727 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-14864729-c342-452f-8bb9-94895ac93ac3 for instance with vm_state building and task_state spawning.
Aug 14 19:50:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-73b00bb4-1307-466c-9ab7-098e44c86981 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-73b00bb4-1307-466c-9ab7-098e44c86981 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:26 user nova-compute[72782]: WARNING nova.compute.manager [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-73b00bb4-1307-466c-9ab7-098e44c86981 for instance with vm_state building and task_state spawning.
Aug 14 19:50:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-73b00bb4-1307-466c-9ab7-098e44c86981 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-73b00bb4-1307-466c-9ab7-098e44c86981 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:26 user nova-compute[72782]: WARNING nova.compute.manager [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-73b00bb4-1307-466c-9ab7-098e44c86981 for instance with vm_state building and task_state spawning.
Aug 14 19:50:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-15ef3b6e-7de5-4089-96fd-3b41433c9738 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-15ef3b6e-7de5-4089-96fd-3b41433c9738 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:26 user nova-compute[72782]: WARNING nova.compute.manager [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-15ef3b6e-7de5-4089-96fd-3b41433c9738 for instance with vm_state building and task_state spawning.
Aug 14 19:50:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-15ef3b6e-7de5-4089-96fd-3b41433c9738 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-15ef3b6e-7de5-4089-96fd-3b41433c9738 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:26 user nova-compute[72782]: WARNING nova.compute.manager [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-15ef3b6e-7de5-4089-96fd-3b41433c9738 for instance with vm_state building and task_state spawning.
Aug 14 19:50:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-613cc4e1-ffff-4180-b0da-0ec02646f55c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-613cc4e1-ffff-4180-b0da-0ec02646f55c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:26 user nova-compute[72782]: WARNING nova.compute.manager [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-613cc4e1-ffff-4180-b0da-0ec02646f55c for instance with vm_state building and task_state spawning.
Aug 14 19:50:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-613cc4e1-ffff-4180-b0da-0ec02646f55c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-613cc4e1-ffff-4180-b0da-0ec02646f55c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:26 user nova-compute[72782]: WARNING nova.compute.manager [req-ecd5853b-ad16-45f4-a070-49c219c465e1 req-80ec4b09-0334-4763-9f84-35de9f29b553 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-613cc4e1-ffff-4180-b0da-0ec02646f55c for instance with vm_state building and task_state spawning.
Aug 14 19:50:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:26 user nova-compute[72782]: INFO nova.compute.manager [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Terminating instance
Aug 14 19:50:26 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:50:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-ade38eb0-0ce2-4471-ba97-613e9bed1714 req-38840b04-e25b-48d1-9802-2a3ad14010bb service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-a10f0761-24bb-4ad9-bb7a-bc9961c576fc {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ade38eb0-0ce2-4471-ba97-613e9bed1714 req-38840b04-e25b-48d1-9802-2a3ad14010bb service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ade38eb0-0ce2-4471-ba97-613e9bed1714 req-38840b04-e25b-48d1-9802-2a3ad14010bb service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ade38eb0-0ce2-4471-ba97-613e9bed1714 req-38840b04-e25b-48d1-9802-2a3ad14010bb service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-ade38eb0-0ce2-4471-ba97-613e9bed1714 req-38840b04-e25b-48d1-9802-2a3ad14010bb service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-a10f0761-24bb-4ad9-bb7a-bc9961c576fc {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:27 user nova-compute[72782]: WARNING nova.compute.manager [req-ade38eb0-0ce2-4471-ba97-613e9bed1714 req-38840b04-e25b-48d1-9802-2a3ad14010bb service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-a10f0761-24bb-4ad9-bb7a-bc9961c576fc for instance with vm_state building and task_state spawning.
Aug 14 19:50:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:27 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Instance destroyed successfully.
Aug 14 19:50:27 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lazy-loading 'resources' on Instance uuid a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-827845467',display_name='tempest-VolumesAdminNegativeTest-server-827845467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-827845467',id=14,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:48:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c294f11708224e9a9a69ae37139b4d06',ramdisk_id='',reservation_id='r-dxgly1h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-468605289',owner_user_name='tempest-VolumesAdminNegativeTest-468605289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:48:31Z,user_data=None,user_id='01da439b977447d9acd627af965122bd',uuid=a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adcfdaef-2180-4855-8971-ea5b45f9f730", "address": "fa:16:3e:d5:4a:31", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadcfdaef-21", "ovs_interfaceid": "adcfdaef-2180-4855-8971-ea5b45f9f730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Converting VIF {"id": "adcfdaef-2180-4855-8971-ea5b45f9f730", "address": "fa:16:3e:d5:4a:31", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadcfdaef-21", "ovs_interfaceid": "adcfdaef-2180-4855-8971-ea5b45f9f730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:31,bridge_name='br-int',has_traffic_filtering=True,id=adcfdaef-2180-4855-8971-ea5b45f9f730,network=Network(f55b2a79-f0a6-4b3f-991b-a93ae0ded8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadcfdaef-21') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG os_vif [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:31,bridge_name='br-int',has_traffic_filtering=True,id=adcfdaef-2180-4855-8971-ea5b45f9f730,network=Network(f55b2a79-f0a6-4b3f-991b-a93ae0ded8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadcfdaef-21') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadcfdaef-21, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-2df46725-c74c-4a50-9866-0ae30b5e48ed req-d596653b-7825-41f2-a45e-2e7a9944a420 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Received event network-vif-unplugged-adcfdaef-2180-4855-8971-ea5b45f9f730 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2df46725-c74c-4a50-9866-0ae30b5e48ed req-d596653b-7825-41f2-a45e-2e7a9944a420 service nova] Acquiring lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2df46725-c74c-4a50-9866-0ae30b5e48ed req-d596653b-7825-41f2-a45e-2e7a9944a420 service nova] Lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2df46725-c74c-4a50-9866-0ae30b5e48ed req-d596653b-7825-41f2-a45e-2e7a9944a420 service nova] Lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-2df46725-c74c-4a50-9866-0ae30b5e48ed req-d596653b-7825-41f2-a45e-2e7a9944a420 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] No waiting events found dispatching network-vif-unplugged-adcfdaef-2180-4855-8971-ea5b45f9f730 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-2df46725-c74c-4a50-9866-0ae30b5e48ed req-d596653b-7825-41f2-a45e-2e7a9944a420 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Received event network-vif-unplugged-adcfdaef-2180-4855-8971-ea5b45f9f730 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-2df46725-c74c-4a50-9866-0ae30b5e48ed req-d596653b-7825-41f2-a45e-2e7a9944a420 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Received event network-vif-plugged-adcfdaef-2180-4855-8971-ea5b45f9f730 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2df46725-c74c-4a50-9866-0ae30b5e48ed req-d596653b-7825-41f2-a45e-2e7a9944a420 service nova] Acquiring lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2df46725-c74c-4a50-9866-0ae30b5e48ed req-d596653b-7825-41f2-a45e-2e7a9944a420 service nova] Lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2df46725-c74c-4a50-9866-0ae30b5e48ed req-d596653b-7825-41f2-a45e-2e7a9944a420 service nova] Lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-2df46725-c74c-4a50-9866-0ae30b5e48ed req-d596653b-7825-41f2-a45e-2e7a9944a420 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] No waiting events found dispatching network-vif-plugged-adcfdaef-2180-4855-8971-ea5b45f9f730 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:27 user nova-compute[72782]: WARNING nova.compute.manager [req-2df46725-c74c-4a50-9866-0ae30b5e48ed req-d596653b-7825-41f2-a45e-2e7a9944a420 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Received unexpected event network-vif-plugged-adcfdaef-2180-4855-8971-ea5b45f9f730 for instance with vm_state active and task_state deleting.
Aug 14 19:50:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:27 user nova-compute[72782]: INFO os_vif [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:31,bridge_name='br-int',has_traffic_filtering=True,id=adcfdaef-2180-4855-8971-ea5b45f9f730,network=Network(f55b2a79-f0a6-4b3f-991b-a93ae0ded8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadcfdaef-21')
Aug 14 19:50:27 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Deleting instance files /opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da_del
Aug 14 19:50:27 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Deletion of /opt/stack/data/nova/instances/a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da_del complete
Aug 14 19:50:28 user nova-compute[72782]: INFO nova.compute.manager [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 14 19:50:28 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:50:28 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:50:28 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:50:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:28 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:50:28 user nova-compute[72782]: DEBUG nova.compute.manager [req-cb087ae1-cea8-4226-8f6f-b9006896c7b6 req-3b98a2b7-4d31-4604-98cf-140abed8a302 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Received event network-vif-deleted-adcfdaef-2180-4855-8971-ea5b45f9f730 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:28 user nova-compute[72782]: INFO nova.compute.manager [req-cb087ae1-cea8-4226-8f6f-b9006896c7b6 req-3b98a2b7-4d31-4604-98cf-140abed8a302 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Neutron deleted interface adcfdaef-2180-4855-8971-ea5b45f9f730; detaching it from the instance and deleting it from the info cache
Aug 14 19:50:28 user nova-compute[72782]: DEBUG nova.network.neutron [req-cb087ae1-cea8-4226-8f6f-b9006896c7b6 req-3b98a2b7-4d31-4604-98cf-140abed8a302 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:50:28 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Took 0.92 seconds to deallocate network for instance.
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-cb087ae1-cea8-4226-8f6f-b9006896c7b6 req-3b98a2b7-4d31-4604-98cf-140abed8a302 service nova] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Detach interface failed, port_id=adcfdaef-2180-4855-8971-ea5b45f9f730, reason: Instance a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042629.1164289, d334dc9b-8b50-41bb-b0e8-73dda305f590 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:50:29 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] VM Resumed (Lifecycle Event)
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:50:29 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Instance spawned successfully.
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:50:29 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042629.1179883, d334dc9b-8b50-41bb-b0e8-73dda305f590 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:50:29 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] VM Started (Lifecycle Event)
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:50:29 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:50:29 user nova-compute[72782]: INFO nova.compute.manager [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Took 14.03 seconds to spawn the instance on the hypervisor.
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:50:29 user nova-compute[72782]: INFO nova.compute.manager [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Took 48.92 seconds to build instance.
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a5e8d7d1-962c-4b3a-afc6-c898c83c4ec6 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 49.045s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:29 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Deleted allocations for instance a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da
Aug 14 19:50:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f023152-d285-402a-aa63-989305dc95b1 tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.757s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042629.828897, c748103b-a37c-47c5-8394-ea54749f27eb => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:50:29 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] VM Resumed (Lifecycle Event)
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:50:29 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Instance spawned successfully.
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:50:29 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042629.8310347, c748103b-a37c-47c5-8394-ea54749f27eb => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:50:29 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] VM Started (Lifecycle Event)
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:50:29 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:50:29 user nova-compute[72782]: INFO nova.compute.manager [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Took 7.81 seconds to spawn the instance on the hypervisor.
Aug 14 19:50:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:50:30 user nova-compute[72782]: DEBUG nova.compute.manager [req-f0dc9c75-11c8-4118-8aa1-14855a76f5db req-a48c98c3-1820-490d-b694-8f98344943c6 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received event network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f0dc9c75-11c8-4118-8aa1-14855a76f5db req-a48c98c3-1820-490d-b694-8f98344943c6 service nova] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f0dc9c75-11c8-4118-8aa1-14855a76f5db req-a48c98c3-1820-490d-b694-8f98344943c6 service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f0dc9c75-11c8-4118-8aa1-14855a76f5db req-a48c98c3-1820-490d-b694-8f98344943c6 service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:30 user nova-compute[72782]: DEBUG nova.compute.manager [req-f0dc9c75-11c8-4118-8aa1-14855a76f5db req-a48c98c3-1820-490d-b694-8f98344943c6 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] No waiting events found dispatching network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:30 user nova-compute[72782]: WARNING nova.compute.manager [req-f0dc9c75-11c8-4118-8aa1-14855a76f5db req-a48c98c3-1820-490d-b694-8f98344943c6 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received unexpected event network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 for instance with vm_state building and task_state spawning.
Aug 14 19:50:30 user nova-compute[72782]: DEBUG nova.compute.manager [req-f0dc9c75-11c8-4118-8aa1-14855a76f5db req-a48c98c3-1820-490d-b694-8f98344943c6 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received event network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:50:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f0dc9c75-11c8-4118-8aa1-14855a76f5db req-a48c98c3-1820-490d-b694-8f98344943c6 service nova] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f0dc9c75-11c8-4118-8aa1-14855a76f5db req-a48c98c3-1820-490d-b694-8f98344943c6 service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f0dc9c75-11c8-4118-8aa1-14855a76f5db req-a48c98c3-1820-490d-b694-8f98344943c6 service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:30 user nova-compute[72782]: DEBUG nova.compute.manager [req-f0dc9c75-11c8-4118-8aa1-14855a76f5db req-a48c98c3-1820-490d-b694-8f98344943c6 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] No waiting events found dispatching network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:50:30 user nova-compute[72782]: WARNING nova.compute.manager [req-f0dc9c75-11c8-4118-8aa1-14855a76f5db req-a48c98c3-1820-490d-b694-8f98344943c6 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received unexpected event network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 for instance with vm_state building and task_state spawning.
Aug 14 19:50:30 user nova-compute[72782]: INFO nova.compute.manager [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Took 8.83 seconds to build instance.
Aug 14 19:50:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-923fd760-184e-4155-9179-a32a2fcd5ca3 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "c748103b-a37c-47c5-8394-ea54749f27eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.950s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xloGDZda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:50:32 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:50:32 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:50:32 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd31a4a4-7fc7-4ed4-b160-386c2626cd11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:50:32 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba9a87a-4bae-4600-821f-3bba3b03a923]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3] added
Aug 14 19:50:32 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8089e27b-1e48-47d8-87f9-6f2f8f48b81b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a6d75a-8ed3-4bed-bf71-268f893b9749]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xloGDZda {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xloGDZda" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8884ec4d-2df4-4c64-8459-a986fa51596c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xloGDZda'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[097d8d66-c658-4ac2-8838-a871f95c4882]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG nova.objects.instance [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'flavor' on Instance uuid 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.129s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3b676c-a9be-4b6b-9145-d57db135943d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:32 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:32 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:32 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:50:32 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:32 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:32 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:32 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:50:32 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2f8ea25d-cf36-452f-b3a2-4be0defcd75b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 11.690s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[900446e4-465e-4f3e-92e0-d583aa7d0f04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3, portal: 172.16.0.220,3260]
Aug 14 19:50:32 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3, portal: 172.16.0.220,3260] successful.
Aug 14 19:50:32 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0906901a-a06d-40b3-9f4a-94ad4937a92f]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea20c58-fbb3-41d7-8f49-fbe8e18c3862]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:32 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:32 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:32 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:50:32 user nova-compute[72782]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 (non-flash)
Aug 14 19:50:32 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:32 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:32 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:32 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:50:32 user nova-compute[72782]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 (non-flash)
Aug 14 19:50:32 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.512s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1f30a9-0318-4edc-863f-f1343cab6aaf]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xloGDZda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:50:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.554s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:50:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] <== connect_volume: return (1559ms) {'type': 'block', 'scsi_wwn': '23861613539643136', 'path': '/dev/sdf'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:50:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861613539643136', 'path': '/dev/sdf'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:50:33 user nova-compute[72782]: DEBUG nova.objects.instance [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lazy-loading 'flavor' on Instance uuid 132b9b0b-9556-4aaf-a9ad-577e18215e84 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:50:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:50:33 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:50:33 user nova-compute[72782]:   <source dev="/dev/sdf"/>
Aug 14 19:50:33 user nova-compute[72782]:   <target dev="vdc" bus="virtio"/>
Aug 14 19:50:33 user nova-compute[72782]:   <serial>8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3</serial>
Aug 14 19:50:33 user nova-compute[72782]: </disk>
Aug 14 19:50:33 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:50:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:50:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:50:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:50:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] No VIF found with MAC fa:16:3e:6a:36:8a, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:50:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a852fd91-6014-4277-8699-8a818071da6a tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.068s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:35 user nova-compute[72782]: INFO nova.compute.manager [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Detaching volume 8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3
Aug 14 19:50:35 user nova-compute[72782]: INFO nova.virt.block_device [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Attempting to driver detach volume 8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 from mountpoint /dev/vdc
Aug 14 19:50:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Attempting to detach device vdc from instance 132b9b0b-9556-4aaf-a9ad-577e18215e84 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:50:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:50:35 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:50:35 user nova-compute[72782]:   <source dev="/dev/sdf"/>
Aug 14 19:50:35 user nova-compute[72782]:   <target dev="vdc" bus="virtio"/>
Aug 14 19:50:35 user nova-compute[72782]:   <serial>8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3</serial>
Aug 14 19:50:35 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 19:50:35 user nova-compute[72782]: </disk>
Aug 14 19:50:35 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:50:35 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Successfully detached device vdc from instance 132b9b0b-9556-4aaf-a9ad-577e18215e84 from the persistent domain config.
Aug 14 19:50:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 132b9b0b-9556-4aaf-a9ad-577e18215e84 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:50:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:50:35 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:50:35 user nova-compute[72782]:   <source dev="/dev/sdf"/>
Aug 14 19:50:35 user nova-compute[72782]:   <target dev="vdc" bus="virtio"/>
Aug 14 19:50:35 user nova-compute[72782]:   <serial>8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3</serial>
Aug 14 19:50:35 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 19:50:35 user nova-compute[72782]: </disk>
Aug 14 19:50:35 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692042636.3735313, 132b9b0b-9556-4aaf-a9ad-577e18215e84 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 132b9b0b-9556-4aaf-a9ad-577e18215e84 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:50:36 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Successfully detached device vdc from instance 132b9b0b-9556-4aaf-a9ad-577e18215e84 from the live domain config.
Aug 14 19:50:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xloGDZda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:50:36 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:50:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e585c97a-0c45-468d-9d45-3a7f355f7651]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8079ccc0-b179-430b-8ee5-465dd964a8cb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:36 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:36 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:36 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:50:36 user nova-compute[72782]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 (non-flash)
Aug 14 19:50:36 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:36 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:36 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:36 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:50:36 user nova-compute[72782]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 (non-flash)
Aug 14 19:50:36 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e86a6dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3'): ({'sdf'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Removing single pathed devices sdf {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee9c141-53c8-48f7-b315-77100c330a41]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6e282d-3063-4387-9a35-7aafddc07a79]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Flushing IO for device /dev/sdf {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ae1fcb-dc61-4d61-bf08-0c30679e26e9]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f003e7b-bddf-4271-bc45-1c97e9e0a61e]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] SCSI volumes sdf have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36242a3-65a7-4c07-a171-933f2abf2855]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[af74cf3a-226d-4e6c-a816-50e857ec1e2a]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3, portal: 172.16.0.220,3260]
Aug 14 19:50:36 user nova-compute[72782]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3, portal: 172.16.0.220,3260] successful.
Aug 14 19:50:36 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa14ab2-3b7c-4be1-a54e-7d2c7de873a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8a730d-1bcf-4ce0-9b39-7abb3eb97138]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] <== disconnect_volume: return (344ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:50:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:50:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG nova.objects.instance [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lazy-loading 'flavor' on Instance uuid 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:39 user nova-compute[72782]: INFO nova.compute.manager [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Attaching volume 328eb7e0-658a-4d95-a4c3-19cf3e7419cc to /dev/vdb
Aug 14 19:50:39 user nova-compute[72782]: DEBUG os_brick.utils [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a402f1e8-f890-4a43-af69-cf0732a86288]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9f373f-72ae-4c71-b88a-5352fb0bdb0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[be00272e-eb25-4656-95d0-939666463000]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[80487c53-b580-48d3-8e5d-9e6f19a1ac73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:50:39 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:50:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41acd32-0c5b-4bd5-8478-93f5f28a4812]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG os_brick.utils [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:50:39 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Updating existing volume attachment record: b5e56e5e-085c-4cb1-afa2-5ec7bfb3c3fd {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:50:41 user nova-compute[72782]: DEBUG nova.objects.instance [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lazy-loading 'flavor' on Instance uuid 132b9b0b-9556-4aaf-a9ad-577e18215e84 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:50:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-89113b44-2101-4945-a123-6bfce95430f1 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.923s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:42 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042627.8761475, a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:50:42 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] VM Stopped (Lifecycle Event)
Aug 14 19:50:42 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f5cb5270-47b8-4991-879f-e4133b943687 None None] [instance: a2fecf7a-d5b8-4ff3-9a3a-b06a654a79da] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:50:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:44 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:44 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72782) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 19:50:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:49 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsUoiLEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:50:49 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:50:49 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:50:49 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[25994496-0fae-484b-a0df-1fcc23c729bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:50:50 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dedfc9-37a9-4975-af0a-fb1a91bc3e17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc] added
Aug 14 19:50:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d7addc-a96e-40d8-afe1-418eeaec3101]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6088e9dd-83a5-487c-a16e-8fe3b933eca1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FsUoiLEY {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FsUoiLEY" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb43a13-4ae2-4620-b9ca-007c99bd75cf]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FsUoiLEY'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc239351-811d-4670-811d-fe5e92756d8b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb46f075-0964-49ef-8196-1339e28b3495]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:50 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:50 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:50 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:50:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:50 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:50 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:50 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:50:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[30106878-0518-4821-b911-7aac19b1f06b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc, portal: 172.16.0.220,3260]
Aug 14 19:50:50 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc, portal: 172.16.0.220,3260] successful.
Aug 14 19:50:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b0c13f-a34c-404e-9e7d-fd2c46424d9a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5bb6c4-8296-49af-be9b-968c10932a78]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:50 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:50 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:50 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:50:50 user nova-compute[72782]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc (non-flash)
Aug 14 19:50:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:50 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:50 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:50 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:50:50 user nova-compute[72782]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc (non-flash)
Aug 14 19:50:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b5c100-0e35-4d7b-b06c-260701d918fe]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsUoiLEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:50:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:50:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:50:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:50:51 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:50:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:50:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23665363037353831', 'path': '/dev/sdf'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:50:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665363037353831', 'path': '/dev/sdf'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:50:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lazy-loading 'flavor' on Instance uuid 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:50:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:50:51 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:50:51 user nova-compute[72782]:   <source dev="/dev/sdf"/>
Aug 14 19:50:51 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:50:51 user nova-compute[72782]:   <serial>328eb7e0-658a-4d95-a4c3-19cf3e7419cc</serial>
Aug 14 19:50:51 user nova-compute[72782]: </disk>
Aug 14 19:50:51 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:50:51 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Updating instance_info_cache with network_info: [{"id": "888a72be-5707-4d58-98e1-b472c928de22", "address": "fa:16:3e:83:d0:33", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888a72be-57", "ovs_interfaceid": "888a72be-5707-4d58-98e1-b472c928de22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:50:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:50:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:50:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:50:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:50:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] No VIF found with MAC fa:16:3e:57:2a:1c, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:50:52 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 19:50:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ac983b11-702f-4ce3-8ca1-de56496dd0c8 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.350s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] There are 0 instances to clean {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 19:50:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:54 user nova-compute[72782]: INFO nova.compute.manager [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Detaching volume 328eb7e0-658a-4d95-a4c3-19cf3e7419cc
Aug 14 19:50:54 user nova-compute[72782]: INFO nova.virt.block_device [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Attempting to driver detach volume 328eb7e0-658a-4d95-a4c3-19cf3e7419cc from mountpoint /dev/vdb
Aug 14 19:50:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Attempting to detach device vdb from instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:50:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:50:54 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:50:54 user nova-compute[72782]:   <source dev="/dev/sdf"/>
Aug 14 19:50:54 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:50:54 user nova-compute[72782]:   <serial>328eb7e0-658a-4d95-a4c3-19cf3e7419cc</serial>
Aug 14 19:50:54 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:50:54 user nova-compute[72782]: </disk>
Aug 14 19:50:54 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:50:54 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Successfully detached device vdb from instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f from the persistent domain config.
Aug 14 19:50:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:50:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:50:54 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:50:54 user nova-compute[72782]:   <source dev="/dev/sdf"/>
Aug 14 19:50:54 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:50:54 user nova-compute[72782]:   <serial>328eb7e0-658a-4d95-a4c3-19cf3e7419cc</serial>
Aug 14 19:50:54 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:50:54 user nova-compute[72782]: </disk>
Aug 14 19:50:54 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692042655.3346176, 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:50:55 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Successfully detached device vdb from instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f from the live domain config.
Aug 14 19:50:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsUoiLEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:50:55 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:50:55 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1e0d27-360b-42de-ab7d-39947e9c3443]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54146c3-7840-4211-8b93-a7f7583841a1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:55 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:55 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:55 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:50:55 user nova-compute[72782]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc (non-flash)
Aug 14 19:50:55 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:50:55 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:50:55 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:50:55 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:50:55 user nova-compute[72782]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc (non-flash)
Aug 14 19:50:55 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e8662560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc'): ({'sdf'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Removing single pathed devices sdf {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b804bee4-d6e1-4e06-a4dd-82335da6c808]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac53400-f12e-4efe-bc9c-41fdf5abf0b4]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Flushing IO for device /dev/sdf {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae2fd76-f429-4f2d-bdbf-cd41c58ce9eb]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bd3db9-293b-44e9-8590-daad1210725e]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] SCSI volumes sdf have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb9bebc-c10f-470a-9e17-5882adc866bd]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[177dfd92-fb13-4776-af10-418d2708f0b4]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc, portal: 172.16.0.220,3260]
Aug 14 19:50:55 user nova-compute[72782]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc, portal: 172.16.0.220,3260] successful.
Aug 14 19:50:55 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328eb7e0-658a-4d95-a4c3-19cf3e7419cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e59491-97fa-4118-a119-5eccc41ec38c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] <== disconnect_volume: return (339ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:50:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:50:56 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:50:56 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:50:56 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:50:56 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7403MB free_disk=25.736560821533203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:50:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:50:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 132b9b0b-9556-4aaf-a9ad-577e18215e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance d334dc9b-8b50-41bb-b0e8-73dda305f590 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 792f31f1-4079-4443-81f2-b1e364a9ee14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance c748103b-a37c-47c5-8394-ea54749f27eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing inventories for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating ProviderTree inventory for provider d26c9e3b-40e6-476e-9664-3119ebf5873b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing aggregate associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, aggregates: None {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing trait associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.784s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:58 user nova-compute[72782]: DEBUG nova.objects.instance [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lazy-loading 'flavor' on Instance uuid 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:50:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-39b12d10-55e2-4636-941b-6045ed6ef0a9 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.427s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:50:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:50:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:50:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:51:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquiring lock "d0ffe207-a89e-41ef-85af-7927ce06627e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "d0ffe207-a89e-41ef-85af-7927ce06627e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:51:09 user nova-compute[72782]: INFO nova.compute.claims [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Claim successful on node user
Aug 14 19:51:09 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:51:09 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:51:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG nova.policy [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f6db9beff934039b38439a362287274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcc7dac78fa47eab14a10d2fe59d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:51:09 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Creating image(s)
Aug 14 19:51:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "/opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "/opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.171s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk 1073741824" returned: 0 in 0.048s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:10 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Successfully created port: bf5a9b82-2e2d-4417-8650-bbc67e82d953 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:51:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.204s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:10 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:51:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:10 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Cannot resize image /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:51:10 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lazy-loading 'migration_context' on Instance uuid d0ffe207-a89e-41ef-85af-7927ce06627e {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:51:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:51:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Ensure instance console log exists: /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:51:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Successfully updated port: bf5a9b82-2e2d-4417-8650-bbc67e82d953 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquiring lock "refresh_cache-d0ffe207-a89e-41ef-85af-7927ce06627e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquired lock "refresh_cache-d0ffe207-a89e-41ef-85af-7927ce06627e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-266f78ca-22a0-4527-aaf6-d1e054803182 req-903b4036-a534-4194-be01-58a9398a0c60 service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Received event network-changed-bf5a9b82-2e2d-4417-8650-bbc67e82d953 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-266f78ca-22a0-4527-aaf6-d1e054803182 req-903b4036-a534-4194-be01-58a9398a0c60 service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Refreshing instance network info cache due to event network-changed-bf5a9b82-2e2d-4417-8650-bbc67e82d953. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-266f78ca-22a0-4527-aaf6-d1e054803182 req-903b4036-a534-4194-be01-58a9398a0c60 service nova] Acquiring lock "refresh_cache-d0ffe207-a89e-41ef-85af-7927ce06627e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:11 user nova-compute[72782]: INFO nova.compute.manager [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Terminating instance
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Updating instance_info_cache with network_info: [{"id": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "address": "fa:16:3e:fa:0f:ec", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5a9b82-2e", "ovs_interfaceid": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Releasing lock "refresh_cache-d0ffe207-a89e-41ef-85af-7927ce06627e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Instance network_info: |[{"id": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "address": "fa:16:3e:fa:0f:ec", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5a9b82-2e", "ovs_interfaceid": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-266f78ca-22a0-4527-aaf6-d1e054803182 req-903b4036-a534-4194-be01-58a9398a0c60 service nova] Acquired lock "refresh_cache-d0ffe207-a89e-41ef-85af-7927ce06627e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.network.neutron [req-266f78ca-22a0-4527-aaf6-d1e054803182 req-903b4036-a534-4194-be01-58a9398a0c60 service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Refreshing network info cache for port bf5a9b82-2e2d-4417-8650-bbc67e82d953 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Start _get_guest_xml network_info=[{"id": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "address": "fa:16:3e:fa:0f:ec", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5a9b82-2e", "ovs_interfaceid": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:51:11 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:51:11 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:51:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1274803257',display_name='tempest-ServersNegativeTestJSON-server-1274803257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1274803257',id=18,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fcc7dac78fa47eab14a10d2fe59d320',ramdisk_id='',reservation_id='r-xxvxdr9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1211486287',owner_user_name='tempest-ServersNegativeTestJSON-1211486287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:51:10Z,user_data=None,user_id='1f6db9beff934039b38439a362287274',uuid=d0ffe207-a89e-41ef-85af-7927ce06627e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "address": "fa:16:3e:fa:0f:ec", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5a9b82-2e", "ovs_interfaceid": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Converting VIF {"id": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "address": "fa:16:3e:fa:0f:ec", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5a9b82-2e", "ovs_interfaceid": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=bf5a9b82-2e2d-4417-8650-bbc67e82d953,network=Network(8e9d9f90-4c74-4a14-9f51-0dc87928a619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5a9b82-2e') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lazy-loading 'pci_devices' on Instance uuid d0ffe207-a89e-41ef-85af-7927ce06627e {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:51:11 user nova-compute[72782]:   <uuid>d0ffe207-a89e-41ef-85af-7927ce06627e</uuid>
Aug 14 19:51:11 user nova-compute[72782]:   <name>instance-00000012</name>
Aug 14 19:51:11 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:51:11 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:51:11 user nova-compute[72782]:   <metadata>
Aug 14 19:51:11 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:51:11 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:51:11 user nova-compute[72782]:       <nova:name>tempest-ServersNegativeTestJSON-server-1274803257</nova:name>
Aug 14 19:51:11 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:51:11</nova:creationTime>
Aug 14 19:51:11 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:51:11 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:51:11 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:51:11 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:51:11 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:51:11 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:51:11 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:51:11 user nova-compute[72782]:       <nova:owner>
Aug 14 19:51:11 user nova-compute[72782]:         <nova:user uuid="1f6db9beff934039b38439a362287274">tempest-ServersNegativeTestJSON-1211486287-project-member</nova:user>
Aug 14 19:51:11 user nova-compute[72782]:         <nova:project uuid="0fcc7dac78fa47eab14a10d2fe59d320">tempest-ServersNegativeTestJSON-1211486287</nova:project>
Aug 14 19:51:11 user nova-compute[72782]:       </nova:owner>
Aug 14 19:51:11 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:51:11 user nova-compute[72782]:       <nova:ports>
Aug 14 19:51:11 user nova-compute[72782]:         <nova:port uuid="bf5a9b82-2e2d-4417-8650-bbc67e82d953">
Aug 14 19:51:11 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 19:51:11 user nova-compute[72782]:         </nova:port>
Aug 14 19:51:11 user nova-compute[72782]:       </nova:ports>
Aug 14 19:51:11 user nova-compute[72782]:     </nova:instance>
Aug 14 19:51:11 user nova-compute[72782]:   </metadata>
Aug 14 19:51:11 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:51:11 user nova-compute[72782]:     <system>
Aug 14 19:51:11 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:51:11 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:51:11 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:51:11 user nova-compute[72782]:       <entry name="serial">d0ffe207-a89e-41ef-85af-7927ce06627e</entry>
Aug 14 19:51:11 user nova-compute[72782]:       <entry name="uuid">d0ffe207-a89e-41ef-85af-7927ce06627e</entry>
Aug 14 19:51:11 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:51:11 user nova-compute[72782]:     </system>
Aug 14 19:51:11 user nova-compute[72782]:   </sysinfo>
Aug 14 19:51:11 user nova-compute[72782]:   <os>
Aug 14 19:51:11 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:51:11 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:51:11 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:51:11 user nova-compute[72782]:   </os>
Aug 14 19:51:11 user nova-compute[72782]:   <features>
Aug 14 19:51:11 user nova-compute[72782]:     <acpi/>
Aug 14 19:51:11 user nova-compute[72782]:     <apic/>
Aug 14 19:51:11 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:51:11 user nova-compute[72782]:   </features>
Aug 14 19:51:11 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:51:11 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:51:11 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:51:11 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:51:11 user nova-compute[72782]:   </clock>
Aug 14 19:51:11 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:51:11 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:51:11 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:51:11 user nova-compute[72782]:   </cpu>
Aug 14 19:51:11 user nova-compute[72782]:   <devices>
Aug 14 19:51:11 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:51:11 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:51:11 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk"/>
Aug 14 19:51:11 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:51:11 user nova-compute[72782]:     </disk>
Aug 14 19:51:11 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:51:11 user nova-compute[72782]:       <mac address="fa:16:3e:fa:0f:ec"/>
Aug 14 19:51:11 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:51:11 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:51:11 user nova-compute[72782]:       <target dev="tapbf5a9b82-2e"/>
Aug 14 19:51:11 user nova-compute[72782]:     </interface>
Aug 14 19:51:11 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:51:11 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/console.log" append="off"/>
Aug 14 19:51:11 user nova-compute[72782]:     </serial>
Aug 14 19:51:11 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:51:11 user nova-compute[72782]:     <video>
Aug 14 19:51:11 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:51:11 user nova-compute[72782]:     </video>
Aug 14 19:51:11 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:51:11 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:51:11 user nova-compute[72782]:     </rng>
Aug 14 19:51:11 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:51:11 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:51:11 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:51:11 user nova-compute[72782]:     </memballoon>
Aug 14 19:51:11 user nova-compute[72782]:   </devices>
Aug 14 19:51:11 user nova-compute[72782]: </domain>
Aug 14 19:51:11 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:51:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1274803257',display_name='tempest-ServersNegativeTestJSON-server-1274803257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1274803257',id=18,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fcc7dac78fa47eab14a10d2fe59d320',ramdisk_id='',reservation_id='r-xxvxdr9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1211486287',owner_user_name='tempest-ServersNegativeTestJSON-1211486287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:51:10Z,user_data=None,user_id='1f6db9beff934039b38439a362287274',uuid=d0ffe207-a89e-41ef-85af-7927ce06627e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "address": "fa:16:3e:fa:0f:ec", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5a9b82-2e", "ovs_interfaceid": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Converting VIF {"id": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "address": "fa:16:3e:fa:0f:ec", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5a9b82-2e", "ovs_interfaceid": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=bf5a9b82-2e2d-4417-8650-bbc67e82d953,network=Network(8e9d9f90-4c74-4a14-9f51-0dc87928a619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5a9b82-2e') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG os_vif [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=bf5a9b82-2e2d-4417-8650-bbc67e82d953,network=Network(8e9d9f90-4c74-4a14-9f51-0dc87928a619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5a9b82-2e') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf5a9b82-2e, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf5a9b82-2e, col_values=(('external_ids', {'iface-id': 'bf5a9b82-2e2d-4417-8650-bbc67e82d953', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:0f:ec', 'vm-uuid': 'd0ffe207-a89e-41ef-85af-7927ce06627e'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:11 user nova-compute[72782]: INFO os_vif [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=bf5a9b82-2e2d-4417-8650-bbc67e82d953,network=Network(8e9d9f90-4c74-4a14-9f51-0dc87928a619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5a9b82-2e')
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:51:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] No VIF found with MAC fa:16:3e:fa:0f:ec, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG nova.network.neutron [req-266f78ca-22a0-4527-aaf6-d1e054803182 req-903b4036-a534-4194-be01-58a9398a0c60 service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Updated VIF entry in instance network info cache for port bf5a9b82-2e2d-4417-8650-bbc67e82d953. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG nova.network.neutron [req-266f78ca-22a0-4527-aaf6-d1e054803182 req-903b4036-a534-4194-be01-58a9398a0c60 service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Updating instance_info_cache with network_info: [{"id": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "address": "fa:16:3e:fa:0f:ec", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5a9b82-2e", "ovs_interfaceid": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-266f78ca-22a0-4527-aaf6-d1e054803182 req-903b4036-a534-4194-be01-58a9398a0c60 service nova] Releasing lock "refresh_cache-d0ffe207-a89e-41ef-85af-7927ce06627e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:51:12 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Instance destroyed successfully.
Aug 14 19:51:12 user nova-compute[72782]: DEBUG nova.objects.instance [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'resources' on Instance uuid 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:45:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-168865067',display_name='tempest-AttachVolumeNegativeTest-server-168865067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-168865067',id=2,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGh4ojufnQPtfxM4eGHoOyR4Gmec06h5XIWvIXJ8DsC40VCmaPCvr47+LOsm285pVn7sdaeXqtpIcJXo9028QHIC9FfOmwcdvmu+9tbuh3bQ/uiuOGZB3tzM5eg+hpSn+A==',key_name='tempest-keypair-1491984689',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:45:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2c26e0199de48ee8c48dde8177bc519',ramdisk_id='',reservation_id='r-z5z2jft3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1229463629',owner_user_name='tempest-AttachVolumeNegativeTest-1229463629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0cada11ffdb4ebc8d9e80218818ec3b',uuid=4d18b2a3-0561-4dec-8a43-ef2c3d9673a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "935f7dd0-e151-47aa-bcaf-a214f5854759", "address": "fa:16:3e:9a:a4:fc", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935f7dd0-e1", "ovs_interfaceid": "935f7dd0-e151-47aa-bcaf-a214f5854759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converting VIF {"id": "935f7dd0-e151-47aa-bcaf-a214f5854759", "address": "fa:16:3e:9a:a4:fc", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap935f7dd0-e1", "ovs_interfaceid": "935f7dd0-e151-47aa-bcaf-a214f5854759", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:a4:fc,bridge_name='br-int',has_traffic_filtering=True,id=935f7dd0-e151-47aa-bcaf-a214f5854759,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935f7dd0-e1') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG os_vif [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:a4:fc,bridge_name='br-int',has_traffic_filtering=True,id=935f7dd0-e151-47aa-bcaf-a214f5854759,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935f7dd0-e1') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap935f7dd0-e1, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:12 user nova-compute[72782]: INFO os_vif [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:a4:fc,bridge_name='br-int',has_traffic_filtering=True,id=935f7dd0-e151-47aa-bcaf-a214f5854759,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935f7dd0-e1')
Aug 14 19:51:12 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Deleting instance files /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5_del
Aug 14 19:51:12 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Deletion of /opt/stack/data/nova/instances/4d18b2a3-0561-4dec-8a43-ef2c3d9673a5_del complete
Aug 14 19:51:12 user nova-compute[72782]: INFO nova.compute.manager [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 14 19:51:12 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-9aeda3a7-c0f4-4bbe-a6a6-9342c2b29bff req-eab507a7-8b4b-4f0f-8a06-0bece6a65546 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Received event network-vif-unplugged-935f7dd0-e151-47aa-bcaf-a214f5854759 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9aeda3a7-c0f4-4bbe-a6a6-9342c2b29bff req-eab507a7-8b4b-4f0f-8a06-0bece6a65546 service nova] Acquiring lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9aeda3a7-c0f4-4bbe-a6a6-9342c2b29bff req-eab507a7-8b4b-4f0f-8a06-0bece6a65546 service nova] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9aeda3a7-c0f4-4bbe-a6a6-9342c2b29bff req-eab507a7-8b4b-4f0f-8a06-0bece6a65546 service nova] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-9aeda3a7-c0f4-4bbe-a6a6-9342c2b29bff req-eab507a7-8b4b-4f0f-8a06-0bece6a65546 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] No waiting events found dispatching network-vif-unplugged-935f7dd0-e151-47aa-bcaf-a214f5854759 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-9aeda3a7-c0f4-4bbe-a6a6-9342c2b29bff req-eab507a7-8b4b-4f0f-8a06-0bece6a65546 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Received event network-vif-unplugged-935f7dd0-e151-47aa-bcaf-a214f5854759 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:51:13 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:51:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:13 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Took 0.90 seconds to deallocate network for instance.
Aug 14 19:51:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-72079370-60dc-4d73-a4c5-634eafc39b16 req-e19efe87-ffd5-471f-bfe3-8c7d663a00c6 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Received event network-vif-deleted-935f7dd0-e151-47aa-bcaf-a214f5854759 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:13 user nova-compute[72782]: INFO nova.compute.manager [req-72079370-60dc-4d73-a4c5-634eafc39b16 req-e19efe87-ffd5-471f-bfe3-8c7d663a00c6 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Neutron deleted interface 935f7dd0-e151-47aa-bcaf-a214f5854759; detaching it from the instance and deleting it from the info cache
Aug 14 19:51:13 user nova-compute[72782]: DEBUG nova.network.neutron [req-72079370-60dc-4d73-a4c5-634eafc39b16 req-e19efe87-ffd5-471f-bfe3-8c7d663a00c6 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:51:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-72079370-60dc-4d73-a4c5-634eafc39b16 req-e19efe87-ffd5-471f-bfe3-8c7d663a00c6 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Detach interface failed, port_id=935f7dd0-e151-47aa-bcaf-a214f5854759, reason: Instance 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 19:51:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "e1052af2-5cc1-4d38-9467-032128545267" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "e1052af2-5cc1-4d38-9467-032128545267" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:51:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:13 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:51:13 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:51:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.320s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:13 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:51:13 user nova-compute[72782]: INFO nova.compute.claims [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Claim successful on node user
Aug 14 19:51:13 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Deleted allocations for instance 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5
Aug 14 19:51:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b244fcd0-6552-4a86-a8b4-4f9c2c363b9f tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.741s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG nova.network.neutron [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:51:14 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:51:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG nova.policy [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a38fa907d804b81903eb97ab88ae181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c0483a97574e7794c73fe43e51795e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:51:14 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Creating image(s)
Aug 14 19:51:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "/opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "/opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.190s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-1f77af22-3586-4e0a-bac6-44135400f2aa req-899e3fa5-93ea-4843-ab0f-a68872e8b885 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Received event network-vif-plugged-935f7dd0-e151-47aa-bcaf-a214f5854759 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1f77af22-3586-4e0a-bac6-44135400f2aa req-899e3fa5-93ea-4843-ab0f-a68872e8b885 service nova] Acquiring lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1f77af22-3586-4e0a-bac6-44135400f2aa req-899e3fa5-93ea-4843-ab0f-a68872e8b885 service nova] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1f77af22-3586-4e0a-bac6-44135400f2aa req-899e3fa5-93ea-4843-ab0f-a68872e8b885 service nova] Lock "4d18b2a3-0561-4dec-8a43-ef2c3d9673a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-1f77af22-3586-4e0a-bac6-44135400f2aa req-899e3fa5-93ea-4843-ab0f-a68872e8b885 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] No waiting events found dispatching network-vif-plugged-935f7dd0-e151-47aa-bcaf-a214f5854759 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:14 user nova-compute[72782]: WARNING nova.compute.manager [req-1f77af22-3586-4e0a-bac6-44135400f2aa req-899e3fa5-93ea-4843-ab0f-a68872e8b885 service nova] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Received unexpected event network-vif-plugged-935f7dd0-e151-47aa-bcaf-a214f5854759 for instance with vm_state deleted and task_state None.
Aug 14 19:51:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.171s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk 1073741824" returned: 0 in 0.055s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.network.neutron [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Successfully created port: aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Cannot resize image /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.objects.instance [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'migration_context' on Instance uuid e1052af2-5cc1-4d38-9467-032128545267 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Ensure instance console log exists: /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.compute.manager [req-6589b611-fc34-46df-964f-b951098b8cf2 req-138c7f31-6770-45bd-8a77-d143e49199ff service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Received event network-vif-plugged-bf5a9b82-2e2d-4417-8650-bbc67e82d953 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6589b611-fc34-46df-964f-b951098b8cf2 req-138c7f31-6770-45bd-8a77-d143e49199ff service nova] Acquiring lock "d0ffe207-a89e-41ef-85af-7927ce06627e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6589b611-fc34-46df-964f-b951098b8cf2 req-138c7f31-6770-45bd-8a77-d143e49199ff service nova] Lock "d0ffe207-a89e-41ef-85af-7927ce06627e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6589b611-fc34-46df-964f-b951098b8cf2 req-138c7f31-6770-45bd-8a77-d143e49199ff service nova] Lock "d0ffe207-a89e-41ef-85af-7927ce06627e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.compute.manager [req-6589b611-fc34-46df-964f-b951098b8cf2 req-138c7f31-6770-45bd-8a77-d143e49199ff service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] No waiting events found dispatching network-vif-plugged-bf5a9b82-2e2d-4417-8650-bbc67e82d953 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:15 user nova-compute[72782]: WARNING nova.compute.manager [req-6589b611-fc34-46df-964f-b951098b8cf2 req-138c7f31-6770-45bd-8a77-d143e49199ff service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Received unexpected event network-vif-plugged-bf5a9b82-2e2d-4417-8650-bbc67e82d953 for instance with vm_state building and task_state spawning.
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.compute.manager [req-6589b611-fc34-46df-964f-b951098b8cf2 req-138c7f31-6770-45bd-8a77-d143e49199ff service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Received event network-vif-plugged-bf5a9b82-2e2d-4417-8650-bbc67e82d953 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6589b611-fc34-46df-964f-b951098b8cf2 req-138c7f31-6770-45bd-8a77-d143e49199ff service nova] Acquiring lock "d0ffe207-a89e-41ef-85af-7927ce06627e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6589b611-fc34-46df-964f-b951098b8cf2 req-138c7f31-6770-45bd-8a77-d143e49199ff service nova] Lock "d0ffe207-a89e-41ef-85af-7927ce06627e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6589b611-fc34-46df-964f-b951098b8cf2 req-138c7f31-6770-45bd-8a77-d143e49199ff service nova] Lock "d0ffe207-a89e-41ef-85af-7927ce06627e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.compute.manager [req-6589b611-fc34-46df-964f-b951098b8cf2 req-138c7f31-6770-45bd-8a77-d143e49199ff service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] No waiting events found dispatching network-vif-plugged-bf5a9b82-2e2d-4417-8650-bbc67e82d953 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:15 user nova-compute[72782]: WARNING nova.compute.manager [req-6589b611-fc34-46df-964f-b951098b8cf2 req-138c7f31-6770-45bd-8a77-d143e49199ff service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Received unexpected event network-vif-plugged-bf5a9b82-2e2d-4417-8650-bbc67e82d953 for instance with vm_state building and task_state spawning.
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042675.509187, d0ffe207-a89e-41ef-85af-7927ce06627e => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:51:15 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] VM Resumed (Lifecycle Event)
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:51:15 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Instance spawned successfully.
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:51:15 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042675.5109203, d0ffe207-a89e-41ef-85af-7927ce06627e => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:51:15 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] VM Started (Lifecycle Event)
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:51:15 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:51:15 user nova-compute[72782]: INFO nova.compute.manager [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Took 5.85 seconds to spawn the instance on the hypervisor.
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:51:15 user nova-compute[72782]: INFO nova.compute.manager [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Took 6.61 seconds to build instance.
Aug 14 19:51:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fbb72816-8328-4f45-80fb-b988c8c894fc tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "d0ffe207-a89e-41ef-85af-7927ce06627e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.730s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.network.neutron [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Successfully updated port: aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "refresh_cache-e1052af2-5cc1-4d38-9467-032128545267" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquired lock "refresh_cache-e1052af2-5cc1-4d38-9467-032128545267" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.network.neutron [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:51:15 user nova-compute[72782]: DEBUG nova.network.neutron [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.network.neutron [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Updating instance_info_cache with network_info: [{"id": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "address": "fa:16:3e:e2:66:90", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e90c-96", "ovs_interfaceid": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Releasing lock "refresh_cache-e1052af2-5cc1-4d38-9467-032128545267" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Instance network_info: |[{"id": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "address": "fa:16:3e:e2:66:90", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e90c-96", "ovs_interfaceid": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Start _get_guest_xml network_info=[{"id": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "address": "fa:16:3e:e2:66:90", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e90c-96", "ovs_interfaceid": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:51:16 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:51:16 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:51:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-490147315',display_name='tempest-tempest.common.compute-instance-490147315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-490147315',id=19,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV5fiZmeiHTnYtIHzitMZse2ribzsRQ2484EQ9im6HhPR/lFEGGu+BQkl8yoXRtLPpzrj+N0//a8a7yN4uMfP50FthqJ6WC/rfTifEYmo41fdCr/FNWJ/A2uqubY97gOQ==',key_name='tempest-keypair-967502446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6c0483a97574e7794c73fe43e51795e',ramdisk_id='',reservation_id='r-c2v7tgso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-956209876',owner_user_name='tempest-ServerActionsTestOtherA-956209876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:51:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a38fa907d804b81903eb97ab88ae181',uuid=e1052af2-5cc1-4d38-9467-032128545267,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "address": "fa:16:3e:e2:66:90", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e90c-96", "ovs_interfaceid": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converting VIF {"id": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "address": "fa:16:3e:e2:66:90", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e90c-96", "ovs_interfaceid": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:66:90,bridge_name='br-int',has_traffic_filtering=True,id=aa74e90c-967b-4500-b0a1-9cd530b0e42f,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e90c-96') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.objects.instance [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'pci_devices' on Instance uuid e1052af2-5cc1-4d38-9467-032128545267 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:51:16 user nova-compute[72782]:   <uuid>e1052af2-5cc1-4d38-9467-032128545267</uuid>
Aug 14 19:51:16 user nova-compute[72782]:   <name>instance-00000013</name>
Aug 14 19:51:16 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:51:16 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:51:16 user nova-compute[72782]:   <metadata>
Aug 14 19:51:16 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:51:16 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:51:16 user nova-compute[72782]:       <nova:name>tempest-tempest.common.compute-instance-490147315</nova:name>
Aug 14 19:51:16 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:51:16</nova:creationTime>
Aug 14 19:51:16 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:51:16 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:51:16 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:51:16 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:51:16 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:51:16 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:51:16 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:51:16 user nova-compute[72782]:       <nova:owner>
Aug 14 19:51:16 user nova-compute[72782]:         <nova:user uuid="8a38fa907d804b81903eb97ab88ae181">tempest-ServerActionsTestOtherA-956209876-project-member</nova:user>
Aug 14 19:51:16 user nova-compute[72782]:         <nova:project uuid="b6c0483a97574e7794c73fe43e51795e">tempest-ServerActionsTestOtherA-956209876</nova:project>
Aug 14 19:51:16 user nova-compute[72782]:       </nova:owner>
Aug 14 19:51:16 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:51:16 user nova-compute[72782]:       <nova:ports>
Aug 14 19:51:16 user nova-compute[72782]:         <nova:port uuid="aa74e90c-967b-4500-b0a1-9cd530b0e42f">
Aug 14 19:51:16 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 19:51:16 user nova-compute[72782]:         </nova:port>
Aug 14 19:51:16 user nova-compute[72782]:       </nova:ports>
Aug 14 19:51:16 user nova-compute[72782]:     </nova:instance>
Aug 14 19:51:16 user nova-compute[72782]:   </metadata>
Aug 14 19:51:16 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:51:16 user nova-compute[72782]:     <system>
Aug 14 19:51:16 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:51:16 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:51:16 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:51:16 user nova-compute[72782]:       <entry name="serial">e1052af2-5cc1-4d38-9467-032128545267</entry>
Aug 14 19:51:16 user nova-compute[72782]:       <entry name="uuid">e1052af2-5cc1-4d38-9467-032128545267</entry>
Aug 14 19:51:16 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:51:16 user nova-compute[72782]:     </system>
Aug 14 19:51:16 user nova-compute[72782]:   </sysinfo>
Aug 14 19:51:16 user nova-compute[72782]:   <os>
Aug 14 19:51:16 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:51:16 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:51:16 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:51:16 user nova-compute[72782]:   </os>
Aug 14 19:51:16 user nova-compute[72782]:   <features>
Aug 14 19:51:16 user nova-compute[72782]:     <acpi/>
Aug 14 19:51:16 user nova-compute[72782]:     <apic/>
Aug 14 19:51:16 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:51:16 user nova-compute[72782]:   </features>
Aug 14 19:51:16 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:51:16 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:51:16 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:51:16 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:51:16 user nova-compute[72782]:   </clock>
Aug 14 19:51:16 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:51:16 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:51:16 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:51:16 user nova-compute[72782]:   </cpu>
Aug 14 19:51:16 user nova-compute[72782]:   <devices>
Aug 14 19:51:16 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:51:16 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:51:16 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk"/>
Aug 14 19:51:16 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:51:16 user nova-compute[72782]:     </disk>
Aug 14 19:51:16 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:51:16 user nova-compute[72782]:       <mac address="fa:16:3e:e2:66:90"/>
Aug 14 19:51:16 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:51:16 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:51:16 user nova-compute[72782]:       <target dev="tapaa74e90c-96"/>
Aug 14 19:51:16 user nova-compute[72782]:     </interface>
Aug 14 19:51:16 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:51:16 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/console.log" append="off"/>
Aug 14 19:51:16 user nova-compute[72782]:     </serial>
Aug 14 19:51:16 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:51:16 user nova-compute[72782]:     <video>
Aug 14 19:51:16 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:51:16 user nova-compute[72782]:     </video>
Aug 14 19:51:16 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:51:16 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:51:16 user nova-compute[72782]:     </rng>
Aug 14 19:51:16 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:51:16 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:51:16 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:51:16 user nova-compute[72782]:     </memballoon>
Aug 14 19:51:16 user nova-compute[72782]:   </devices>
Aug 14 19:51:16 user nova-compute[72782]: </domain>
Aug 14 19:51:16 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:51:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-490147315',display_name='tempest-tempest.common.compute-instance-490147315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-490147315',id=19,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV5fiZmeiHTnYtIHzitMZse2ribzsRQ2484EQ9im6HhPR/lFEGGu+BQkl8yoXRtLPpzrj+N0//a8a7yN4uMfP50FthqJ6WC/rfTifEYmo41fdCr/FNWJ/A2uqubY97gOQ==',key_name='tempest-keypair-967502446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6c0483a97574e7794c73fe43e51795e',ramdisk_id='',reservation_id='r-c2v7tgso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-956209876',owner_user_name='tempest-ServerActionsTestOtherA-956209876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:51:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a38fa907d804b81903eb97ab88ae181',uuid=e1052af2-5cc1-4d38-9467-032128545267,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "address": "fa:16:3e:e2:66:90", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e90c-96", "ovs_interfaceid": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converting VIF {"id": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "address": "fa:16:3e:e2:66:90", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e90c-96", "ovs_interfaceid": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:66:90,bridge_name='br-int',has_traffic_filtering=True,id=aa74e90c-967b-4500-b0a1-9cd530b0e42f,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e90c-96') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG os_vif [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:66:90,bridge_name='br-int',has_traffic_filtering=True,id=aa74e90c-967b-4500-b0a1-9cd530b0e42f,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e90c-96') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa74e90c-96, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaa74e90c-96, col_values=(('external_ids', {'iface-id': 'aa74e90c-967b-4500-b0a1-9cd530b0e42f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:66:90', 'vm-uuid': 'e1052af2-5cc1-4d38-9467-032128545267'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:16 user nova-compute[72782]: INFO os_vif [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:66:90,bridge_name='br-int',has_traffic_filtering=True,id=aa74e90c-967b-4500-b0a1-9cd530b0e42f,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e90c-96')
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:51:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] No VIF found with MAC fa:16:3e:e2:66:90, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:51:17 user nova-compute[72782]: DEBUG nova.compute.manager [req-ef48ebaf-8351-4f16-951c-08d17899f263 req-eced22ca-0d64-4883-b79c-0f096c90b141 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received event network-changed-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:17 user nova-compute[72782]: DEBUG nova.compute.manager [req-ef48ebaf-8351-4f16-951c-08d17899f263 req-eced22ca-0d64-4883-b79c-0f096c90b141 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Refreshing instance network info cache due to event network-changed-aa74e90c-967b-4500-b0a1-9cd530b0e42f. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:51:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ef48ebaf-8351-4f16-951c-08d17899f263 req-eced22ca-0d64-4883-b79c-0f096c90b141 service nova] Acquiring lock "refresh_cache-e1052af2-5cc1-4d38-9467-032128545267" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:51:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ef48ebaf-8351-4f16-951c-08d17899f263 req-eced22ca-0d64-4883-b79c-0f096c90b141 service nova] Acquired lock "refresh_cache-e1052af2-5cc1-4d38-9467-032128545267" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:51:17 user nova-compute[72782]: DEBUG nova.network.neutron [req-ef48ebaf-8351-4f16-951c-08d17899f263 req-eced22ca-0d64-4883-b79c-0f096c90b141 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Refreshing network info cache for port aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:51:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:17 user nova-compute[72782]: DEBUG nova.network.neutron [req-ef48ebaf-8351-4f16-951c-08d17899f263 req-eced22ca-0d64-4883-b79c-0f096c90b141 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Updated VIF entry in instance network info cache for port aa74e90c-967b-4500-b0a1-9cd530b0e42f. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:51:17 user nova-compute[72782]: DEBUG nova.network.neutron [req-ef48ebaf-8351-4f16-951c-08d17899f263 req-eced22ca-0d64-4883-b79c-0f096c90b141 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Updating instance_info_cache with network_info: [{"id": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "address": "fa:16:3e:e2:66:90", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e90c-96", "ovs_interfaceid": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:51:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ef48ebaf-8351-4f16-951c-08d17899f263 req-eced22ca-0d64-4883-b79c-0f096c90b141 service nova] Releasing lock "refresh_cache-e1052af2-5cc1-4d38-9467-032128545267" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:51:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-0c2bb3b0-4a11-4416-acaa-3d55812aa5c2 req-3fb7d94f-42c5-4dd1-ab6a-8844965fd744 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received event network-vif-plugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0c2bb3b0-4a11-4416-acaa-3d55812aa5c2 req-3fb7d94f-42c5-4dd1-ab6a-8844965fd744 service nova] Acquiring lock "e1052af2-5cc1-4d38-9467-032128545267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0c2bb3b0-4a11-4416-acaa-3d55812aa5c2 req-3fb7d94f-42c5-4dd1-ab6a-8844965fd744 service nova] Lock "e1052af2-5cc1-4d38-9467-032128545267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0c2bb3b0-4a11-4416-acaa-3d55812aa5c2 req-3fb7d94f-42c5-4dd1-ab6a-8844965fd744 service nova] Lock "e1052af2-5cc1-4d38-9467-032128545267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-0c2bb3b0-4a11-4416-acaa-3d55812aa5c2 req-3fb7d94f-42c5-4dd1-ab6a-8844965fd744 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] No waiting events found dispatching network-vif-plugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:19 user nova-compute[72782]: WARNING nova.compute.manager [req-0c2bb3b0-4a11-4416-acaa-3d55812aa5c2 req-3fb7d94f-42c5-4dd1-ab6a-8844965fd744 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received unexpected event network-vif-plugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f for instance with vm_state building and task_state spawning.
Aug 14 19:51:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-0c2bb3b0-4a11-4416-acaa-3d55812aa5c2 req-3fb7d94f-42c5-4dd1-ab6a-8844965fd744 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received event network-vif-plugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0c2bb3b0-4a11-4416-acaa-3d55812aa5c2 req-3fb7d94f-42c5-4dd1-ab6a-8844965fd744 service nova] Acquiring lock "e1052af2-5cc1-4d38-9467-032128545267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0c2bb3b0-4a11-4416-acaa-3d55812aa5c2 req-3fb7d94f-42c5-4dd1-ab6a-8844965fd744 service nova] Lock "e1052af2-5cc1-4d38-9467-032128545267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0c2bb3b0-4a11-4416-acaa-3d55812aa5c2 req-3fb7d94f-42c5-4dd1-ab6a-8844965fd744 service nova] Lock "e1052af2-5cc1-4d38-9467-032128545267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-0c2bb3b0-4a11-4416-acaa-3d55812aa5c2 req-3fb7d94f-42c5-4dd1-ab6a-8844965fd744 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] No waiting events found dispatching network-vif-plugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:19 user nova-compute[72782]: WARNING nova.compute.manager [req-0c2bb3b0-4a11-4416-acaa-3d55812aa5c2 req-3fb7d94f-42c5-4dd1-ab6a-8844965fd744 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received unexpected event network-vif-plugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f for instance with vm_state building and task_state spawning.
Aug 14 19:51:20 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042680.6363904, e1052af2-5cc1-4d38-9467-032128545267 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:51:20 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: e1052af2-5cc1-4d38-9467-032128545267] VM Resumed (Lifecycle Event)
Aug 14 19:51:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:51:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:51:20 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: e1052af2-5cc1-4d38-9467-032128545267] Instance spawned successfully.
Aug 14 19:51:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:51:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: e1052af2-5cc1-4d38-9467-032128545267] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:51:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: e1052af2-5cc1-4d38-9467-032128545267] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:51:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:51:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:51:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:51:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:51:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:51:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:51:20 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: e1052af2-5cc1-4d38-9467-032128545267] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:51:20 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042680.637862, e1052af2-5cc1-4d38-9467-032128545267 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:51:20 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: e1052af2-5cc1-4d38-9467-032128545267] VM Started (Lifecycle Event)
Aug 14 19:51:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: e1052af2-5cc1-4d38-9467-032128545267] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:51:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: e1052af2-5cc1-4d38-9467-032128545267] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:51:20 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: e1052af2-5cc1-4d38-9467-032128545267] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:51:20 user nova-compute[72782]: INFO nova.compute.manager [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Took 6.30 seconds to spawn the instance on the hypervisor.
Aug 14 19:51:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:51:20 user nova-compute[72782]: INFO nova.compute.manager [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Took 7.36 seconds to build instance.
Aug 14 19:51:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7c8f2d54-d065-4249-8b1b-2c9667d18dea tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "e1052af2-5cc1-4d38-9467-032128545267" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.500s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:26 user nova-compute[72782]: INFO nova.compute.manager [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Terminating instance
Aug 14 19:51:26 user nova-compute[72782]: DEBUG nova.compute.manager [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:26 user nova-compute[72782]: INFO nova.compute.manager [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Detaching volume 00bc3052-85b8-4a79-b0e7-83799a0f4d07
Aug 14 19:51:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:26 user nova-compute[72782]: INFO nova.virt.block_device [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Attempting to driver detach volume 00bc3052-85b8-4a79-b0e7-83799a0f4d07 from mountpoint /dev/vdb
Aug 14 19:51:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Attempting to detach device vdb from instance 132b9b0b-9556-4aaf-a9ad-577e18215e84 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:51:26 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:51:26 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 19:51:26 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:51:26 user nova-compute[72782]:   <serial>00bc3052-85b8-4a79-b0e7-83799a0f4d07</serial>
Aug 14 19:51:26 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:51:26 user nova-compute[72782]: </disk>
Aug 14 19:51:26 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:51:26 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Successfully detached device vdb from instance 132b9b0b-9556-4aaf-a9ad-577e18215e84 from the persistent domain config.
Aug 14 19:51:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 132b9b0b-9556-4aaf-a9ad-577e18215e84 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:51:26 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:51:26 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 19:51:26 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:51:26 user nova-compute[72782]:   <serial>00bc3052-85b8-4a79-b0e7-83799a0f4d07</serial>
Aug 14 19:51:26 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:51:26 user nova-compute[72782]: </disk>
Aug 14 19:51:26 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-5dc9aa14-56d6-4024-8dbf-6c50315ef40f req-c3fdb32f-1e4e-48f9-8e02-55d09a7a68b9 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Received event network-vif-unplugged-888a72be-5707-4d58-98e1-b472c928de22 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5dc9aa14-56d6-4024-8dbf-6c50315ef40f req-c3fdb32f-1e4e-48f9-8e02-55d09a7a68b9 service nova] Acquiring lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5dc9aa14-56d6-4024-8dbf-6c50315ef40f req-c3fdb32f-1e4e-48f9-8e02-55d09a7a68b9 service nova] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5dc9aa14-56d6-4024-8dbf-6c50315ef40f req-c3fdb32f-1e4e-48f9-8e02-55d09a7a68b9 service nova] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-5dc9aa14-56d6-4024-8dbf-6c50315ef40f req-c3fdb32f-1e4e-48f9-8e02-55d09a7a68b9 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] No waiting events found dispatching network-vif-unplugged-888a72be-5707-4d58-98e1-b472c928de22 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-5dc9aa14-56d6-4024-8dbf-6c50315ef40f req-c3fdb32f-1e4e-48f9-8e02-55d09a7a68b9 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Received event network-vif-unplugged-888a72be-5707-4d58-98e1-b472c928de22 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692042687.2752464, 132b9b0b-9556-4aaf-a9ad-577e18215e84 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 132b9b0b-9556-4aaf-a9ad-577e18215e84 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:51:27 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Successfully detached device vdb from instance 132b9b0b-9556-4aaf-a9ad-577e18215e84 from the live domain config.
Aug 14 19:51:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nuShmHab', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:51:27 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042672.302817, 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:51:27 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] VM Stopped (Lifecycle Event)
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:27 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Instance destroyed successfully.
Aug 14 19:51:27 user nova-compute[72782]: DEBUG nova.objects.instance [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lazy-loading 'resources' on Instance uuid b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1177120667',display_name='tempest-VolumesAdminNegativeTest-server-1177120667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1177120667',id=4,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH00Mhm4BdUQ/WKnJrAbE4oMdBwmMvak2fIgW/fa64RGW+K6Tw9nYvgT7rt9GMHrdE0UJc2ad9A6656U8CO7+xu8xj+cJ4fdOwb9EXiw/9YkDO3dKIrlmyKbHaK+Q5nGNA==',key_name='tempest-keypair-783314842',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:45:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c294f11708224e9a9a69ae37139b4d06',ramdisk_id='',reservation_id='r-b1xmkvvx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-468605289',owner_user_name='tempest-VolumesAdminNegativeTest-468605289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01da439b977447d9acd627af965122bd',uuid=b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "888a72be-5707-4d58-98e1-b472c928de22", "address": "fa:16:3e:83:d0:33", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888a72be-57", "ovs_interfaceid": "888a72be-5707-4d58-98e1-b472c928de22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Converting VIF {"id": "888a72be-5707-4d58-98e1-b472c928de22", "address": "fa:16:3e:83:d0:33", "network": {"id": "f55b2a79-f0a6-4b3f-991b-a93ae0ded8be", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1741999298-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c294f11708224e9a9a69ae37139b4d06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888a72be-57", "ovs_interfaceid": "888a72be-5707-4d58-98e1-b472c928de22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:d0:33,bridge_name='br-int',has_traffic_filtering=True,id=888a72be-5707-4d58-98e1-b472c928de22,network=Network(f55b2a79-f0a6-4b3f-991b-a93ae0ded8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888a72be-57') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_vif [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:d0:33,bridge_name='br-int',has_traffic_filtering=True,id=888a72be-5707-4d58-98e1-b472c928de22,network=Network(f55b2a79-f0a6-4b3f-991b-a93ae0ded8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888a72be-57') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[638486a7-4775-4bad-adc7-d5b4a670ac39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG nova.compute.manager [None req-d68621aa-cf28-448a-b84e-fe98fba47a95 None None] [instance: 4d18b2a3-0561-4dec-8a43-ef2c3d9673a5] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap888a72be-57, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:27 user nova-compute[72782]: INFO os_vif [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:d0:33,bridge_name='br-int',has_traffic_filtering=True,id=888a72be-5707-4d58-98e1-b472c928de22,network=Network(f55b2a79-f0a6-4b3f-991b-a93ae0ded8be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888a72be-57')
Aug 14 19:51:27 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Deleting instance files /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6_del
Aug 14 19:51:27 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Deletion of /opt/stack/data/nova/instances/b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6_del complete
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f672c4-92ba-4cd0-ab86-577430839abb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:51:27 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:51:27 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:51:27 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:51:27 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 (non-flash)
Aug 14 19:51:27 user nova-compute[72782]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:51:27 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:51:27 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:51:27 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e85a80d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f470282-05b6-4965-8eb1-b4b345f74434]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:27 user nova-compute[72782]: INFO nova.compute.manager [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6f1db9-7acb-4b6a-a7ca-7cf15ed49fab]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f353dab5-d79f-4fef-8fdf-b4551ceb1900]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[90059422-fd8d-4d80-873f-63e9f9bf12e4]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d8c065-952b-4211-828f-291894a71b94]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6d4fa5-69a2-4502-8587-7b946fde009b]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07, portal: 172.16.0.220,3260]
Aug 14 19:51:27 user nova-compute[72782]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07, portal: 172.16.0.220,3260] successful.
Aug 14 19:51:27 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00bc3052-85b8-4a79-b0e7-83799a0f4d07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af10223-e49b-46aa-91f4-b81cf880f786]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] <== disconnect_volume: return (323ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:51:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:51:28 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Took 0.94 seconds to deallocate network for instance.
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:28 user nova-compute[72782]: WARNING nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Aug 14 19:51:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid 132b9b0b-9556-4aaf-a9ad-577e18215e84 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid 259c51df-ccd6-456e-85f4-7aaf4cba2b69 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid d334dc9b-8b50-41bb-b0e8-73dda305f590 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid 792f31f1-4079-4443-81f2-b1e364a9ee14 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid c748103b-a37c-47c5-8394-ea54749f27eb {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid d0ffe207-a89e-41ef-85af-7927ce06627e {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid e1052af2-5cc1-4d38-9467-032128545267 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG nova.objects.instance [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lazy-loading 'flavor' on Instance uuid 132b9b0b-9556-4aaf-a9ad-577e18215e84 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "c748103b-a37c-47c5-8394-ea54749f27eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "d0ffe207-a89e-41ef-85af-7927ce06627e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "d0ffe207-a89e-41ef-85af-7927ce06627e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "e1052af2-5cc1-4d38-9467-032128545267" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "e1052af2-5cc1-4d38-9467-032128545267" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7fd0d5a7-7331-4f3c-8290-95cfb5307ed5 tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.173s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.057s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "c748103b-a37c-47c5-8394-ea54749f27eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "e1052af2-5cc1-4d38-9467-032128545267" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "d0ffe207-a89e-41ef-85af-7927ce06627e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.128s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG nova.compute.manager [req-fa11ee5d-27ac-4bb3-a142-2227f74665d8 req-d9103d5d-fba3-40be-abdd-79aad50abd06 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Received event network-vif-plugged-888a72be-5707-4d58-98e1-b472c928de22 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fa11ee5d-27ac-4bb3-a142-2227f74665d8 req-d9103d5d-fba3-40be-abdd-79aad50abd06 service nova] Acquiring lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fa11ee5d-27ac-4bb3-a142-2227f74665d8 req-d9103d5d-fba3-40be-abdd-79aad50abd06 service nova] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fa11ee5d-27ac-4bb3-a142-2227f74665d8 req-d9103d5d-fba3-40be-abdd-79aad50abd06 service nova] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG nova.compute.manager [req-fa11ee5d-27ac-4bb3-a142-2227f74665d8 req-d9103d5d-fba3-40be-abdd-79aad50abd06 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] No waiting events found dispatching network-vif-plugged-888a72be-5707-4d58-98e1-b472c928de22 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:28 user nova-compute[72782]: WARNING nova.compute.manager [req-fa11ee5d-27ac-4bb3-a142-2227f74665d8 req-d9103d5d-fba3-40be-abdd-79aad50abd06 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Received unexpected event network-vif-plugged-888a72be-5707-4d58-98e1-b472c928de22 for instance with vm_state deleted and task_state None.
Aug 14 19:51:28 user nova-compute[72782]: DEBUG nova.compute.manager [req-fa11ee5d-27ac-4bb3-a142-2227f74665d8 req-d9103d5d-fba3-40be-abdd-79aad50abd06 service nova] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Received event network-vif-deleted-888a72be-5707-4d58-98e1-b472c928de22 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:28 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Deleted allocations for instance b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-24d87d0a-936e-41e4-b13d-a8bbfba6a60a tempest-VolumesAdminNegativeTest-468605289 tempest-VolumesAdminNegativeTest-468605289-project-member] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.826s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.506s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:28 user nova-compute[72782]: INFO nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] During sync_power_state the instance has a pending task (deleting). Skip.
Aug 14 19:51:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:31 user nova-compute[72782]: DEBUG nova.compute.manager [req-3056d9ca-0fdd-4017-8171-f68987657b8a req-3581220b-b95d-4bf2-9d34-5621b84d4e5d service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-changed-57339d04-6d3a-4eec-9ca2-bcd028028335 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:31 user nova-compute[72782]: DEBUG nova.compute.manager [req-3056d9ca-0fdd-4017-8171-f68987657b8a req-3581220b-b95d-4bf2-9d34-5621b84d4e5d service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Refreshing instance network info cache due to event network-changed-57339d04-6d3a-4eec-9ca2-bcd028028335. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:51:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3056d9ca-0fdd-4017-8171-f68987657b8a req-3581220b-b95d-4bf2-9d34-5621b84d4e5d service nova] Acquiring lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:51:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3056d9ca-0fdd-4017-8171-f68987657b8a req-3581220b-b95d-4bf2-9d34-5621b84d4e5d service nova] Acquired lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:51:31 user nova-compute[72782]: DEBUG nova.network.neutron [req-3056d9ca-0fdd-4017-8171-f68987657b8a req-3581220b-b95d-4bf2-9d34-5621b84d4e5d service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Refreshing network info cache for port 57339d04-6d3a-4eec-9ca2-bcd028028335 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:51:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:32 user nova-compute[72782]: DEBUG nova.network.neutron [req-3056d9ca-0fdd-4017-8171-f68987657b8a req-3581220b-b95d-4bf2-9d34-5621b84d4e5d service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updated VIF entry in instance network info cache for port 57339d04-6d3a-4eec-9ca2-bcd028028335. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:51:32 user nova-compute[72782]: DEBUG nova.network.neutron [req-3056d9ca-0fdd-4017-8171-f68987657b8a req-3581220b-b95d-4bf2-9d34-5621b84d4e5d service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updating instance_info_cache with network_info: [{"id": "57339d04-6d3a-4eec-9ca2-bcd028028335", "address": "fa:16:3e:b3:73:cf", "network": {"id": "c9bb353d-5f85-45cd-9f62-a069db7c3dfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-255362601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57339d04-6d", "ovs_interfaceid": "57339d04-6d3a-4eec-9ca2-bcd028028335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55021cb8-5aac-42d2-898b-13b28995d3d8", "address": "fa:16:3e:ad:b1:39", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55021cb8-5a", "ovs_interfaceid": "55021cb8-5aac-42d2-898b-13b28995d3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14864729-c342-452f-8bb9-94895ac93ac3", "address": "fa:16:3e:b7:12:96", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14864729-c3", "ovs_interfaceid": "14864729-c342-452f-8bb9-94895ac93ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73b00bb4-1307-466c-9ab7-098e44c86981", "address": "fa:16:3e:56:b6:55", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b00bb4-13", "ovs_interfaceid": "73b00bb4-1307-466c-9ab7-098e44c86981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "address": "fa:16:3e:c6:ce:13", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ef3b6e-7d", "ovs_interfaceid": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "address": "fa:16:3e:df:c6:8f", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap613cc4e1-ff", "ovs_interfaceid": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "address": "fa:16:3e:9c:65:37", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10f0761-24", "ovs_interfaceid": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:51:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3056d9ca-0fdd-4017-8171-f68987657b8a req-3581220b-b95d-4bf2-9d34-5621b84d4e5d service nova] Releasing lock "refresh_cache-d334dc9b-8b50-41bb-b0e8-73dda305f590" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:51:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:34 user nova-compute[72782]: INFO nova.compute.manager [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Terminating instance
Aug 14 19:51:34 user nova-compute[72782]: DEBUG nova.compute.manager [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG nova.compute.manager [req-0c808475-ad74-44b3-ab2d-b1973e7a1288 req-62d9e6b4-1d52-48df-a2a1-68c263da04a7 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-unplugged-57339d04-6d3a-4eec-9ca2-bcd028028335 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0c808475-ad74-44b3-ab2d-b1973e7a1288 req-62d9e6b4-1d52-48df-a2a1-68c263da04a7 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0c808475-ad74-44b3-ab2d-b1973e7a1288 req-62d9e6b4-1d52-48df-a2a1-68c263da04a7 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0c808475-ad74-44b3-ab2d-b1973e7a1288 req-62d9e6b4-1d52-48df-a2a1-68c263da04a7 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG nova.compute.manager [req-0c808475-ad74-44b3-ab2d-b1973e7a1288 req-62d9e6b4-1d52-48df-a2a1-68c263da04a7 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-unplugged-57339d04-6d3a-4eec-9ca2-bcd028028335 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG nova.compute.manager [req-0c808475-ad74-44b3-ab2d-b1973e7a1288 req-62d9e6b4-1d52-48df-a2a1-68c263da04a7 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-unplugged-57339d04-6d3a-4eec-9ca2-bcd028028335 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-a1d4f6a8-437e-4ae7-87ab-94d76ec34db2 req-a822befd-f8fc-4046-a344-06dfd3c0745b service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-unplugged-73b00bb4-1307-466c-9ab7-098e44c86981 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a1d4f6a8-437e-4ae7-87ab-94d76ec34db2 req-a822befd-f8fc-4046-a344-06dfd3c0745b service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a1d4f6a8-437e-4ae7-87ab-94d76ec34db2 req-a822befd-f8fc-4046-a344-06dfd3c0745b service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a1d4f6a8-437e-4ae7-87ab-94d76ec34db2 req-a822befd-f8fc-4046-a344-06dfd3c0745b service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-a1d4f6a8-437e-4ae7-87ab-94d76ec34db2 req-a822befd-f8fc-4046-a344-06dfd3c0745b service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-unplugged-73b00bb4-1307-466c-9ab7-098e44c86981 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-a1d4f6a8-437e-4ae7-87ab-94d76ec34db2 req-a822befd-f8fc-4046-a344-06dfd3c0745b service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-unplugged-73b00bb4-1307-466c-9ab7-098e44c86981 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-9e707e0e-adaa-441f-bfe5-ec5229b7dfce req-d06bcef1-a488-4ae7-a825-8ff8d70fcccb service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-unplugged-a10f0761-24bb-4ad9-bb7a-bc9961c576fc {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9e707e0e-adaa-441f-bfe5-ec5229b7dfce req-d06bcef1-a488-4ae7-a825-8ff8d70fcccb service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9e707e0e-adaa-441f-bfe5-ec5229b7dfce req-d06bcef1-a488-4ae7-a825-8ff8d70fcccb service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9e707e0e-adaa-441f-bfe5-ec5229b7dfce req-d06bcef1-a488-4ae7-a825-8ff8d70fcccb service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-9e707e0e-adaa-441f-bfe5-ec5229b7dfce req-d06bcef1-a488-4ae7-a825-8ff8d70fcccb service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-unplugged-a10f0761-24bb-4ad9-bb7a-bc9961c576fc {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-9e707e0e-adaa-441f-bfe5-ec5229b7dfce req-d06bcef1-a488-4ae7-a825-8ff8d70fcccb service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-unplugged-a10f0761-24bb-4ad9-bb7a-bc9961c576fc for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:36 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Instance destroyed successfully.
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.objects.instance [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lazy-loading 'resources' on Instance uuid d334dc9b-8b50-41bb-b0e8-73dda305f590 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:50:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:50:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57339d04-6d3a-4eec-9ca2-bcd028028335", "address": "fa:16:3e:b3:73:cf", "network": {"id": "c9bb353d-5f85-45cd-9f62-a069db7c3dfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-255362601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57339d04-6d", "ovs_interfaceid": "57339d04-6d3a-4eec-9ca2-bcd028028335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "57339d04-6d3a-4eec-9ca2-bcd028028335", "address": "fa:16:3e:b3:73:cf", "network": {"id": "c9bb353d-5f85-45cd-9f62-a069db7c3dfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-255362601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57339d04-6d", "ovs_interfaceid": "57339d04-6d3a-4eec-9ca2-bcd028028335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:73:cf,bridge_name='br-int',has_traffic_filtering=True,id=57339d04-6d3a-4eec-9ca2-bcd028028335,network=Network(c9bb353d-5f85-45cd-9f62-a069db7c3dfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57339d04-6d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:73:cf,bridge_name='br-int',has_traffic_filtering=True,id=57339d04-6d3a-4eec-9ca2-bcd028028335,network=Network(c9bb353d-5f85-45cd-9f62-a069db7c3dfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57339d04-6d') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57339d04-6d, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:36 user nova-compute[72782]: INFO os_vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:73:cf,bridge_name='br-int',has_traffic_filtering=True,id=57339d04-6d3a-4eec-9ca2-bcd028028335,network=Network(c9bb353d-5f85-45cd-9f62-a069db7c3dfd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57339d04-6d')
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:50:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:50:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55021cb8-5aac-42d2-898b-13b28995d3d8", "address": "fa:16:3e:ad:b1:39", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55021cb8-5a", "ovs_interfaceid": "55021cb8-5aac-42d2-898b-13b28995d3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "55021cb8-5aac-42d2-898b-13b28995d3d8", "address": "fa:16:3e:ad:b1:39", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55021cb8-5a", "ovs_interfaceid": "55021cb8-5aac-42d2-898b-13b28995d3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=55021cb8-5aac-42d2-898b-13b28995d3d8,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55021cb8-5a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=55021cb8-5aac-42d2-898b-13b28995d3d8,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55021cb8-5a') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55021cb8-5a, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:36 user nova-compute[72782]: INFO os_vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=55021cb8-5aac-42d2-898b-13b28995d3d8,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap55021cb8-5a')
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:50:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:50:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14864729-c342-452f-8bb9-94895ac93ac3", "address": "fa:16:3e:b7:12:96", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14864729-c3", "ovs_interfaceid": "14864729-c342-452f-8bb9-94895ac93ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "14864729-c342-452f-8bb9-94895ac93ac3", "address": "fa:16:3e:b7:12:96", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14864729-c3", "ovs_interfaceid": "14864729-c342-452f-8bb9-94895ac93ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:12:96,bridge_name='br-int',has_traffic_filtering=True,id=14864729-c342-452f-8bb9-94895ac93ac3,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14864729-c3') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:12:96,bridge_name='br-int',has_traffic_filtering=True,id=14864729-c342-452f-8bb9-94895ac93ac3,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14864729-c3') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14864729-c3, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:36 user nova-compute[72782]: INFO os_vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:12:96,bridge_name='br-int',has_traffic_filtering=True,id=14864729-c342-452f-8bb9-94895ac93ac3,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14864729-c3')
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:50:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:50:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73b00bb4-1307-466c-9ab7-098e44c86981", "address": "fa:16:3e:56:b6:55", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b00bb4-13", "ovs_interfaceid": "73b00bb4-1307-466c-9ab7-098e44c86981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "73b00bb4-1307-466c-9ab7-098e44c86981", "address": "fa:16:3e:56:b6:55", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b00bb4-13", "ovs_interfaceid": "73b00bb4-1307-466c-9ab7-098e44c86981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:b6:55,bridge_name='br-int',has_traffic_filtering=True,id=73b00bb4-1307-466c-9ab7-098e44c86981,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b00bb4-13') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:b6:55,bridge_name='br-int',has_traffic_filtering=True,id=73b00bb4-1307-466c-9ab7-098e44c86981,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b00bb4-13') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73b00bb4-13, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:36 user nova-compute[72782]: INFO os_vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:b6:55,bridge_name='br-int',has_traffic_filtering=True,id=73b00bb4-1307-466c-9ab7-098e44c86981,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b00bb4-13')
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:50:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:50:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "address": "fa:16:3e:c6:ce:13", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ef3b6e-7d", "ovs_interfaceid": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "address": "fa:16:3e:c6:ce:13", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ef3b6e-7d", "ovs_interfaceid": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ce:13,bridge_name='br-int',has_traffic_filtering=True,id=15ef3b6e-7de5-4089-96fd-3b41433c9738,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15ef3b6e-7d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ce:13,bridge_name='br-int',has_traffic_filtering=True,id=15ef3b6e-7de5-4089-96fd-3b41433c9738,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15ef3b6e-7d') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15ef3b6e-7d, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:36 user nova-compute[72782]: INFO os_vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ce:13,bridge_name='br-int',has_traffic_filtering=True,id=15ef3b6e-7de5-4089-96fd-3b41433c9738,network=Network(b9bd2c9f-0364-4783-a09b-59577bb21a88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15ef3b6e-7d')
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:50:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:50:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "address": "fa:16:3e:df:c6:8f", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap613cc4e1-ff", "ovs_interfaceid": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "address": "fa:16:3e:df:c6:8f", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap613cc4e1-ff", "ovs_interfaceid": "613cc4e1-ffff-4180-b0da-0ec02646f55c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:c6:8f,bridge_name='br-int',has_traffic_filtering=True,id=613cc4e1-ffff-4180-b0da-0ec02646f55c,network=Network(67f03e30-a12c-4777-9054-42ea6e22f1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap613cc4e1-ff') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:c6:8f,bridge_name='br-int',has_traffic_filtering=True,id=613cc4e1-ffff-4180-b0da-0ec02646f55c,network=Network(67f03e30-a12c-4777-9054-42ea6e22f1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap613cc4e1-ff') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap613cc4e1-ff, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:36 user nova-compute[72782]: INFO os_vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:c6:8f,bridge_name='br-int',has_traffic_filtering=True,id=613cc4e1-ffff-4180-b0da-0ec02646f55c,network=Network(67f03e30-a12c-4777-9054-42ea6e22f1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap613cc4e1-ff')
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T19:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1114133347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1114133347',id=15,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlXQGYPVEiaDirvy83PGW5AEGKTE1jRQWKLCx2BSQW3vwhuLEzgaxxy84A/qdPTVU2E8I08FY+aYtiOAkhPlzA8ZcK81MctThtx00spYTgfuFL69I6MtIeS4GF5iN+LMg==',key_name='tempest-keypair-952368793',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:50:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6fcb670ad7a401d93224e690fc674a1',ramdisk_id='',reservation_id='r-4tfg9tm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1869060357',owner_user_name='tempest-TaggedBootDevicesTest-1869060357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:50:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='860c5b3f201f421488b838ff368b692e',uuid=d334dc9b-8b50-41bb-b0e8-73dda305f590,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "address": "fa:16:3e:9c:65:37", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10f0761-24", "ovs_interfaceid": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converting VIF {"id": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "address": "fa:16:3e:9c:65:37", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10f0761-24", "ovs_interfaceid": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:65:37,bridge_name='br-int',has_traffic_filtering=True,id=a10f0761-24bb-4ad9-bb7a-bc9961c576fc,network=Network(67f03e30-a12c-4777-9054-42ea6e22f1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa10f0761-24') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:65:37,bridge_name='br-int',has_traffic_filtering=True,id=a10f0761-24bb-4ad9-bb7a-bc9961c576fc,network=Network(67f03e30-a12c-4777-9054-42ea6e22f1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa10f0761-24') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa10f0761-24, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:51:36 user nova-compute[72782]: INFO os_vif [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:65:37,bridge_name='br-int',has_traffic_filtering=True,id=a10f0761-24bb-4ad9-bb7a-bc9961c576fc,network=Network(67f03e30-a12c-4777-9054-42ea6e22f1da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa10f0761-24')
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kRJiMjND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:51:36 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5879e8-f00d-4701-962a-48d92ada1977]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bc8b71-c03e-4ef3-a7b2-afc0c9f8e1a9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:51:36 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:51:36 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:51:36 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:51:36 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:51:36 user nova-compute[72782]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 (non-flash)
Aug 14 19:51:36 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e87e7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2'): ({'sde'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Removing single pathed devices sde {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[281fdda0-be71-4772-8e1c-77bc79260d5d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e7d22f-7bb5-4658-ba2b-f57e38908e62]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Flushing IO for device /dev/sde {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[712aa72d-1286-4a90-8194-335c081d2f98]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba94de5-02f5-4cd1-a0ba-bc3a3e3c649c]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] SCSI volumes sde have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[38959222-e69f-4d5f-a387-8a1f2314911f]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-57339d04-6d3a-4eec-9ca2-bcd028028335 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-57339d04-6d3a-4eec-9ca2-bcd028028335 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:36 user nova-compute[72782]: WARNING nova.compute.manager [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-57339d04-6d3a-4eec-9ca2-bcd028028335 for instance with vm_state active and task_state deleting.
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-unplugged-55021cb8-5aac-42d2-898b-13b28995d3d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-unplugged-55021cb8-5aac-42d2-898b-13b28995d3d8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-unplugged-55021cb8-5aac-42d2-898b-13b28995d3d8 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-55021cb8-5aac-42d2-898b-13b28995d3d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-55021cb8-5aac-42d2-898b-13b28995d3d8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:36 user nova-compute[72782]: WARNING nova.compute.manager [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-55021cb8-5aac-42d2-898b-13b28995d3d8 for instance with vm_state active and task_state deleting.
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-unplugged-14864729-c342-452f-8bb9-94895ac93ac3 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-unplugged-14864729-c342-452f-8bb9-94895ac93ac3 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-unplugged-14864729-c342-452f-8bb9-94895ac93ac3 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-14864729-c342-452f-8bb9-94895ac93ac3 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-14864729-c342-452f-8bb9-94895ac93ac3 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:36 user nova-compute[72782]: WARNING nova.compute.manager [req-83e16d2a-8322-4039-af6c-0e1cfe9eb253 req-a6ed50b8-1c6f-4c41-9c75-a02871bae1ed service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-14864729-c342-452f-8bb9-94895ac93ac3 for instance with vm_state active and task_state deleting.
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[025cc157-8560-4f05-83ff-43136c98fc02]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2, portal: 172.16.0.220,3260]
Aug 14 19:51:36 user nova-compute[72782]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2, portal: 172.16.0.220,3260] successful.
Aug 14 19:51:36 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74c20-8f91-4d9a-a6f5-e92efef3a5a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[319598ba-6e95-4570-8b78-1d7e844ed60f]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] <== disconnect_volume: return (319ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpiKMSwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:51:36 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[24794fed-a94c-4c94-bed7-b56edfac7a5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaebe62-1ddd-4384-85a2-ec08ba35924d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:51:36 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:51:36 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba (non-flash)
Aug 14 19:51:36 user nova-compute[72782]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:51:36 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e87e7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba'): ({'sdc'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Removing single pathed devices sdc {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9d9279-07c7-45ca-9fa7-afeabad9de23]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[17190c68-a425-4cbd-9d2a-cd120c1b14c0]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Flushing IO for device /dev/sdc {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d6d940-1f21-4b90-bc9c-870aa8a83720]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:51:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d260412-a4d9-4847-95d1-c61b1b0abae5]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] SCSI volumes sdc have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d0970d-84cc-45cd-9a6f-dd7e2e4e8516]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f661dd-c2a9-4a4a-9208-2293629bb3c7]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba, portal: 172.16.0.220,3260]
Aug 14 19:51:37 user nova-compute[72782]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba, portal: 172.16.0.220,3260] successful.
Aug 14 19:51:37 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b993f06-57e2-4344-962e-8c9db32e0cba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0bfc73-7585-44c9-bb38-102ead93f1c7]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] <== disconnect_volume: return (288ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfvNYxkq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:51:37 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b84d28-095c-4078-9f4c-2d503ffbffd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-73b00bb4-1307-466c-9ab7-098e44c86981 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-73b00bb4-1307-466c-9ab7-098e44c86981 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:37 user nova-compute[72782]: WARNING nova.compute.manager [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-73b00bb4-1307-466c-9ab7-098e44c86981 for instance with vm_state active and task_state deleting.
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-unplugged-15ef3b6e-7de5-4089-96fd-3b41433c9738 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-unplugged-15ef3b6e-7de5-4089-96fd-3b41433c9738 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-unplugged-15ef3b6e-7de5-4089-96fd-3b41433c9738 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-15ef3b6e-7de5-4089-96fd-3b41433c9738 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-15ef3b6e-7de5-4089-96fd-3b41433c9738 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:37 user nova-compute[72782]: WARNING nova.compute.manager [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-15ef3b6e-7de5-4089-96fd-3b41433c9738 for instance with vm_state active and task_state deleting.
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-unplugged-613cc4e1-ffff-4180-b0da-0ec02646f55c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-unplugged-613cc4e1-ffff-4180-b0da-0ec02646f55c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-unplugged-613cc4e1-ffff-4180-b0da-0ec02646f55c for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-613cc4e1-ffff-4180-b0da-0ec02646f55c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-613cc4e1-ffff-4180-b0da-0ec02646f55c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:37 user nova-compute[72782]: WARNING nova.compute.manager [req-65a017fb-33c2-416d-ad34-d0206548fb5d req-31241ea0-26bc-4cba-91b8-37e293241ab6 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-613cc4e1-ffff-4180-b0da-0ec02646f55c for instance with vm_state active and task_state deleting.
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[875a5b6c-1de2-4a5a-90da-a28f3df4735e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:51:37 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 (non-flash)
Aug 14 19:51:37 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e869a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725'): ({'sdd'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Removing single pathed devices sdd {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d4a8e3-834e-4b93-a3b2-aa3fe092e899]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0726df-95b3-486f-83e6-51f11a15f51b]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Flushing IO for device /dev/sdd {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2214e634-4112-4d18-a0c5-10c4832aa327]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2437f078-65a8-4101-94ae-171d11a7cea6]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2fe5f3-d165-4480-8651-149a1360221a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd774edf-630c-46b5-81c1-6e96bd95a88c]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725, portal: 172.16.0.220,3260]
Aug 14 19:51:37 user nova-compute[72782]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725, portal: 172.16.0.220,3260] successful.
Aug 14 19:51:37 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c50a685a-247d-4bbd-b1de-6cf0cb96b725 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae52319-4328-4a76-a32f-e3d77b2975b1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] <== disconnect_volume: return (286ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:51:37 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Deleting instance files /opt/stack/data/nova/instances/d334dc9b-8b50-41bb-b0e8-73dda305f590_del
Aug 14 19:51:37 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Deletion of /opt/stack/data/nova/instances/d334dc9b-8b50-41bb-b0e8-73dda305f590_del complete
Aug 14 19:51:37 user nova-compute[72782]: INFO nova.compute.manager [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Took 3.13 seconds to destroy the instance on the hypervisor.
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-c84f9f8b-7216-48c1-a6a3-16769e21b36e req-3fad2914-2123-4e6a-b895-6e799f0c2317 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-plugged-a10f0761-24bb-4ad9-bb7a-bc9961c576fc {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c84f9f8b-7216-48c1-a6a3-16769e21b36e req-3fad2914-2123-4e6a-b895-6e799f0c2317 service nova] Acquiring lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c84f9f8b-7216-48c1-a6a3-16769e21b36e req-3fad2914-2123-4e6a-b895-6e799f0c2317 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c84f9f8b-7216-48c1-a6a3-16769e21b36e req-3fad2914-2123-4e6a-b895-6e799f0c2317 service nova] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-c84f9f8b-7216-48c1-a6a3-16769e21b36e req-3fad2914-2123-4e6a-b895-6e799f0c2317 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] No waiting events found dispatching network-vif-plugged-a10f0761-24bb-4ad9-bb7a-bc9961c576fc {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:51:37 user nova-compute[72782]: WARNING nova.compute.manager [req-c84f9f8b-7216-48c1-a6a3-16769e21b36e req-3fad2914-2123-4e6a-b895-6e799f0c2317 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received unexpected event network-vif-plugged-a10f0761-24bb-4ad9-bb7a-bc9961c576fc for instance with vm_state active and task_state deleting.
Aug 14 19:51:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-868e60cd-c515-453e-8973-d453ec11cd11 req-2940bf4b-9517-4262-8579-957fb7e9ff92 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-deleted-613cc4e1-ffff-4180-b0da-0ec02646f55c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:39 user nova-compute[72782]: INFO nova.compute.manager [req-868e60cd-c515-453e-8973-d453ec11cd11 req-2940bf4b-9517-4262-8579-957fb7e9ff92 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Neutron deleted interface 613cc4e1-ffff-4180-b0da-0ec02646f55c; detaching it from the instance and deleting it from the info cache
Aug 14 19:51:39 user nova-compute[72782]: DEBUG nova.network.neutron [req-868e60cd-c515-453e-8973-d453ec11cd11 req-2940bf4b-9517-4262-8579-957fb7e9ff92 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updating instance_info_cache with network_info: [{"id": "57339d04-6d3a-4eec-9ca2-bcd028028335", "address": "fa:16:3e:b3:73:cf", "network": {"id": "c9bb353d-5f85-45cd-9f62-a069db7c3dfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-255362601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57339d04-6d", "ovs_interfaceid": "57339d04-6d3a-4eec-9ca2-bcd028028335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55021cb8-5aac-42d2-898b-13b28995d3d8", "address": "fa:16:3e:ad:b1:39", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55021cb8-5a", "ovs_interfaceid": "55021cb8-5aac-42d2-898b-13b28995d3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14864729-c342-452f-8bb9-94895ac93ac3", "address": "fa:16:3e:b7:12:96", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14864729-c3", "ovs_interfaceid": "14864729-c342-452f-8bb9-94895ac93ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73b00bb4-1307-466c-9ab7-098e44c86981", "address": "fa:16:3e:56:b6:55", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b00bb4-13", "ovs_interfaceid": "73b00bb4-1307-466c-9ab7-098e44c86981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "address": "fa:16:3e:c6:ce:13", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ef3b6e-7d", "ovs_interfaceid": "15ef3b6e-7de5-4089-96fd-3b41433c9738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "address": "fa:16:3e:9c:65:37", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10f0761-24", "ovs_interfaceid": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:51:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-868e60cd-c515-453e-8973-d453ec11cd11 req-2940bf4b-9517-4262-8579-957fb7e9ff92 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Detach interface failed, port_id=613cc4e1-ffff-4180-b0da-0ec02646f55c, reason: Instance d334dc9b-8b50-41bb-b0e8-73dda305f590 could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 19:51:41 user nova-compute[72782]: DEBUG nova.compute.manager [req-ce5de8e6-3087-4529-8907-ebc8dc3657f8 req-7a685c90-4f15-4fff-b5d7-11dd1fe15a2e service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-deleted-15ef3b6e-7de5-4089-96fd-3b41433c9738 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:41 user nova-compute[72782]: INFO nova.compute.manager [req-ce5de8e6-3087-4529-8907-ebc8dc3657f8 req-7a685c90-4f15-4fff-b5d7-11dd1fe15a2e service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Neutron deleted interface 15ef3b6e-7de5-4089-96fd-3b41433c9738; detaching it from the instance and deleting it from the info cache
Aug 14 19:51:41 user nova-compute[72782]: DEBUG nova.network.neutron [req-ce5de8e6-3087-4529-8907-ebc8dc3657f8 req-7a685c90-4f15-4fff-b5d7-11dd1fe15a2e service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updating instance_info_cache with network_info: [{"id": "57339d04-6d3a-4eec-9ca2-bcd028028335", "address": "fa:16:3e:b3:73:cf", "network": {"id": "c9bb353d-5f85-45cd-9f62-a069db7c3dfd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-255362601-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57339d04-6d", "ovs_interfaceid": "57339d04-6d3a-4eec-9ca2-bcd028028335", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "55021cb8-5aac-42d2-898b-13b28995d3d8", "address": "fa:16:3e:ad:b1:39", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55021cb8-5a", "ovs_interfaceid": "55021cb8-5aac-42d2-898b-13b28995d3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14864729-c342-452f-8bb9-94895ac93ac3", "address": "fa:16:3e:b7:12:96", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14864729-c3", "ovs_interfaceid": "14864729-c342-452f-8bb9-94895ac93ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73b00bb4-1307-466c-9ab7-098e44c86981", "address": "fa:16:3e:56:b6:55", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b00bb4-13", "ovs_interfaceid": "73b00bb4-1307-466c-9ab7-098e44c86981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "address": "fa:16:3e:9c:65:37", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10f0761-24", "ovs_interfaceid": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:51:41 user nova-compute[72782]: DEBUG nova.compute.manager [req-ce5de8e6-3087-4529-8907-ebc8dc3657f8 req-7a685c90-4f15-4fff-b5d7-11dd1fe15a2e service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Detach interface failed, port_id=15ef3b6e-7de5-4089-96fd-3b41433c9738, reason: Instance d334dc9b-8b50-41bb-b0e8-73dda305f590 could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 19:51:41 user nova-compute[72782]: DEBUG nova.compute.manager [req-ce5de8e6-3087-4529-8907-ebc8dc3657f8 req-7a685c90-4f15-4fff-b5d7-11dd1fe15a2e service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-deleted-57339d04-6d3a-4eec-9ca2-bcd028028335 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:41 user nova-compute[72782]: INFO nova.compute.manager [req-ce5de8e6-3087-4529-8907-ebc8dc3657f8 req-7a685c90-4f15-4fff-b5d7-11dd1fe15a2e service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Neutron deleted interface 57339d04-6d3a-4eec-9ca2-bcd028028335; detaching it from the instance and deleting it from the info cache
Aug 14 19:51:41 user nova-compute[72782]: DEBUG nova.network.neutron [req-ce5de8e6-3087-4529-8907-ebc8dc3657f8 req-7a685c90-4f15-4fff-b5d7-11dd1fe15a2e service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updating instance_info_cache with network_info: [{"id": "55021cb8-5aac-42d2-898b-13b28995d3d8", "address": "fa:16:3e:ad:b1:39", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55021cb8-5a", "ovs_interfaceid": "55021cb8-5aac-42d2-898b-13b28995d3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14864729-c342-452f-8bb9-94895ac93ac3", "address": "fa:16:3e:b7:12:96", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14864729-c3", "ovs_interfaceid": "14864729-c342-452f-8bb9-94895ac93ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73b00bb4-1307-466c-9ab7-098e44c86981", "address": "fa:16:3e:56:b6:55", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b00bb4-13", "ovs_interfaceid": "73b00bb4-1307-466c-9ab7-098e44c86981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "address": "fa:16:3e:9c:65:37", "network": {"id": "67f03e30-a12c-4777-9054-42ea6e22f1da", "bridge": "br-int", "label": "tempest-device-tagging-net2-1340882596", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa10f0761-24", "ovs_interfaceid": "a10f0761-24bb-4ad9-bb7a-bc9961c576fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:51:41 user nova-compute[72782]: DEBUG nova.compute.manager [req-ce5de8e6-3087-4529-8907-ebc8dc3657f8 req-7a685c90-4f15-4fff-b5d7-11dd1fe15a2e service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Detach interface failed, port_id=57339d04-6d3a-4eec-9ca2-bcd028028335, reason: Instance d334dc9b-8b50-41bb-b0e8-73dda305f590 could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 19:51:41 user nova-compute[72782]: DEBUG nova.compute.manager [req-ce5de8e6-3087-4529-8907-ebc8dc3657f8 req-7a685c90-4f15-4fff-b5d7-11dd1fe15a2e service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-deleted-a10f0761-24bb-4ad9-bb7a-bc9961c576fc {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:41 user nova-compute[72782]: INFO nova.compute.manager [req-ce5de8e6-3087-4529-8907-ebc8dc3657f8 req-7a685c90-4f15-4fff-b5d7-11dd1fe15a2e service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Neutron deleted interface a10f0761-24bb-4ad9-bb7a-bc9961c576fc; detaching it from the instance and deleting it from the info cache
Aug 14 19:51:41 user nova-compute[72782]: DEBUG nova.network.neutron [req-ce5de8e6-3087-4529-8907-ebc8dc3657f8 req-7a685c90-4f15-4fff-b5d7-11dd1fe15a2e service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updating instance_info_cache with network_info: [{"id": "55021cb8-5aac-42d2-898b-13b28995d3d8", "address": "fa:16:3e:ad:b1:39", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55021cb8-5a", "ovs_interfaceid": "55021cb8-5aac-42d2-898b-13b28995d3d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14864729-c342-452f-8bb9-94895ac93ac3", "address": "fa:16:3e:b7:12:96", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14864729-c3", "ovs_interfaceid": "14864729-c342-452f-8bb9-94895ac93ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73b00bb4-1307-466c-9ab7-098e44c86981", "address": "fa:16:3e:56:b6:55", "network": {"id": "b9bd2c9f-0364-4783-a09b-59577bb21a88", "bridge": "br-int", "label": "tempest-device-tagging-net1-2112372989", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b6fcb670ad7a401d93224e690fc674a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b00bb4-13", "ovs_interfaceid": "73b00bb4-1307-466c-9ab7-098e44c86981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:51:41 user nova-compute[72782]: DEBUG nova.compute.manager [req-ce5de8e6-3087-4529-8907-ebc8dc3657f8 req-7a685c90-4f15-4fff-b5d7-11dd1fe15a2e service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Detach interface failed, port_id=a10f0761-24bb-4ad9-bb7a-bc9961c576fc, reason: Instance d334dc9b-8b50-41bb-b0e8-73dda305f590 could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 19:51:41 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:51:41 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Took 3.98 seconds to deallocate network for instance.
Aug 14 19:51:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:42 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042687.2927334, b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:51:42 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] VM Stopped (Lifecycle Event)
Aug 14 19:51:42 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a37e1308-7ea2-4ea4-8e32-83b5a928ec99 None None] [instance: b8075b40-15c0-48f6-aaf2-3f5b5e9a0dd6] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:51:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:43 user nova-compute[72782]: DEBUG nova.compute.manager [req-87381e9b-3c4f-469c-b182-7a7826ee6e58 req-368a7d0d-b36b-483d-a751-71cef2b3c301 service nova] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Received event network-vif-deleted-73b00bb4-1307-466c-9ab7-098e44c86981 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:44 user nova-compute[72782]: INFO nova.compute.manager [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Took 2.85 seconds to detach 3 volumes for instance.
Aug 14 19:51:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:44 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:51:44 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:51:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:44 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Deleted allocations for instance d334dc9b-8b50-41bb-b0e8-73dda305f590
Aug 14 19:51:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d335be40-0ba3-4fd3-89e5-374579a08589 tempest-TaggedBootDevicesTest-1869060357 tempest-TaggedBootDevicesTest-1869060357-project-member] Lock "d334dc9b-8b50-41bb-b0e8-73dda305f590" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.439s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:48 user nova-compute[72782]: DEBUG nova.objects.instance [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lazy-loading 'flavor' on Instance uuid 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:51:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:48 user nova-compute[72782]: INFO nova.compute.manager [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Attaching volume 0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd to /dev/vdb
Aug 14 19:51:48 user nova-compute[72782]: DEBUG os_brick.utils [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:51:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[363d52e0-4c05-433c-9613-cae22ccdf11c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[423c754c-eef8-4718-9bd6-9e5a06441fb8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b868a65-81e5-4fa0-ac39-a5f9e2cb74d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e37d64b-e2a7-4957-ae54-bda61ca9454f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:51:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:51:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:51:49 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:51:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bcb818-9576-4898-b9b7-ba7c7b977a80]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:51:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:51:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:51:49 user nova-compute[72782]: DEBUG os_brick.utils [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:51:49 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Updating existing volume attachment record: b6bd6392-1373-42f5-b15f-5426914b76a6 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:51:49 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:51:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:51:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:51:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:51:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:51:51 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:51:51 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042696.1429167, d334dc9b-8b50-41bb-b0e8-73dda305f590 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:51:51 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] VM Stopped (Lifecycle Event)
Aug 14 19:51:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-109a5787-f2b0-46c5-a268-b15666e907b6 None None] [instance: d334dc9b-8b50-41bb-b0e8-73dda305f590] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:51:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:51 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Updating instance_info_cache with network_info: [{"id": "2dad6c60-4f31-4548-bfe7-31c85495c454", "address": "fa:16:3e:57:2a:1c", "network": {"id": "16825893-d7a0-4b45-8921-c96e6333c811", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1870839756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1bf9f154f641798504207c6db32799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad6c60-4f", "ovs_interfaceid": "2dad6c60-4f31-4548-bfe7-31c85495c454", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:51:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:51:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:51:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:51:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:51:54 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:51:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:51:54 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:51:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:54 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:51:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:57 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:51:57 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:51:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7538MB free_disk=25.720504760742188GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 132b9b0b-9556-4aaf-a9ad-577e18215e84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 792f31f1-4079-4443-81f2-b1e364a9ee14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance c748103b-a37c-47c5-8394-ea54749f27eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance d0ffe207-a89e-41ef-85af-7927ce06627e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance e1052af2-5cc1-4d38-9467-032128545267 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPiOUDzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:51:57 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:51:57 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:51:57 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d276c0d-24a2-4494-962c-290889e8db42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:51:57 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f55635-d0f6-4d66-a7c5-5cc2581d8e68]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd] added
Aug 14 19:51:57 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e3019b-357a-4ba9-8320-a2548ece0dd5]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6e0b89-b3ec-4e50-a9d0-9d4f4c6acfa7]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BPiOUDzc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BPiOUDzc" returned: 0 in 0.028s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a82f344-4836-444c-bfb9-e029f138aa7d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BPiOUDzc'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bde090-42fd-4720-9629-2634a3ac6643]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c25b990-9e53-4795-bf3f-03ce369ca857]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 19:51:57 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 19:51:57 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:51:57 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 19:51:57 user nova-compute[72782]: 
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0770202b-074c-4bf6-a031-ef06737931f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd, portal: 172.16.0.220,3260]
Aug 14 19:51:57 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd, portal: 172.16.0.220,3260] successful.
Aug 14 19:51:57 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60f024f-822d-4279-9d0a-95e21de114a5]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e13c0cb-2325-460f-8426-3beaf7c8a52d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd (non-flash)
Aug 14 19:51:57 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd (non-flash)
Aug 14 19:51:57 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:51:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:51:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:51:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f599f4-a9ce-478d-a6e2-fa4a3401de66]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:51:58 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:51:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPiOUDzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:51:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:51:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:51:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:51:58 user nova-compute[72782]: DEBUG nova.compute.manager [req-01efd79e-37e1-4046-aee2-ab543ab85d51 req-0261ed9e-4168-442c-96fd-af5658e31e9c service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received event network-changed-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:51:58 user nova-compute[72782]: DEBUG nova.compute.manager [req-01efd79e-37e1-4046-aee2-ab543ab85d51 req-0261ed9e-4168-442c-96fd-af5658e31e9c service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Refreshing instance network info cache due to event network-changed-5fae61f6-03b8-4f93-8719-be8733d8590c. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:51:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-01efd79e-37e1-4046-aee2-ab543ab85d51 req-0261ed9e-4168-442c-96fd-af5658e31e9c service nova] Acquiring lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:51:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-01efd79e-37e1-4046-aee2-ab543ab85d51 req-0261ed9e-4168-442c-96fd-af5658e31e9c service nova] Acquired lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:51:58 user nova-compute[72782]: DEBUG nova.network.neutron [req-01efd79e-37e1-4046-aee2-ab543ab85d51 req-0261ed9e-4168-442c-96fd-af5658e31e9c service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Refreshing network info cache for port 5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:51:59 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:51:59 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26263326665376166', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:51:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263326665376166', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:51:59 user nova-compute[72782]: DEBUG nova.objects.instance [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lazy-loading 'flavor' on Instance uuid 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:51:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:51:59 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:51:59 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 19:51:59 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:51:59 user nova-compute[72782]:   <serial>0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd</serial>
Aug 14 19:51:59 user nova-compute[72782]: </disk>
Aug 14 19:51:59 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:51:59 user nova-compute[72782]: DEBUG nova.network.neutron [req-01efd79e-37e1-4046-aee2-ab543ab85d51 req-0261ed9e-4168-442c-96fd-af5658e31e9c service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Updated VIF entry in instance network info cache for port 5fae61f6-03b8-4f93-8719-be8733d8590c. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:51:59 user nova-compute[72782]: DEBUG nova.network.neutron [req-01efd79e-37e1-4046-aee2-ab543ab85d51 req-0261ed9e-4168-442c-96fd-af5658e31e9c service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Updating instance_info_cache with network_info: [{"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:51:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-01efd79e-37e1-4046-aee2-ab543ab85d51 req-0261ed9e-4168-442c-96fd-af5658e31e9c service nova] Releasing lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:51:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:51:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:51:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] No VIF found with MAC fa:16:3e:57:2a:1c, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:51:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bca61313-9480-49b9-99e1-0f6b0049e922 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.765s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:51:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:52:00 user nova-compute[72782]: INFO nova.compute.manager [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] instance snapshotting
Aug 14 19:52:00 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Beginning live snapshot process
Aug 14 19:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json -f qcow2 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json -f qcow2 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.193s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa39kxmrd/e1ab17c84ff14508af9faf3a199389e1.delta 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa39kxmrd/e1ab17c84ff14508af9faf3a199389e1.delta 1073741824" returned: 0 in 0.046s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:00 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 19:52:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:52:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:52:01 user nova-compute[72782]: INFO nova.compute.manager [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Detaching volume 0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd
Aug 14 19:52:01 user nova-compute[72782]: INFO nova.virt.block_device [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Attempting to driver detach volume 0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd from mountpoint /dev/vdb
Aug 14 19:52:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Attempting to detach device vdb from instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:52:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:52:01 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:52:01 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 19:52:01 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:52:01 user nova-compute[72782]:   <serial>0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd</serial>
Aug 14 19:52:01 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:52:01 user nova-compute[72782]: </disk>
Aug 14 19:52:01 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:52:01 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Successfully detached device vdb from instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f from the persistent domain config.
Aug 14 19:52:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:52:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:52:01 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:52:01 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 19:52:01 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:52:01 user nova-compute[72782]:   <serial>0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd</serial>
Aug 14 19:52:01 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:52:01 user nova-compute[72782]: </disk>
Aug 14 19:52:01 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:52:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:52:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692042722.0060403, 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:52:02 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Successfully detached device vdb from instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f from the live domain config.
Aug 14 19:52:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPiOUDzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:52:02 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ee7bd8-085b-4f0f-b1b4-f4830a61546a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cbb857-8318-45f2-992b-def75adb4cfe]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd (non-flash)
Aug 14 19:52:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd (non-flash)
Aug 14 19:52:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e86c8ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cb929a-86a9-4b0f-8b2b-3a8f8c0e77c1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[153deeff-bdd7-4582-ae04-10b8bbb1bc46]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1eb33cb-54a0-4b2f-970c-efec05c918a2]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:52:02 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc80d108-aa30-4944-8307-344ec3c16d80]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6780dac4-c9c4-4430-b72e-c9681bdc7704]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG nova.privsep.utils [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72782) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa39kxmrd/e1ab17c84ff14508af9faf3a199389e1.delta /opt/stack/data/nova/instances/snapshots/tmpa39kxmrd/e1ab17c84ff14508af9faf3a199389e1 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37bffbc-ff17-44f1-94bb-3590b95ae059]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd, portal: 172.16.0.220,3260]
Aug 14 19:52:02 user nova-compute[72782]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd, portal: 172.16.0.220,3260] successful.
Aug 14 19:52:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c9abb41-32c6-4c35-8f2a-42d1eb6d4dbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[408509b2-2691-4a3e-955b-9f2c46b535cc]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] <== disconnect_volume: return (310ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:52:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa39kxmrd/e1ab17c84ff14508af9faf3a199389e1.delta /opt/stack/data/nova/instances/snapshots/tmpa39kxmrd/e1ab17c84ff14508af9faf3a199389e1" returned: 0 in 0.268s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:02 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Snapshot extracted, beginning image upload
Aug 14 19:52:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:05 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Snapshot image upload complete
Aug 14 19:52:05 user nova-compute[72782]: INFO nova.compute.manager [None req-17cb334a-0d67-4c55-90df-313814ec77fc tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Took 5.15 seconds to snapshot the instance on the hypervisor.
Aug 14 19:52:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:52:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:52:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:52:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:52:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:52:05 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:52:05 user nova-compute[72782]: INFO nova.compute.claims [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Claim successful on node user
Aug 14 19:52:06 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:52:06 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:52:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:52:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:52:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:52:06 user nova-compute[72782]: DEBUG nova.network.neutron [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:52:06 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:52:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:52:06 user nova-compute[72782]: DEBUG nova.policy [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0cada11ffdb4ebc8d9e80218818ec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c26e0199de48ee8c48dde8177bc519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:52:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:52:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:52:06 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Creating image(s)
Aug 14 19:52:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "/opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:52:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "/opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:52:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "/opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:52:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.193s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:52:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:52:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.215s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk 1073741824" returned: 0 in 0.054s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:52:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:07 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:52:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:07 user nova-compute[72782]: DEBUG nova.network.neutron [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Successfully created port: 803ee4c4-0603-4e7a-80e3-83bb2b41e3fd {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:52:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:07 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Cannot resize image /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:52:07 user nova-compute[72782]: DEBUG nova.objects.instance [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'migration_context' on Instance uuid afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:52:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:52:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Ensure instance console log exists: /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:52:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:52:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:52:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:52:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.network.neutron [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Successfully updated port: 803ee4c4-0603-4e7a-80e3-83bb2b41e3fd {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "refresh_cache-afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquired lock "refresh_cache-afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.network.neutron [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-94fc79ae-ba37-4274-b1ce-8b4429be49ec req-a87b25eb-7c6b-41d4-9b02-55bf1c24fcf5 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Received event network-changed-803ee4c4-0603-4e7a-80e3-83bb2b41e3fd {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-94fc79ae-ba37-4274-b1ce-8b4429be49ec req-a87b25eb-7c6b-41d4-9b02-55bf1c24fcf5 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Refreshing instance network info cache due to event network-changed-803ee4c4-0603-4e7a-80e3-83bb2b41e3fd. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-94fc79ae-ba37-4274-b1ce-8b4429be49ec req-a87b25eb-7c6b-41d4-9b02-55bf1c24fcf5 service nova] Acquiring lock "refresh_cache-afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.network.neutron [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.network.neutron [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Updating instance_info_cache with network_info: [{"id": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "address": "fa:16:3e:7c:2a:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803ee4c4-06", "ovs_interfaceid": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Releasing lock "refresh_cache-afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Instance network_info: |[{"id": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "address": "fa:16:3e:7c:2a:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803ee4c4-06", "ovs_interfaceid": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-94fc79ae-ba37-4274-b1ce-8b4429be49ec req-a87b25eb-7c6b-41d4-9b02-55bf1c24fcf5 service nova] Acquired lock "refresh_cache-afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.network.neutron [req-94fc79ae-ba37-4274-b1ce-8b4429be49ec req-a87b25eb-7c6b-41d4-9b02-55bf1c24fcf5 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Refreshing network info cache for port 803ee4c4-0603-4e7a-80e3-83bb2b41e3fd {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Start _get_guest_xml network_info=[{"id": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "address": "fa:16:3e:7c:2a:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803ee4c4-06", "ovs_interfaceid": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:52:08 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:52:08 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1862824055',display_name='tempest-AttachVolumeNegativeTest-server-1862824055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1862824055',id=20,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGG1KUAEYko3X5nPJLENR0zSkHunj8YcsP1iOIy0vwlHsFikeQmZevxGlRZT/0vxMtlNeznB55Uf/dZu9yExs3S0modsxSE31TB7SkdEZbQuJj22T9qshXWLMFTu8ZKVbQ==',key_name='tempest-keypair-11616787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2c26e0199de48ee8c48dde8177bc519',ramdisk_id='',reservation_id='r-20fpc77x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1229463629',owner_user_name='tempest-AttachVolumeNegativeTest-1229463629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:52:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0cada11ffdb4ebc8d9e80218818ec3b',uuid=afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "address": "fa:16:3e:7c:2a:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803ee4c4-06", "ovs_interfaceid": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converting VIF {"id": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "address": "fa:16:3e:7c:2a:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803ee4c4-06", "ovs_interfaceid": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:2a:61,bridge_name='br-int',has_traffic_filtering=True,id=803ee4c4-0603-4e7a-80e3-83bb2b41e3fd,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803ee4c4-06') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.objects.instance [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'pci_devices' on Instance uuid afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:52:08 user nova-compute[72782]:   <uuid>afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9</uuid>
Aug 14 19:52:08 user nova-compute[72782]:   <name>instance-00000014</name>
Aug 14 19:52:08 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:52:08 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:52:08 user nova-compute[72782]:   <metadata>
Aug 14 19:52:08 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:52:08 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:52:08 user nova-compute[72782]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1862824055</nova:name>
Aug 14 19:52:08 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:52:08</nova:creationTime>
Aug 14 19:52:08 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:52:08 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:52:08 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:52:08 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:52:08 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:52:08 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:52:08 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:52:08 user nova-compute[72782]:       <nova:owner>
Aug 14 19:52:08 user nova-compute[72782]:         <nova:user uuid="b0cada11ffdb4ebc8d9e80218818ec3b">tempest-AttachVolumeNegativeTest-1229463629-project-member</nova:user>
Aug 14 19:52:08 user nova-compute[72782]:         <nova:project uuid="f2c26e0199de48ee8c48dde8177bc519">tempest-AttachVolumeNegativeTest-1229463629</nova:project>
Aug 14 19:52:08 user nova-compute[72782]:       </nova:owner>
Aug 14 19:52:08 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:52:08 user nova-compute[72782]:       <nova:ports>
Aug 14 19:52:08 user nova-compute[72782]:         <nova:port uuid="803ee4c4-0603-4e7a-80e3-83bb2b41e3fd">
Aug 14 19:52:08 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 19:52:08 user nova-compute[72782]:         </nova:port>
Aug 14 19:52:08 user nova-compute[72782]:       </nova:ports>
Aug 14 19:52:08 user nova-compute[72782]:     </nova:instance>
Aug 14 19:52:08 user nova-compute[72782]:   </metadata>
Aug 14 19:52:08 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:52:08 user nova-compute[72782]:     <system>
Aug 14 19:52:08 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:52:08 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:52:08 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:52:08 user nova-compute[72782]:       <entry name="serial">afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9</entry>
Aug 14 19:52:08 user nova-compute[72782]:       <entry name="uuid">afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9</entry>
Aug 14 19:52:08 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:52:08 user nova-compute[72782]:     </system>
Aug 14 19:52:08 user nova-compute[72782]:   </sysinfo>
Aug 14 19:52:08 user nova-compute[72782]:   <os>
Aug 14 19:52:08 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:52:08 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:52:08 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:52:08 user nova-compute[72782]:   </os>
Aug 14 19:52:08 user nova-compute[72782]:   <features>
Aug 14 19:52:08 user nova-compute[72782]:     <acpi/>
Aug 14 19:52:08 user nova-compute[72782]:     <apic/>
Aug 14 19:52:08 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:52:08 user nova-compute[72782]:   </features>
Aug 14 19:52:08 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:52:08 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:52:08 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:52:08 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:52:08 user nova-compute[72782]:   </clock>
Aug 14 19:52:08 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:52:08 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:52:08 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:52:08 user nova-compute[72782]:   </cpu>
Aug 14 19:52:08 user nova-compute[72782]:   <devices>
Aug 14 19:52:08 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:52:08 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:52:08 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk"/>
Aug 14 19:52:08 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:52:08 user nova-compute[72782]:     </disk>
Aug 14 19:52:08 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:52:08 user nova-compute[72782]:       <mac address="fa:16:3e:7c:2a:61"/>
Aug 14 19:52:08 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:52:08 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:52:08 user nova-compute[72782]:       <target dev="tap803ee4c4-06"/>
Aug 14 19:52:08 user nova-compute[72782]:     </interface>
Aug 14 19:52:08 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:52:08 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/console.log" append="off"/>
Aug 14 19:52:08 user nova-compute[72782]:     </serial>
Aug 14 19:52:08 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:52:08 user nova-compute[72782]:     <video>
Aug 14 19:52:08 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:52:08 user nova-compute[72782]:     </video>
Aug 14 19:52:08 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:52:08 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:52:08 user nova-compute[72782]:     </rng>
Aug 14 19:52:08 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:52:08 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:52:08 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:52:08 user nova-compute[72782]:     </memballoon>
Aug 14 19:52:08 user nova-compute[72782]:   </devices>
Aug 14 19:52:08 user nova-compute[72782]: </domain>
Aug 14 19:52:08 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1862824055',display_name='tempest-AttachVolumeNegativeTest-server-1862824055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1862824055',id=20,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGG1KUAEYko3X5nPJLENR0zSkHunj8YcsP1iOIy0vwlHsFikeQmZevxGlRZT/0vxMtlNeznB55Uf/dZu9yExs3S0modsxSE31TB7SkdEZbQuJj22T9qshXWLMFTu8ZKVbQ==',key_name='tempest-keypair-11616787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2c26e0199de48ee8c48dde8177bc519',ramdisk_id='',reservation_id='r-20fpc77x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1229463629',owner_user_name='tempest-AttachVolumeNegativeTest-1229463629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:52:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0cada11ffdb4ebc8d9e80218818ec3b',uuid=afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "address": "fa:16:3e:7c:2a:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803ee4c4-06", "ovs_interfaceid": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converting VIF {"id": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "address": "fa:16:3e:7c:2a:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803ee4c4-06", "ovs_interfaceid": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:2a:61,bridge_name='br-int',has_traffic_filtering=True,id=803ee4c4-0603-4e7a-80e3-83bb2b41e3fd,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803ee4c4-06') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG os_vif [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:2a:61,bridge_name='br-int',has_traffic_filtering=True,id=803ee4c4-0603-4e7a-80e3-83bb2b41e3fd,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803ee4c4-06') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap803ee4c4-06, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap803ee4c4-06, col_values=(('external_ids', {'iface-id': '803ee4c4-0603-4e7a-80e3-83bb2b41e3fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:2a:61', 'vm-uuid': 'afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:08 user nova-compute[72782]: INFO os_vif [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:2a:61,bridge_name='br-int',has_traffic_filtering=True,id=803ee4c4-0603-4e7a-80e3-83bb2b41e3fd,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803ee4c4-06')
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] No VIF found with MAC fa:16:3e:7c:2a:61, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.network.neutron [req-94fc79ae-ba37-4274-b1ce-8b4429be49ec req-a87b25eb-7c6b-41d4-9b02-55bf1c24fcf5 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Updated VIF entry in instance network info cache for port 803ee4c4-0603-4e7a-80e3-83bb2b41e3fd. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG nova.network.neutron [req-94fc79ae-ba37-4274-b1ce-8b4429be49ec req-a87b25eb-7c6b-41d4-9b02-55bf1c24fcf5 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Updating instance_info_cache with network_info: [{"id": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "address": "fa:16:3e:7c:2a:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803ee4c4-06", "ovs_interfaceid": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:52:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-94fc79ae-ba37-4274-b1ce-8b4429be49ec req-a87b25eb-7c6b-41d4-9b02-55bf1c24fcf5 service nova] Releasing lock "refresh_cache-afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:52:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-d601a862-6b0b-41a5-a213-d351fa57edb4 req-870bbe61-6209-4830-9b82-be412b146bf8 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Received event network-vif-plugged-803ee4c4-0603-4e7a-80e3-83bb2b41e3fd {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:52:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d601a862-6b0b-41a5-a213-d351fa57edb4 req-870bbe61-6209-4830-9b82-be412b146bf8 service nova] Acquiring lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:52:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d601a862-6b0b-41a5-a213-d351fa57edb4 req-870bbe61-6209-4830-9b82-be412b146bf8 service nova] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:52:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d601a862-6b0b-41a5-a213-d351fa57edb4 req-870bbe61-6209-4830-9b82-be412b146bf8 service nova] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:52:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-d601a862-6b0b-41a5-a213-d351fa57edb4 req-870bbe61-6209-4830-9b82-be412b146bf8 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] No waiting events found dispatching network-vif-plugged-803ee4c4-0603-4e7a-80e3-83bb2b41e3fd {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:52:10 user nova-compute[72782]: WARNING nova.compute.manager [req-d601a862-6b0b-41a5-a213-d351fa57edb4 req-870bbe61-6209-4830-9b82-be412b146bf8 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Received unexpected event network-vif-plugged-803ee4c4-0603-4e7a-80e3-83bb2b41e3fd for instance with vm_state building and task_state spawning.
Aug 14 19:52:10 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lazy-loading 'flavor' on Instance uuid 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:52:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb36bea8-6daa-433c-8770-c67c9b92b979 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.104s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:52:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-ba85c8fc-7da2-4b8b-a6d5-2ca90c20ca5c req-906b79f5-2384-4ecb-b9df-19724ce567b7 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received event network-changed-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-ba85c8fc-7da2-4b8b-a6d5-2ca90c20ca5c req-906b79f5-2384-4ecb-b9df-19724ce567b7 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Refreshing instance network info cache due to event network-changed-356eefe9-57d0-4af1-b7bd-842e2cfa33d0. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ba85c8fc-7da2-4b8b-a6d5-2ca90c20ca5c req-906b79f5-2384-4ecb-b9df-19724ce567b7 service nova] Acquiring lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ba85c8fc-7da2-4b8b-a6d5-2ca90c20ca5c req-906b79f5-2384-4ecb-b9df-19724ce567b7 service nova] Acquired lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.network.neutron [req-ba85c8fc-7da2-4b8b-a6d5-2ca90c20ca5c req-906b79f5-2384-4ecb-b9df-19724ce567b7 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Refreshing network info cache for port 356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042732.225101, afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:52:12 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] VM Resumed (Lifecycle Event)
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:52:12 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Instance spawned successfully.
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-7d8080a9-b4ba-46dd-88e9-b2fb5886e4d0 req-a23500c6-fe71-472d-9493-ad6e01042f98 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Received event network-vif-plugged-803ee4c4-0603-4e7a-80e3-83bb2b41e3fd {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7d8080a9-b4ba-46dd-88e9-b2fb5886e4d0 req-a23500c6-fe71-472d-9493-ad6e01042f98 service nova] Acquiring lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7d8080a9-b4ba-46dd-88e9-b2fb5886e4d0 req-a23500c6-fe71-472d-9493-ad6e01042f98 service nova] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7d8080a9-b4ba-46dd-88e9-b2fb5886e4d0 req-a23500c6-fe71-472d-9493-ad6e01042f98 service nova] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-7d8080a9-b4ba-46dd-88e9-b2fb5886e4d0 req-a23500c6-fe71-472d-9493-ad6e01042f98 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] No waiting events found dispatching network-vif-plugged-803ee4c4-0603-4e7a-80e3-83bb2b41e3fd {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:52:12 user nova-compute[72782]: WARNING nova.compute.manager [req-7d8080a9-b4ba-46dd-88e9-b2fb5886e4d0 req-a23500c6-fe71-472d-9493-ad6e01042f98 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Received unexpected event network-vif-plugged-803ee4c4-0603-4e7a-80e3-83bb2b41e3fd for instance with vm_state building and task_state spawning.
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:52:12 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042732.2292132, afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:52:12 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] VM Started (Lifecycle Event)
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:52:12 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:52:12 user nova-compute[72782]: INFO nova.compute.manager [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:52:12 user nova-compute[72782]: INFO nova.compute.manager [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Took 6.73 seconds to build instance.
Aug 14 19:52:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-44783bf6-456a-4e71-a08d-f69d3ad6711a tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.870s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.network.neutron [req-ba85c8fc-7da2-4b8b-a6d5-2ca90c20ca5c req-906b79f5-2384-4ecb-b9df-19724ce567b7 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Updated VIF entry in instance network info cache for port 356eefe9-57d0-4af1-b7bd-842e2cfa33d0. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG nova.network.neutron [req-ba85c8fc-7da2-4b8b-a6d5-2ca90c20ca5c req-906b79f5-2384-4ecb-b9df-19724ce567b7 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Updating instance_info_cache with network_info: [{"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:52:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ba85c8fc-7da2-4b8b-a6d5-2ca90c20ca5c req-906b79f5-2384-4ecb-b9df-19724ce567b7 service nova] Releasing lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:52:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:52:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:52:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "132b9b0b-9556-4aaf-a9ad-577e18215e84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:52:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:52:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:52:16 user nova-compute[72782]: INFO nova.compute.manager [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Terminating instance
Aug 14 19:52:16 user nova-compute[72782]: DEBUG nova.compute.manager [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:52:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:17 user nova-compute[72782]: DEBUG nova.compute.manager [req-0e26c9e0-ecbd-4493-8889-5fe4f58ab438 req-a42ad235-6231-4ec7-8f2c-0df7afd5cde1 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Received event network-vif-unplugged-5b0452fc-96f1-4844-afe9-290b93c90fda {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:52:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0e26c9e0-ecbd-4493-8889-5fe4f58ab438 req-a42ad235-6231-4ec7-8f2c-0df7afd5cde1 service nova] Acquiring lock "132b9b0b-9556-4aaf-a9ad-577e18215e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:52:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0e26c9e0-ecbd-4493-8889-5fe4f58ab438 req-a42ad235-6231-4ec7-8f2c-0df7afd5cde1 service nova] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:52:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0e26c9e0-ecbd-4493-8889-5fe4f58ab438 req-a42ad235-6231-4ec7-8f2c-0df7afd5cde1 service nova] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:52:17 user nova-compute[72782]: DEBUG nova.compute.manager [req-0e26c9e0-ecbd-4493-8889-5fe4f58ab438 req-a42ad235-6231-4ec7-8f2c-0df7afd5cde1 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] No waiting events found dispatching network-vif-unplugged-5b0452fc-96f1-4844-afe9-290b93c90fda {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:52:17 user nova-compute[72782]: DEBUG nova.compute.manager [req-0e26c9e0-ecbd-4493-8889-5fe4f58ab438 req-a42ad235-6231-4ec7-8f2c-0df7afd5cde1 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Received event network-vif-unplugged-5b0452fc-96f1-4844-afe9-290b93c90fda for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:52:17 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Instance destroyed successfully.
Aug 14 19:52:17 user nova-compute[72782]: DEBUG nova.objects.instance [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lazy-loading 'resources' on Instance uuid 132b9b0b-9556-4aaf-a9ad-577e18215e84 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:52:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:47:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1332349428',display_name='tempest-TestServerVolumeAttachmentScenario-server-1332349428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1332349428',id=12,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2j9WPGVcxPMkHwhH1b2XrLb2qAY9wnIGEQivbR27VCyyYzuASc0xgPrpTGxFMhCTgOFRd4NRv/buaO3fO/8vnao0Yu73RcffnnVqbDY0Xq2Ar57C7fRhwB+e+vORQCFw==',key_name='tempest-keypair-120233547',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:48:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7ab27e735104a3caad51ab1049677a5',ramdisk_id='',reservation_id='r-42l4m140',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1589824258',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1589824258-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:48:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e9eaaa882374ccca3caa21be6023022',uuid=132b9b0b-9556-4aaf-a9ad-577e18215e84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b0452fc-96f1-4844-afe9-290b93c90fda", "address": "fa:16:3e:6a:36:8a", "network": {"id": "2e677476-9a97-4e6d-a259-3c1427e62a6e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-607049029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab27e735104a3caad51ab1049677a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0452fc-96", "ovs_interfaceid": "5b0452fc-96f1-4844-afe9-290b93c90fda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:52:17 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Converting VIF {"id": "5b0452fc-96f1-4844-afe9-290b93c90fda", "address": "fa:16:3e:6a:36:8a", "network": {"id": "2e677476-9a97-4e6d-a259-3c1427e62a6e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-607049029-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ab27e735104a3caad51ab1049677a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b0452fc-96", "ovs_interfaceid": "5b0452fc-96f1-4844-afe9-290b93c90fda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:52:17 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:36:8a,bridge_name='br-int',has_traffic_filtering=True,id=5b0452fc-96f1-4844-afe9-290b93c90fda,network=Network(2e677476-9a97-4e6d-a259-3c1427e62a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b0452fc-96') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:52:17 user nova-compute[72782]: DEBUG os_vif [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:36:8a,bridge_name='br-int',has_traffic_filtering=True,id=5b0452fc-96f1-4844-afe9-290b93c90fda,network=Network(2e677476-9a97-4e6d-a259-3c1427e62a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b0452fc-96') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:52:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b0452fc-96, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:52:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:52:17 user nova-compute[72782]: INFO os_vif [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:36:8a,bridge_name='br-int',has_traffic_filtering=True,id=5b0452fc-96f1-4844-afe9-290b93c90fda,network=Network(2e677476-9a97-4e6d-a259-3c1427e62a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b0452fc-96')
Aug 14 19:52:17 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Deleting instance files /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84_del
Aug 14 19:52:17 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Deletion of /opt/stack/data/nova/instances/132b9b0b-9556-4aaf-a9ad-577e18215e84_del complete
Aug 14 19:52:17 user nova-compute[72782]: INFO nova.compute.manager [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 14 19:52:17 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:52:17 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:52:17 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:52:18 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:52:18 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Took 1.16 seconds to deallocate network for instance.
Aug 14 19:52:18 user nova-compute[72782]: DEBUG nova.compute.manager [req-fb47d56c-b679-4cd9-b0aa-de843b1e9300 req-297c1674-d7f4-49ac-ba0a-d93a497bf471 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Received event network-vif-deleted-5b0452fc-96f1-4844-afe9-290b93c90fda {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:52:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:52:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:52:19 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:52:19 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:52:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:52:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-8a8fa656-c8a3-48b0-8412-3d7543f5eb5b req-30dfff45-85a8-4849-a0b9-7720ba209ed0 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Received event network-vif-plugged-5b0452fc-96f1-4844-afe9-290b93c90fda {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:52:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8a8fa656-c8a3-48b0-8412-3d7543f5eb5b req-30dfff45-85a8-4849-a0b9-7720ba209ed0 service nova] Acquiring lock "132b9b0b-9556-4aaf-a9ad-577e18215e84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:52:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8a8fa656-c8a3-48b0-8412-3d7543f5eb5b req-30dfff45-85a8-4849-a0b9-7720ba209ed0 service nova] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:52:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8a8fa656-c8a3-48b0-8412-3d7543f5eb5b req-30dfff45-85a8-4849-a0b9-7720ba209ed0 service nova] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:52:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-8a8fa656-c8a3-48b0-8412-3d7543f5eb5b req-30dfff45-85a8-4849-a0b9-7720ba209ed0 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] No waiting events found dispatching network-vif-plugged-5b0452fc-96f1-4844-afe9-290b93c90fda {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:52:19 user nova-compute[72782]: WARNING nova.compute.manager [req-8a8fa656-c8a3-48b0-8412-3d7543f5eb5b req-30dfff45-85a8-4849-a0b9-7720ba209ed0 service nova] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Received unexpected event network-vif-plugged-5b0452fc-96f1-4844-afe9-290b93c90fda for instance with vm_state deleted and task_state None.
Aug 14 19:52:19 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Deleted allocations for instance 132b9b0b-9556-4aaf-a9ad-577e18215e84
Aug 14 19:52:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-429e3fab-a53e-4676-b9d1-5b822745b2eb tempest-TestServerVolumeAttachmentScenario-1589824258 tempest-TestServerVolumeAttachmentScenario-1589824258-project-member] Lock "132b9b0b-9556-4aaf-a9ad-577e18215e84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.623s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:52:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:32 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042737.5542233, 132b9b0b-9556-4aaf-a9ad-577e18215e84 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:52:32 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] VM Stopped (Lifecycle Event)
Aug 14 19:52:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-981b805e-fff0-448d-a40d-2925381516dc None None] [instance: 132b9b0b-9556-4aaf-a9ad-577e18215e84] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:52:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:49 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:52:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:52:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:52:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:52:53 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:52:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:52:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:52:53 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:52:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:53 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Updating instance_info_cache with network_info: [{"id": "35b9955c-a82a-42b9-a936-5f3429cda375", "address": "fa:16:3e:36:7a:36", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b9955c-a8", "ovs_interfaceid": "35b9955c-a82a-42b9-a936-5f3429cda375", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:52:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:52:53 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:52:54 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:52:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:52:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:52:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:52:54 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:52:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:57 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:52:57 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:52:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7598MB free_disk=25.657405853271484GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:52:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:52:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:52:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:52:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:52:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 792f31f1-4079-4443-81f2-b1e364a9ee14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:52:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance c748103b-a37c-47c5-8394-ea54749f27eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:52:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance d0ffe207-a89e-41ef-85af-7927ce06627e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:52:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance e1052af2-5cc1-4d38-9467-032128545267 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:52:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:52:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:52:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:52:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:52:57 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:52:57 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:52:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:52:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:52:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Acquiring lock "4702362b-72ca-43b7-aed2-3545a5f13a98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:52:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:52:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:52:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:52:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:52:58 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:52:58 user nova-compute[72782]: INFO nova.compute.claims [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Claim successful on node user
Aug 14 19:52:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:52:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:52:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:52:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:52:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:52:59 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:52:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:52:59 user nova-compute[72782]: INFO nova.virt.block_device [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Booting with volume b3f8e876-2e28-4709-b96b-c5f20ee56ab6 at /dev/vda
Aug 14 19:52:59 user nova-compute[72782]: DEBUG nova.policy [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31d2306e51414be6a895a1dc017c782f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2583e13fbf42a995ad5d30af0e1428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG os_brick.utils [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56adb95-345e-432f-851f-26c7cb49c5e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[140acb44-6d14-4f8a-ae9a-8efdd82f70a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61a43f4-7bea-44e9-aff6-516f7074a55c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c5c7ae-ebf9-41fd-bda1-f795b84344eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:52:59 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:52:59 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f49d18a-5b41-43d3-8999-173fd3dc35d7]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG os_brick.utils [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:52:59 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Updating existing volume attachment record: 7bc85444-b804-4455-b7dc-f79c46b9033f {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Successfully created port: 06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquiring lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:53:00 user nova-compute[72782]: INFO nova.compute.claims [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Claim successful on node user
Aug 14 19:53:00 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG nova.network.neutron [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:53:00 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:53:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG nova.policy [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f6db9beff934039b38439a362287274', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcc7dac78fa47eab14a10d2fe59d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Successfully updated port: 06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Acquiring lock "refresh_cache-4702362b-72ca-43b7-aed2-3545a5f13a98" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Acquired lock "refresh_cache-4702362b-72ca-43b7-aed2-3545a5f13a98" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-b946afea-c4fa-4754-8687-1fd6b756f4ab req-7249c16a-ef14-466c-b1b9-bd3633bb36e9 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received event network-changed-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-b946afea-c4fa-4754-8687-1fd6b756f4ab req-7249c16a-ef14-466c-b1b9-bd3633bb36e9 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Refreshing instance network info cache due to event network-changed-06846aaf-2a0a-4e50-9b81-c4f15943cd28. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b946afea-c4fa-4754-8687-1fd6b756f4ab req-7249c16a-ef14-466c-b1b9-bd3633bb36e9 service nova] Acquiring lock "refresh_cache-4702362b-72ca-43b7-aed2-3545a5f13a98" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:53:00 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Creating image(s)
Aug 14 19:53:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquiring lock "/opt/stack/data/nova/instances/059c305c-1279-4eb0-a1c6-b38c2c0ad393/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "/opt/stack/data/nova/instances/059c305c-1279-4eb0-a1c6-b38c2c0ad393/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "/opt/stack/data/nova/instances/059c305c-1279-4eb0-a1c6-b38c2c0ad393/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Updating instance_info_cache with network_info: [{"id": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "address": "fa:16:3e:ea:ce:52", "network": {"id": "400033aa-00fb-41ff-a23d-7deee12714e7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1338285309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2583e13fbf42a995ad5d30af0e1428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06846aaf-2a", "ovs_interfaceid": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Releasing lock "refresh_cache-4702362b-72ca-43b7-aed2-3545a5f13a98" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Instance network_info: |[{"id": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "address": "fa:16:3e:ea:ce:52", "network": {"id": "400033aa-00fb-41ff-a23d-7deee12714e7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1338285309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2583e13fbf42a995ad5d30af0e1428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06846aaf-2a", "ovs_interfaceid": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b946afea-c4fa-4754-8687-1fd6b756f4ab req-7249c16a-ef14-466c-b1b9-bd3633bb36e9 service nova] Acquired lock "refresh_cache-4702362b-72ca-43b7-aed2-3545a5f13a98" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG nova.network.neutron [req-b946afea-c4fa-4754-8687-1fd6b756f4ab req-7249c16a-ef14-466c-b1b9-bd3633bb36e9 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Refreshing network info cache for port 06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.207s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/059c305c-1279-4eb0-a1c6-b38c2c0ad393/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/059c305c-1279-4eb0-a1c6-b38c2c0ad393/disk 1073741824" returned: 0 in 0.057s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.218s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Checking if we can resize image /opt/stack/data/nova/instances/059c305c-1279-4eb0-a1c6-b38c2c0ad393/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059c305c-1279-4eb0-a1c6-b38c2c0ad393/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059c305c-1279-4eb0-a1c6-b38c2c0ad393/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Cannot resize image /opt/stack/data/nova/instances/059c305c-1279-4eb0-a1c6-b38c2c0ad393/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG nova.objects.instance [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lazy-loading 'migration_context' on Instance uuid 059c305c-1279-4eb0-a1c6-b38c2c0ad393 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Ensure instance console log exists: /opt/stack/data/nova/instances/059c305c-1279-4eb0-a1c6-b38c2c0ad393/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG nova.network.neutron [req-b946afea-c4fa-4754-8687-1fd6b756f4ab req-7249c16a-ef14-466c-b1b9-bd3633bb36e9 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Updated VIF entry in instance network info cache for port 06846aaf-2a0a-4e50-9b81-c4f15943cd28. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG nova.network.neutron [req-b946afea-c4fa-4754-8687-1fd6b756f4ab req-7249c16a-ef14-466c-b1b9-bd3633bb36e9 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Updating instance_info_cache with network_info: [{"id": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "address": "fa:16:3e:ea:ce:52", "network": {"id": "400033aa-00fb-41ff-a23d-7deee12714e7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1338285309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2583e13fbf42a995ad5d30af0e1428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06846aaf-2a", "ovs_interfaceid": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:53:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b946afea-c4fa-4754-8687-1fd6b756f4ab req-7249c16a-ef14-466c-b1b9-bd3633bb36e9 service nova] Releasing lock "refresh_cache-4702362b-72ca-43b7-aed2-3545a5f13a98" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:53:02 user nova-compute[72782]: DEBUG nova.network.neutron [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Successfully created port: e7a0656c-2802-4e58-b0ab-634570cde84a {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:53:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Successfully updated port: e7a0656c-2802-4e58-b0ab-634570cde84a {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:53:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquiring lock "refresh_cache-059c305c-1279-4eb0-a1c6-b38c2c0ad393" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:53:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquired lock "refresh_cache-059c305c-1279-4eb0-a1c6-b38c2c0ad393" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:53:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:53:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-891ccee7-6032-4b06-8979-6fc7a2d91f25 req-5a28faa6-84e4-4edb-8e4e-2c68b9972386 service nova] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Received event network-changed-e7a0656c-2802-4e58-b0ab-634570cde84a {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:53:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-891ccee7-6032-4b06-8979-6fc7a2d91f25 req-5a28faa6-84e4-4edb-8e4e-2c68b9972386 service nova] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Refreshing instance network info cache due to event network-changed-e7a0656c-2802-4e58-b0ab-634570cde84a. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:53:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-891ccee7-6032-4b06-8979-6fc7a2d91f25 req-5a28faa6-84e4-4edb-8e4e-2c68b9972386 service nova] Acquiring lock "refresh_cache-059c305c-1279-4eb0-a1c6-b38c2c0ad393" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:53:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:53:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Updating instance_info_cache with network_info: [{"id": "e7a0656c-2802-4e58-b0ab-634570cde84a", "address": "fa:16:3e:e9:8a:0d", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a0656c-28", "ovs_interfaceid": "e7a0656c-2802-4e58-b0ab-634570cde84a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Releasing lock "refresh_cache-059c305c-1279-4eb0-a1c6-b38c2c0ad393" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.compute.manager [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Instance network_info: |[{"id": "e7a0656c-2802-4e58-b0ab-634570cde84a", "address": "fa:16:3e:e9:8a:0d", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a0656c-28", "ovs_interfaceid": "e7a0656c-2802-4e58-b0ab-634570cde84a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-891ccee7-6032-4b06-8979-6fc7a2d91f25 req-5a28faa6-84e4-4edb-8e4e-2c68b9972386 service nova] Acquired lock "refresh_cache-059c305c-1279-4eb0-a1c6-b38c2c0ad393" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.network.neutron [req-891ccee7-6032-4b06-8979-6fc7a2d91f25 req-5a28faa6-84e4-4edb-8e4e-2c68b9972386 service nova] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Refreshing network info cache for port e7a0656c-2802-4e58-b0ab-634570cde84a {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Start _get_guest_xml network_info=[{"id": "e7a0656c-2802-4e58-b0ab-634570cde84a", "address": "fa:16:3e:e9:8a:0d", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a0656c-28", "ovs_interfaceid": "e7a0656c-2802-4e58-b0ab-634570cde84a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:53:04 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:53:04 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2137805649',display_name='tempest-ServersNegativeTestJSON-server-2137805649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2137805649',id=22,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fcc7dac78fa47eab14a10d2fe59d320',ramdisk_id='',reservation_id='r-u81j1e0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1211486287',owner_user_name='tempest-ServersNegativeTestJSON-1211486287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:53:01Z,user_data=None,user_id='1f6db9beff934039b38439a362287274',uuid=059c305c-1279-4eb0-a1c6-b38c2c0ad393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7a0656c-2802-4e58-b0ab-634570cde84a", "address": "fa:16:3e:e9:8a:0d", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a0656c-28", "ovs_interfaceid": "e7a0656c-2802-4e58-b0ab-634570cde84a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Converting VIF {"id": "e7a0656c-2802-4e58-b0ab-634570cde84a", "address": "fa:16:3e:e9:8a:0d", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a0656c-28", "ovs_interfaceid": "e7a0656c-2802-4e58-b0ab-634570cde84a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:8a:0d,bridge_name='br-int',has_traffic_filtering=True,id=e7a0656c-2802-4e58-b0ab-634570cde84a,network=Network(8e9d9f90-4c74-4a14-9f51-0dc87928a619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a0656c-28') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.objects.instance [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lazy-loading 'pci_devices' on Instance uuid 059c305c-1279-4eb0-a1c6-b38c2c0ad393 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:53:04 user nova-compute[72782]:   <uuid>059c305c-1279-4eb0-a1c6-b38c2c0ad393</uuid>
Aug 14 19:53:04 user nova-compute[72782]:   <name>instance-00000016</name>
Aug 14 19:53:04 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:53:04 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:53:04 user nova-compute[72782]:   <metadata>
Aug 14 19:53:04 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:53:04 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:53:04 user nova-compute[72782]:       <nova:name>tempest-ServersNegativeTestJSON-server-2137805649</nova:name>
Aug 14 19:53:04 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:53:04</nova:creationTime>
Aug 14 19:53:04 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:53:04 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:53:04 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:53:04 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:53:04 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:53:04 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:53:04 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:53:04 user nova-compute[72782]:       <nova:owner>
Aug 14 19:53:04 user nova-compute[72782]:         <nova:user uuid="1f6db9beff934039b38439a362287274">tempest-ServersNegativeTestJSON-1211486287-project-member</nova:user>
Aug 14 19:53:04 user nova-compute[72782]:         <nova:project uuid="0fcc7dac78fa47eab14a10d2fe59d320">tempest-ServersNegativeTestJSON-1211486287</nova:project>
Aug 14 19:53:04 user nova-compute[72782]:       </nova:owner>
Aug 14 19:53:04 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:53:04 user nova-compute[72782]:       <nova:ports>
Aug 14 19:53:04 user nova-compute[72782]:         <nova:port uuid="e7a0656c-2802-4e58-b0ab-634570cde84a">
Aug 14 19:53:04 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 19:53:04 user nova-compute[72782]:         </nova:port>
Aug 14 19:53:04 user nova-compute[72782]:       </nova:ports>
Aug 14 19:53:04 user nova-compute[72782]:     </nova:instance>
Aug 14 19:53:04 user nova-compute[72782]:   </metadata>
Aug 14 19:53:04 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:53:04 user nova-compute[72782]:     <system>
Aug 14 19:53:04 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:53:04 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:53:04 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:53:04 user nova-compute[72782]:       <entry name="serial">059c305c-1279-4eb0-a1c6-b38c2c0ad393</entry>
Aug 14 19:53:04 user nova-compute[72782]:       <entry name="uuid">059c305c-1279-4eb0-a1c6-b38c2c0ad393</entry>
Aug 14 19:53:04 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:53:04 user nova-compute[72782]:     </system>
Aug 14 19:53:04 user nova-compute[72782]:   </sysinfo>
Aug 14 19:53:04 user nova-compute[72782]:   <os>
Aug 14 19:53:04 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:53:04 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:53:04 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:53:04 user nova-compute[72782]:   </os>
Aug 14 19:53:04 user nova-compute[72782]:   <features>
Aug 14 19:53:04 user nova-compute[72782]:     <acpi/>
Aug 14 19:53:04 user nova-compute[72782]:     <apic/>
Aug 14 19:53:04 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:53:04 user nova-compute[72782]:   </features>
Aug 14 19:53:04 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:53:04 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:53:04 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:53:04 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:53:04 user nova-compute[72782]:   </clock>
Aug 14 19:53:04 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:53:04 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:53:04 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:53:04 user nova-compute[72782]:   </cpu>
Aug 14 19:53:04 user nova-compute[72782]:   <devices>
Aug 14 19:53:04 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:53:04 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:53:04 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/059c305c-1279-4eb0-a1c6-b38c2c0ad393/disk"/>
Aug 14 19:53:04 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:53:04 user nova-compute[72782]:     </disk>
Aug 14 19:53:04 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:53:04 user nova-compute[72782]:       <mac address="fa:16:3e:e9:8a:0d"/>
Aug 14 19:53:04 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:53:04 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:53:04 user nova-compute[72782]:       <target dev="tape7a0656c-28"/>
Aug 14 19:53:04 user nova-compute[72782]:     </interface>
Aug 14 19:53:04 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:53:04 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/059c305c-1279-4eb0-a1c6-b38c2c0ad393/console.log" append="off"/>
Aug 14 19:53:04 user nova-compute[72782]:     </serial>
Aug 14 19:53:04 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:53:04 user nova-compute[72782]:     <video>
Aug 14 19:53:04 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:53:04 user nova-compute[72782]:     </video>
Aug 14 19:53:04 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:53:04 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:53:04 user nova-compute[72782]:     </rng>
Aug 14 19:53:04 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:53:04 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:53:04 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:53:04 user nova-compute[72782]:     </memballoon>
Aug 14 19:53:04 user nova-compute[72782]:   </devices>
Aug 14 19:53:04 user nova-compute[72782]: </domain>
Aug 14 19:53:04 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2137805649',display_name='tempest-ServersNegativeTestJSON-server-2137805649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2137805649',id=22,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fcc7dac78fa47eab14a10d2fe59d320',ramdisk_id='',reservation_id='r-u81j1e0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1211486287',owner_user_name='tempest-ServersNegativeTestJSON-1211486287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:53:01Z,user_data=None,user_id='1f6db9beff934039b38439a362287274',uuid=059c305c-1279-4eb0-a1c6-b38c2c0ad393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7a0656c-2802-4e58-b0ab-634570cde84a", "address": "fa:16:3e:e9:8a:0d", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a0656c-28", "ovs_interfaceid": "e7a0656c-2802-4e58-b0ab-634570cde84a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Converting VIF {"id": "e7a0656c-2802-4e58-b0ab-634570cde84a", "address": "fa:16:3e:e9:8a:0d", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a0656c-28", "ovs_interfaceid": "e7a0656c-2802-4e58-b0ab-634570cde84a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:8a:0d,bridge_name='br-int',has_traffic_filtering=True,id=e7a0656c-2802-4e58-b0ab-634570cde84a,network=Network(8e9d9f90-4c74-4a14-9f51-0dc87928a619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a0656c-28') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG os_vif [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:8a:0d,bridge_name='br-int',has_traffic_filtering=True,id=e7a0656c-2802-4e58-b0ab-634570cde84a,network=Network(8e9d9f90-4c74-4a14-9f51-0dc87928a619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a0656c-28') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7a0656c-28, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7a0656c-28, col_values=(('external_ids', {'iface-id': 'e7a0656c-2802-4e58-b0ab-634570cde84a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:8a:0d', 'vm-uuid': '059c305c-1279-4eb0-a1c6-b38c2c0ad393'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:04 user nova-compute[72782]: INFO os_vif [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:8a:0d,bridge_name='br-int',has_traffic_filtering=True,id=e7a0656c-2802-4e58-b0ab-634570cde84a,network=Network(8e9d9f90-4c74-4a14-9f51-0dc87928a619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a0656c-28')
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] No VIF found with MAC fa:16:3e:e9:8a:0d, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.network.neutron [req-891ccee7-6032-4b06-8979-6fc7a2d91f25 req-5a28faa6-84e4-4edb-8e4e-2c68b9972386 service nova] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Updated VIF entry in instance network info cache for port e7a0656c-2802-4e58-b0ab-634570cde84a. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.network.neutron [req-891ccee7-6032-4b06-8979-6fc7a2d91f25 req-5a28faa6-84e4-4edb-8e4e-2c68b9972386 service nova] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Updating instance_info_cache with network_info: [{"id": "e7a0656c-2802-4e58-b0ab-634570cde84a", "address": "fa:16:3e:e9:8a:0d", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a0656c-28", "ovs_interfaceid": "e7a0656c-2802-4e58-b0ab-634570cde84a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-891ccee7-6032-4b06-8979-6fc7a2d91f25 req-5a28faa6-84e4-4edb-8e4e-2c68b9972386 service nova] Releasing lock "refresh_cache-059c305c-1279-4eb0-a1c6-b38c2c0ad393" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.compute.manager [req-cbc193a3-f863-4bb0-a9ea-eb66b84be12a req-73034803-ee72-429d-b383-c0e7049d799a service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received event network-changed-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.compute.manager [req-cbc193a3-f863-4bb0-a9ea-eb66b84be12a req-73034803-ee72-429d-b383-c0e7049d799a service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Refreshing instance network info cache due to event network-changed-aa74e90c-967b-4500-b0a1-9cd530b0e42f. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cbc193a3-f863-4bb0-a9ea-eb66b84be12a req-73034803-ee72-429d-b383-c0e7049d799a service nova] Acquiring lock "refresh_cache-e1052af2-5cc1-4d38-9467-032128545267" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cbc193a3-f863-4bb0-a9ea-eb66b84be12a req-73034803-ee72-429d-b383-c0e7049d799a service nova] Acquired lock "refresh_cache-e1052af2-5cc1-4d38-9467-032128545267" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:53:04 user nova-compute[72782]: DEBUG nova.network.neutron [req-cbc193a3-f863-4bb0-a9ea-eb66b84be12a req-73034803-ee72-429d-b383-c0e7049d799a service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Refreshing network info cache for port aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "e1052af2-5cc1-4d38-9467-032128545267" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "e1052af2-5cc1-4d38-9467-032128545267" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG nova.objects.instance [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'flavor' on Instance uuid e1052af2-5cc1-4d38-9467-032128545267 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "e1052af2-5cc1-4d38-9467-032128545267" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG nova.network.neutron [req-cbc193a3-f863-4bb0-a9ea-eb66b84be12a req-73034803-ee72-429d-b383-c0e7049d799a service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Updated VIF entry in instance network info cache for port aa74e90c-967b-4500-b0a1-9cd530b0e42f. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG nova.network.neutron [req-cbc193a3-f863-4bb0-a9ea-eb66b84be12a req-73034803-ee72-429d-b383-c0e7049d799a service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Updating instance_info_cache with network_info: [{"id": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "address": "fa:16:3e:e2:66:90", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e90c-96", "ovs_interfaceid": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "3c2df162-332c-4391-95b8-223e07546d74" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "3c2df162-332c-4391-95b8-223e07546d74" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cbc193a3-f863-4bb0-a9ea-eb66b84be12a req-73034803-ee72-429d-b383-c0e7049d799a service nova] Releasing lock "refresh_cache-e1052af2-5cc1-4d38-9467-032128545267" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:53:05 user nova-compute[72782]: INFO nova.compute.claims [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Claim successful on node user
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "e1052af2-5cc1-4d38-9467-032128545267" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "e1052af2-5cc1-4d38-9467-032128545267" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:05 user nova-compute[72782]: INFO nova.compute.manager [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Attaching volume 8619d659-89ff-4f0b-9ad5-819391568db7 to /dev/vdb
Aug 14 19:53:05 user nova-compute[72782]: DEBUG os_brick.utils [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d708c3c0-214f-448b-a33b-2a45d38a174a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a694e00-4f53-4eb2-84ae-a0e517971ac3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c48902-0d82-4703-b926-373fb5a82b10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b280b9b8-7758-48b4-bf10-6eeb68ad64bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:53:05 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:53:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20ca9f0-e0e3-4552-92c6-0b1fc4d1b635]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG os_brick.utils [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] <== get_connector_properties: return (213ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Updating existing volume attachment record: 6a8e1de4-6d00-40c9-a2f6-30a14317255c {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:53:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-af7e640f-062f-4c42-ace1-dd5277475fb7 req-00cbab9e-e0de-43aa-a08d-f557e6c2c3a9 service nova] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Received event network-vif-plugged-e7a0656c-2802-4e58-b0ab-634570cde84a {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-af7e640f-062f-4c42-ace1-dd5277475fb7 req-00cbab9e-e0de-43aa-a08d-f557e6c2c3a9 service nova] Acquiring lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-af7e640f-062f-4c42-ace1-dd5277475fb7 req-00cbab9e-e0de-43aa-a08d-f557e6c2c3a9 service nova] Lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-af7e640f-062f-4c42-ace1-dd5277475fb7 req-00cbab9e-e0de-43aa-a08d-f557e6c2c3a9 service nova] Lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG nova.compute.manager [req-af7e640f-062f-4c42-ace1-dd5277475fb7 req-00cbab9e-e0de-43aa-a08d-f557e6c2c3a9 service nova] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] No waiting events found dispatching network-vif-plugged-e7a0656c-2802-4e58-b0ab-634570cde84a {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:53:06 user nova-compute[72782]: WARNING nova.compute.manager [req-af7e640f-062f-4c42-ace1-dd5277475fb7 req-00cbab9e-e0de-43aa-a08d-f557e6c2c3a9 service nova] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Received unexpected event network-vif-plugged-e7a0656c-2802-4e58-b0ab-634570cde84a for instance with vm_state building and task_state spawning.
Aug 14 19:53:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.683s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG nova.network.neutron [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:53:06 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:53:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:53:06 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Creating image(s)
Aug 14 19:53:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "/opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "/opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG nova.policy [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12fb8b10952b4c6b8dc6823610830241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9f312ba4414905a8d6eb44933e430e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.242s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.232s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk 1073741824" returned: 0 in 0.057s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.212s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lazy-loading 'flavor' on Instance uuid 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Cannot resize image /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG nova.objects.instance [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'migration_context' on Instance uuid 3c2df162-332c-4391-95b8-223e07546d74 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Ensure instance console log exists: /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:07 user nova-compute[72782]: INFO nova.compute.manager [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Attaching volume 44facaef-e80a-44ee-b32b-1f8227ab57df to /dev/vdb
Aug 14 19:53:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG os_brick.utils [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e0e9e9-f1c6-4391-aa57-6891180ed40d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG nova.network.neutron [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Successfully created port: cb361406-de4a-4ea5-a8ac-ba025104ee70 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a76ca4-7299-424a-866a-d8bdcec86143]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b53d5a-30e2-445d-afd7-30a84eed6edd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0036a8-39d9-4192-86e1-1928f307de78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:53:07 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:53:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6581cf8-5045-4eb3-9f5a-91fde8444b2b]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG os_brick.utils [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:53:07 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Updating existing volume attachment record: d58d8199-6e88-471f-93da-6d32023ef12b {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-95d27f1f-4680-468d-b0a5-35e836dd7a74 req-50a0fa7e-109e-4a73-9b08-7d32c21c98c4 service nova] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Received event network-vif-plugged-e7a0656c-2802-4e58-b0ab-634570cde84a {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-95d27f1f-4680-468d-b0a5-35e836dd7a74 req-50a0fa7e-109e-4a73-9b08-7d32c21c98c4 service nova] Acquiring lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-95d27f1f-4680-468d-b0a5-35e836dd7a74 req-50a0fa7e-109e-4a73-9b08-7d32c21c98c4 service nova] Lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-95d27f1f-4680-468d-b0a5-35e836dd7a74 req-50a0fa7e-109e-4a73-9b08-7d32c21c98c4 service nova] Lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-95d27f1f-4680-468d-b0a5-35e836dd7a74 req-50a0fa7e-109e-4a73-9b08-7d32c21c98c4 service nova] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] No waiting events found dispatching network-vif-plugged-e7a0656c-2802-4e58-b0ab-634570cde84a {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:53:08 user nova-compute[72782]: WARNING nova.compute.manager [req-95d27f1f-4680-468d-b0a5-35e836dd7a74 req-50a0fa7e-109e-4a73-9b08-7d32c21c98c4 service nova] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Received unexpected event network-vif-plugged-e7a0656c-2802-4e58-b0ab-634570cde84a for instance with vm_state building and task_state spawning.
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042788.1673203, 059c305c-1279-4eb0-a1c6-b38c2c0ad393 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:53:08 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] VM Resumed (Lifecycle Event)
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:53:08 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Instance spawned successfully.
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:08 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042788.1695538, 059c305c-1279-4eb0-a1c6-b38c2c0ad393 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:53:08 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] VM Started (Lifecycle Event)
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:53:08 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:53:08 user nova-compute[72782]: INFO nova.compute.manager [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Took 7.38 seconds to spawn the instance on the hypervisor.
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:53:08 user nova-compute[72782]: INFO nova.compute.manager [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Took 8.25 seconds to build instance.
Aug 14 19:53:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bc539d0a-f381-44af-9ef0-09c19e5b4d39 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.351s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.network.neutron [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Successfully updated port: cb361406-de4a-4ea5-a8ac-ba025104ee70 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "refresh_cache-3c2df162-332c-4391-95b8-223e07546d74" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquired lock "refresh_cache-3c2df162-332c-4391-95b8-223e07546d74" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.network.neutron [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:53:08 user nova-compute[72782]: DEBUG nova.network.neutron [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.network.neutron [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Updating instance_info_cache with network_info: [{"id": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "address": "fa:16:3e:fe:b9:74", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb361406-de", "ovs_interfaceid": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Releasing lock "refresh_cache-3c2df162-332c-4391-95b8-223e07546d74" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Instance network_info: |[{"id": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "address": "fa:16:3e:fe:b9:74", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb361406-de", "ovs_interfaceid": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Start _get_guest_xml network_info=[{"id": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "address": "fa:16:3e:fe:b9:74", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb361406-de", "ovs_interfaceid": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:53:09 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:53:09 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:53:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1008009503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1008009503',id=23,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f9f312ba4414905a8d6eb44933e430e',ramdisk_id='',reservation_id='r-cqw1t00m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:53:06Z,user_data=None,user_id='12fb8b10952b4c6b8dc6823610830241',uuid=3c2df162-332c-4391-95b8-223e07546d74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "address": "fa:16:3e:fe:b9:74", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb361406-de", "ovs_interfaceid": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converting VIF {"id": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "address": "fa:16:3e:fe:b9:74", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb361406-de", "ovs_interfaceid": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:b9:74,bridge_name='br-int',has_traffic_filtering=True,id=cb361406-de4a-4ea5-a8ac-ba025104ee70,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb361406-de') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.objects.instance [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c2df162-332c-4391-95b8-223e07546d74 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:53:09 user nova-compute[72782]:   <uuid>3c2df162-332c-4391-95b8-223e07546d74</uuid>
Aug 14 19:53:09 user nova-compute[72782]:   <name>instance-00000017</name>
Aug 14 19:53:09 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:53:09 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:53:09 user nova-compute[72782]:   <metadata>
Aug 14 19:53:09 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:53:09 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:53:09 user nova-compute[72782]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1008009503</nova:name>
Aug 14 19:53:09 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:53:09</nova:creationTime>
Aug 14 19:53:09 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:53:09 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:53:09 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:53:09 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:53:09 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:53:09 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:53:09 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:53:09 user nova-compute[72782]:       <nova:owner>
Aug 14 19:53:09 user nova-compute[72782]:         <nova:user uuid="12fb8b10952b4c6b8dc6823610830241">tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member</nova:user>
Aug 14 19:53:09 user nova-compute[72782]:         <nova:project uuid="4f9f312ba4414905a8d6eb44933e430e">tempest-ServerBootFromVolumeStableRescueTest-1102073842</nova:project>
Aug 14 19:53:09 user nova-compute[72782]:       </nova:owner>
Aug 14 19:53:09 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:53:09 user nova-compute[72782]:       <nova:ports>
Aug 14 19:53:09 user nova-compute[72782]:         <nova:port uuid="cb361406-de4a-4ea5-a8ac-ba025104ee70">
Aug 14 19:53:09 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 19:53:09 user nova-compute[72782]:         </nova:port>
Aug 14 19:53:09 user nova-compute[72782]:       </nova:ports>
Aug 14 19:53:09 user nova-compute[72782]:     </nova:instance>
Aug 14 19:53:09 user nova-compute[72782]:   </metadata>
Aug 14 19:53:09 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:53:09 user nova-compute[72782]:     <system>
Aug 14 19:53:09 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:53:09 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:53:09 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:53:09 user nova-compute[72782]:       <entry name="serial">3c2df162-332c-4391-95b8-223e07546d74</entry>
Aug 14 19:53:09 user nova-compute[72782]:       <entry name="uuid">3c2df162-332c-4391-95b8-223e07546d74</entry>
Aug 14 19:53:09 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:53:09 user nova-compute[72782]:     </system>
Aug 14 19:53:09 user nova-compute[72782]:   </sysinfo>
Aug 14 19:53:09 user nova-compute[72782]:   <os>
Aug 14 19:53:09 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:53:09 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:53:09 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:53:09 user nova-compute[72782]:   </os>
Aug 14 19:53:09 user nova-compute[72782]:   <features>
Aug 14 19:53:09 user nova-compute[72782]:     <acpi/>
Aug 14 19:53:09 user nova-compute[72782]:     <apic/>
Aug 14 19:53:09 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:53:09 user nova-compute[72782]:   </features>
Aug 14 19:53:09 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:53:09 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:53:09 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:53:09 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:53:09 user nova-compute[72782]:   </clock>
Aug 14 19:53:09 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:53:09 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:53:09 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:53:09 user nova-compute[72782]:   </cpu>
Aug 14 19:53:09 user nova-compute[72782]:   <devices>
Aug 14 19:53:09 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:53:09 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:53:09 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk"/>
Aug 14 19:53:09 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:53:09 user nova-compute[72782]:     </disk>
Aug 14 19:53:09 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:53:09 user nova-compute[72782]:       <mac address="fa:16:3e:fe:b9:74"/>
Aug 14 19:53:09 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:53:09 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:53:09 user nova-compute[72782]:       <target dev="tapcb361406-de"/>
Aug 14 19:53:09 user nova-compute[72782]:     </interface>
Aug 14 19:53:09 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:53:09 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/console.log" append="off"/>
Aug 14 19:53:09 user nova-compute[72782]:     </serial>
Aug 14 19:53:09 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:53:09 user nova-compute[72782]:     <video>
Aug 14 19:53:09 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:53:09 user nova-compute[72782]:     </video>
Aug 14 19:53:09 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:53:09 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:53:09 user nova-compute[72782]:     </rng>
Aug 14 19:53:09 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:53:09 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:53:09 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:53:09 user nova-compute[72782]:     </memballoon>
Aug 14 19:53:09 user nova-compute[72782]:   </devices>
Aug 14 19:53:09 user nova-compute[72782]: </domain>
Aug 14 19:53:09 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:53:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1008009503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1008009503',id=23,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f9f312ba4414905a8d6eb44933e430e',ramdisk_id='',reservation_id='r-cqw1t00m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:53:06Z,user_data=None,user_id='12fb8b10952b4c6b8dc6823610830241',uuid=3c2df162-332c-4391-95b8-223e07546d74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "address": "fa:16:3e:fe:b9:74", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb361406-de", "ovs_interfaceid": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converting VIF {"id": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "address": "fa:16:3e:fe:b9:74", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb361406-de", "ovs_interfaceid": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:b9:74,bridge_name='br-int',has_traffic_filtering=True,id=cb361406-de4a-4ea5-a8ac-ba025104ee70,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb361406-de') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_vif [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:b9:74,bridge_name='br-int',has_traffic_filtering=True,id=cb361406-de4a-4ea5-a8ac-ba025104ee70,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb361406-de') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb361406-de, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb361406-de, col_values=(('external_ids', {'iface-id': 'cb361406-de4a-4ea5-a8ac-ba025104ee70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:b9:74', 'vm-uuid': '3c2df162-332c-4391-95b8-223e07546d74'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:09 user nova-compute[72782]: INFO os_vif [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:b9:74,bridge_name='br-int',has_traffic_filtering=True,id=cb361406-de4a-4ea5-a8ac-ba025104ee70,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb361406-de')
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:53:09 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Creating image(s)
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Did not create local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Ensure instance console log exists: /opt/stack/data/nova/instances/4702362b-72ca-43b7-aed2-3545a5f13a98/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Start _get_guest_xml network_info=[{"id": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "address": "fa:16:3e:ea:ce:52", "network": {"id": "400033aa-00fb-41ff-a23d-7deee12714e7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1338285309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2583e13fbf42a995ad5d30af0e1428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06846aaf-2a", "ovs_interfaceid": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '7bc85444-b804-4455-b7dc-f79c46b9033f', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIqUZeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4702362b-72ca-43b7-aed2-3545a5f13a98', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3f8e876-2e28-4709-b96b-c5f20ee56ab6', 'serial': 'b3f8e876-2e28-4709-b96b-c5f20ee56ab6'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:53:09 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:53:09 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIqUZeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:53:09 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:53:09 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:53:09 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] No VIF found with MAC fa:16:3e:fe:b9:74, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[999fcde4-9994-40ef-9754-c2270ddb7ceb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:53:09 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94bd513-c51c-4319-a9e1-b8aada389dd2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6] added
Aug 14 19:53:09 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[32814f3d-cd38-4ecd-b53b-f078f42ba722]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2089a803-2a11-41ef-8b4d-95c5ae9b6133]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YIqUZeQP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YIqUZeQP" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c5e5df-b202-4cf1-9d33-7d372db6320b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YIqUZeQP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[393e5a7a-efdb-4086-a79c-6367d0fe9b7b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d28adf3-9406-4416-82b1-549bc677c087]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 19:53:09 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 19:53:09 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:53:09 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 19:53:09 user nova-compute[72782]: 
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d05c138-1b29-4d83-ba84-65c5059a9074]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6, portal: 172.16.0.220,3260]
Aug 14 19:53:09 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6, portal: 172.16.0.220,3260] successful.
Aug 14 19:53:09 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1a270c-ab25-4cbc-b808-c4659be2c83b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c03242-c31a-4d56-9943-5b9fe34a2bf2]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:09 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:09 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4047dd-7cb1-418b-a3f6-e479a37ba0f7]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:53:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIqUZeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-34d6bd5d-ea06-4f64-a315-721c1e7849b7 req-914b48f8-dc1b-4d6d-814e-bf946447cbc1 service nova] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Received event network-changed-cb361406-de4a-4ea5-a8ac-ba025104ee70 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-34d6bd5d-ea06-4f64-a315-721c1e7849b7 req-914b48f8-dc1b-4d6d-814e-bf946447cbc1 service nova] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Refreshing instance network info cache due to event network-changed-cb361406-de4a-4ea5-a8ac-ba025104ee70. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-34d6bd5d-ea06-4f64-a315-721c1e7849b7 req-914b48f8-dc1b-4d6d-814e-bf946447cbc1 service nova] Acquiring lock "refresh_cache-3c2df162-332c-4391-95b8-223e07546d74" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-34d6bd5d-ea06-4f64-a315-721c1e7849b7 req-914b48f8-dc1b-4d6d-814e-bf946447cbc1 service nova] Acquired lock "refresh_cache-3c2df162-332c-4391-95b8-223e07546d74" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG nova.network.neutron [req-34d6bd5d-ea06-4f64-a315-721c1e7849b7 req-914b48f8-dc1b-4d6d-814e-bf946447cbc1 service nova] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Refreshing network info cache for port cb361406-de4a-4ea5-a8ac-ba025104ee70 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG nova.network.neutron [req-34d6bd5d-ea06-4f64-a315-721c1e7849b7 req-914b48f8-dc1b-4d6d-814e-bf946447cbc1 service nova] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Updated VIF entry in instance network info cache for port cb361406-de4a-4ea5-a8ac-ba025104ee70. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG nova.network.neutron [req-34d6bd5d-ea06-4f64-a315-721c1e7849b7 req-914b48f8-dc1b-4d6d-814e-bf946447cbc1 service nova] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Updating instance_info_cache with network_info: [{"id": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "address": "fa:16:3e:fe:b9:74", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb361406-de", "ovs_interfaceid": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-34d6bd5d-ea06-4f64-a315-721c1e7849b7 req-914b48f8-dc1b-4d6d-814e-bf946447cbc1 service nova] Releasing lock "refresh_cache-3c2df162-332c-4391-95b8-223e07546d74" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23162646463623434', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162646463623434', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-746603197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-746603197',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOegGaETqx1Pztqu1P77PVxvX0dwSMalKmcPN2jtCEazOU38nLPC5/6W1Crj1WtV9Rzil7eKqqLrYgjHm4Eh8onwWMwLp8hfPbbHri4CF+U5X3sE+rRfhsJzXgWjRWix7g==',key_name='tempest-keypair-1783336846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d2583e13fbf42a995ad5d30af0e1428',ramdisk_id='',reservation_id='r-ghzpchq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2138678264',owner_user_name='tempest-ServerActionsV293TestJSON-2138678264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:52:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d2306e51414be6a895a1dc017c782f',uuid=4702362b-72ca-43b7-aed2-3545a5f13a98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "address": "fa:16:3e:ea:ce:52", "network": {"id": "400033aa-00fb-41ff-a23d-7deee12714e7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1338285309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2583e13fbf42a995ad5d30af0e1428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06846aaf-2a", "ovs_interfaceid": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Converting VIF {"id": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "address": "fa:16:3e:ea:ce:52", "network": {"id": "400033aa-00fb-41ff-a23d-7deee12714e7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1338285309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2583e13fbf42a995ad5d30af0e1428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06846aaf-2a", "ovs_interfaceid": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=06846aaf-2a0a-4e50-9b81-c4f15943cd28,network=Network(400033aa-00fb-41ff-a23d-7deee12714e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06846aaf-2a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lazy-loading 'pci_devices' on Instance uuid 4702362b-72ca-43b7-aed2-3545a5f13a98 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:53:10 user nova-compute[72782]:   <uuid>4702362b-72ca-43b7-aed2-3545a5f13a98</uuid>
Aug 14 19:53:10 user nova-compute[72782]:   <name>instance-00000015</name>
Aug 14 19:53:10 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:53:10 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:53:10 user nova-compute[72782]:   <metadata>
Aug 14 19:53:10 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:53:10 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:53:10 user nova-compute[72782]:       <nova:name>tempest-ServerActionsV293TestJSON-server-746603197</nova:name>
Aug 14 19:53:10 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:53:09</nova:creationTime>
Aug 14 19:53:10 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:53:10 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:53:10 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:53:10 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:53:10 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:53:10 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:53:10 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:53:10 user nova-compute[72782]:       <nova:owner>
Aug 14 19:53:10 user nova-compute[72782]:         <nova:user uuid="31d2306e51414be6a895a1dc017c782f">tempest-ServerActionsV293TestJSON-2138678264-project-member</nova:user>
Aug 14 19:53:10 user nova-compute[72782]:         <nova:project uuid="3d2583e13fbf42a995ad5d30af0e1428">tempest-ServerActionsV293TestJSON-2138678264</nova:project>
Aug 14 19:53:10 user nova-compute[72782]:       </nova:owner>
Aug 14 19:53:10 user nova-compute[72782]:       <nova:ports>
Aug 14 19:53:10 user nova-compute[72782]:         <nova:port uuid="06846aaf-2a0a-4e50-9b81-c4f15943cd28">
Aug 14 19:53:10 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 19:53:10 user nova-compute[72782]:         </nova:port>
Aug 14 19:53:10 user nova-compute[72782]:       </nova:ports>
Aug 14 19:53:10 user nova-compute[72782]:     </nova:instance>
Aug 14 19:53:10 user nova-compute[72782]:   </metadata>
Aug 14 19:53:10 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:53:10 user nova-compute[72782]:     <system>
Aug 14 19:53:10 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:53:10 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:53:10 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:53:10 user nova-compute[72782]:       <entry name="serial">4702362b-72ca-43b7-aed2-3545a5f13a98</entry>
Aug 14 19:53:10 user nova-compute[72782]:       <entry name="uuid">4702362b-72ca-43b7-aed2-3545a5f13a98</entry>
Aug 14 19:53:10 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:53:10 user nova-compute[72782]:     </system>
Aug 14 19:53:10 user nova-compute[72782]:   </sysinfo>
Aug 14 19:53:10 user nova-compute[72782]:   <os>
Aug 14 19:53:10 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:53:10 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:53:10 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:53:10 user nova-compute[72782]:   </os>
Aug 14 19:53:10 user nova-compute[72782]:   <features>
Aug 14 19:53:10 user nova-compute[72782]:     <acpi/>
Aug 14 19:53:10 user nova-compute[72782]:     <apic/>
Aug 14 19:53:10 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:53:10 user nova-compute[72782]:   </features>
Aug 14 19:53:10 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:53:10 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:53:10 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:53:10 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:53:10 user nova-compute[72782]:   </clock>
Aug 14 19:53:10 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:53:10 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:53:10 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:53:10 user nova-compute[72782]:   </cpu>
Aug 14 19:53:10 user nova-compute[72782]:   <devices>
Aug 14 19:53:10 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 19:53:10 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:53:10 user nova-compute[72782]:       <source dev="/dev/sdb"/>
Aug 14 19:53:10 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:53:10 user nova-compute[72782]:       <serial>b3f8e876-2e28-4709-b96b-c5f20ee56ab6</serial>
Aug 14 19:53:10 user nova-compute[72782]:     </disk>
Aug 14 19:53:10 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:53:10 user nova-compute[72782]:       <mac address="fa:16:3e:ea:ce:52"/>
Aug 14 19:53:10 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:53:10 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:53:10 user nova-compute[72782]:       <target dev="tap06846aaf-2a"/>
Aug 14 19:53:10 user nova-compute[72782]:     </interface>
Aug 14 19:53:10 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:53:10 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/4702362b-72ca-43b7-aed2-3545a5f13a98/console.log" append="off"/>
Aug 14 19:53:10 user nova-compute[72782]:     </serial>
Aug 14 19:53:10 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:53:10 user nova-compute[72782]:     <video>
Aug 14 19:53:10 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:53:10 user nova-compute[72782]:     </video>
Aug 14 19:53:10 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:53:10 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:53:10 user nova-compute[72782]:     </rng>
Aug 14 19:53:10 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:53:10 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:53:10 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:53:10 user nova-compute[72782]:     </memballoon>
Aug 14 19:53:10 user nova-compute[72782]:   </devices>
Aug 14 19:53:10 user nova-compute[72782]: </domain>
Aug 14 19:53:10 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-746603197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-746603197',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOegGaETqx1Pztqu1P77PVxvX0dwSMalKmcPN2jtCEazOU38nLPC5/6W1Crj1WtV9Rzil7eKqqLrYgjHm4Eh8onwWMwLp8hfPbbHri4CF+U5X3sE+rRfhsJzXgWjRWix7g==',key_name='tempest-keypair-1783336846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d2583e13fbf42a995ad5d30af0e1428',ramdisk_id='',reservation_id='r-ghzpchq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2138678264',owner_user_name='tempest-ServerActionsV293TestJSON-2138678264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:52:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d2306e51414be6a895a1dc017c782f',uuid=4702362b-72ca-43b7-aed2-3545a5f13a98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "address": "fa:16:3e:ea:ce:52", "network": {"id": "400033aa-00fb-41ff-a23d-7deee12714e7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1338285309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2583e13fbf42a995ad5d30af0e1428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06846aaf-2a", "ovs_interfaceid": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Converting VIF {"id": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "address": "fa:16:3e:ea:ce:52", "network": {"id": "400033aa-00fb-41ff-a23d-7deee12714e7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1338285309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2583e13fbf42a995ad5d30af0e1428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06846aaf-2a", "ovs_interfaceid": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=06846aaf-2a0a-4e50-9b81-c4f15943cd28,network=Network(400033aa-00fb-41ff-a23d-7deee12714e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06846aaf-2a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG os_vif [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=06846aaf-2a0a-4e50-9b81-c4f15943cd28,network=Network(400033aa-00fb-41ff-a23d-7deee12714e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06846aaf-2a') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06846aaf-2a, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06846aaf-2a, col_values=(('external_ids', {'iface-id': '06846aaf-2a0a-4e50-9b81-c4f15943cd28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:ce:52', 'vm-uuid': '4702362b-72ca-43b7-aed2-3545a5f13a98'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:53:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:10 user nova-compute[72782]: INFO os_vif [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=06846aaf-2a0a-4e50-9b81-c4f15943cd28,network=Network(400033aa-00fb-41ff-a23d-7deee12714e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06846aaf-2a')
Aug 14 19:53:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:53:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] No VIF found with MAC fa:16:3e:ea:ce:52, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:53:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-e8c0fde3-824a-4a73-885e-624bced1482f req-20c0e639-f40d-4833-8c7b-1ee23d570219 service nova] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Received event network-vif-plugged-cb361406-de4a-4ea5-a8ac-ba025104ee70 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:53:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e8c0fde3-824a-4a73-885e-624bced1482f req-20c0e639-f40d-4833-8c7b-1ee23d570219 service nova] Acquiring lock "3c2df162-332c-4391-95b8-223e07546d74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e8c0fde3-824a-4a73-885e-624bced1482f req-20c0e639-f40d-4833-8c7b-1ee23d570219 service nova] Lock "3c2df162-332c-4391-95b8-223e07546d74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e8c0fde3-824a-4a73-885e-624bced1482f req-20c0e639-f40d-4833-8c7b-1ee23d570219 service nova] Lock "3c2df162-332c-4391-95b8-223e07546d74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-e8c0fde3-824a-4a73-885e-624bced1482f req-20c0e639-f40d-4833-8c7b-1ee23d570219 service nova] [instance: 3c2df162-332c-4391-95b8-223e07546d74] No waiting events found dispatching network-vif-plugged-cb361406-de4a-4ea5-a8ac-ba025104ee70 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:53:11 user nova-compute[72782]: WARNING nova.compute.manager [req-e8c0fde3-824a-4a73-885e-624bced1482f req-20c0e639-f40d-4833-8c7b-1ee23d570219 service nova] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Received unexpected event network-vif-plugged-cb361406-de4a-4ea5-a8ac-ba025104ee70 for instance with vm_state building and task_state spawning.
Aug 14 19:53:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-224cd9cc-1e19-4902-b2a2-cd00ff2ed4ab req-87e42948-d2ae-4080-80a7-8028419d4ec1 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received event network-vif-plugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:53:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-224cd9cc-1e19-4902-b2a2-cd00ff2ed4ab req-87e42948-d2ae-4080-80a7-8028419d4ec1 service nova] Acquiring lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-224cd9cc-1e19-4902-b2a2-cd00ff2ed4ab req-87e42948-d2ae-4080-80a7-8028419d4ec1 service nova] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-224cd9cc-1e19-4902-b2a2-cd00ff2ed4ab req-87e42948-d2ae-4080-80a7-8028419d4ec1 service nova] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-224cd9cc-1e19-4902-b2a2-cd00ff2ed4ab req-87e42948-d2ae-4080-80a7-8028419d4ec1 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] No waiting events found dispatching network-vif-plugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:53:13 user nova-compute[72782]: WARNING nova.compute.manager [req-224cd9cc-1e19-4902-b2a2-cd00ff2ed4ab req-87e42948-d2ae-4080-80a7-8028419d4ec1 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received unexpected event network-vif-plugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 for instance with vm_state building and task_state spawning.
Aug 14 19:53:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-a2fe3a74-3c4c-4e8d-9190-64541f911137 req-aeb4cbb3-f61b-49f8-a8dc-c42aa0b4b7cd service nova] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Received event network-vif-plugged-cb361406-de4a-4ea5-a8ac-ba025104ee70 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:53:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a2fe3a74-3c4c-4e8d-9190-64541f911137 req-aeb4cbb3-f61b-49f8-a8dc-c42aa0b4b7cd service nova] Acquiring lock "3c2df162-332c-4391-95b8-223e07546d74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a2fe3a74-3c4c-4e8d-9190-64541f911137 req-aeb4cbb3-f61b-49f8-a8dc-c42aa0b4b7cd service nova] Lock "3c2df162-332c-4391-95b8-223e07546d74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a2fe3a74-3c4c-4e8d-9190-64541f911137 req-aeb4cbb3-f61b-49f8-a8dc-c42aa0b4b7cd service nova] Lock "3c2df162-332c-4391-95b8-223e07546d74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-a2fe3a74-3c4c-4e8d-9190-64541f911137 req-aeb4cbb3-f61b-49f8-a8dc-c42aa0b4b7cd service nova] [instance: 3c2df162-332c-4391-95b8-223e07546d74] No waiting events found dispatching network-vif-plugged-cb361406-de4a-4ea5-a8ac-ba025104ee70 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:53:13 user nova-compute[72782]: WARNING nova.compute.manager [req-a2fe3a74-3c4c-4e8d-9190-64541f911137 req-aeb4cbb3-f61b-49f8-a8dc-c42aa0b4b7cd service nova] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Received unexpected event network-vif-plugged-cb361406-de4a-4ea5-a8ac-ba025104ee70 for instance with vm_state building and task_state spawning.
Aug 14 19:53:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:14 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042794.4016333, 3c2df162-332c-4391-95b8-223e07546d74 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:53:14 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 3c2df162-332c-4391-95b8-223e07546d74] VM Resumed (Lifecycle Event)
Aug 14 19:53:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:53:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:53:14 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Instance spawned successfully.
Aug 14 19:53:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:53:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:53:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:53:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:14 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 3c2df162-332c-4391-95b8-223e07546d74] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:53:14 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042794.405873, 3c2df162-332c-4391-95b8-223e07546d74 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:53:14 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 3c2df162-332c-4391-95b8-223e07546d74] VM Started (Lifecycle Event)
Aug 14 19:53:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:53:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:53:14 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 3c2df162-332c-4391-95b8-223e07546d74] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:53:14 user nova-compute[72782]: INFO nova.compute.manager [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Took 8.13 seconds to spawn the instance on the hypervisor.
Aug 14 19:53:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:53:14 user nova-compute[72782]: INFO nova.compute.manager [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Took 9.22 seconds to build instance.
Aug 14 19:53:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9c745cf3-a230-4287-b21d-28d066889f23 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "3c2df162-332c-4391-95b8-223e07546d74" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.366s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:15 user nova-compute[72782]: DEBUG nova.compute.manager [req-970ac974-5198-48c1-833b-6225d8102a74 req-0e54e80b-b6c6-4ece-bee6-ad4b94f57899 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received event network-vif-plugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:53:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-970ac974-5198-48c1-833b-6225d8102a74 req-0e54e80b-b6c6-4ece-bee6-ad4b94f57899 service nova] Acquiring lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-970ac974-5198-48c1-833b-6225d8102a74 req-0e54e80b-b6c6-4ece-bee6-ad4b94f57899 service nova] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-970ac974-5198-48c1-833b-6225d8102a74 req-0e54e80b-b6c6-4ece-bee6-ad4b94f57899 service nova] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:15 user nova-compute[72782]: DEBUG nova.compute.manager [req-970ac974-5198-48c1-833b-6225d8102a74 req-0e54e80b-b6c6-4ece-bee6-ad4b94f57899 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] No waiting events found dispatching network-vif-plugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:53:15 user nova-compute[72782]: WARNING nova.compute.manager [req-970ac974-5198-48c1-833b-6225d8102a74 req-0e54e80b-b6c6-4ece-bee6-ad4b94f57899 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received unexpected event network-vif-plugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 for instance with vm_state building and task_state spawning.
Aug 14 19:53:15 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042795.3457985, 4702362b-72ca-43b7-aed2-3545a5f13a98 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:53:15 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] VM Resumed (Lifecycle Event)
Aug 14 19:53:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:53:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:53:15 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Instance spawned successfully.
Aug 14 19:53:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:53:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:53:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:53:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:15 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:53:15 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042795.3488169, 4702362b-72ca-43b7-aed2-3545a5f13a98 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:53:15 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] VM Started (Lifecycle Event)
Aug 14 19:53:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:53:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:53:15 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:53:15 user nova-compute[72782]: INFO nova.compute.manager [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Took 5.96 seconds to spawn the instance on the hypervisor.
Aug 14 19:53:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:53:15 user nova-compute[72782]: INFO nova.compute.manager [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Took 16.93 seconds to build instance.
Aug 14 19:53:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4961ab13-04c6-4c92-96db-f0708833b647 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.049s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cHpmeAjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:53:17 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:53:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:53:17 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:53:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:53:17 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3502151-0ffe-41ed-9b97-c418c38de770]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:53:17 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[791db882-df78-42a5-aaaa-1ef202abe99e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df] added
Aug 14 19:53:17 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f32d6f-36de-4c91-83b4-3f116b86e33a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4503bfd-fabe-4c2f-a138-a0d9ee2a47b1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cHpmeAjD {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cHpmeAjD" returned: 0 in 0.040s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a4bea6-98bf-424b-87a9-da1c1c8e731e]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cHpmeAjD'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb6f60f-d5a8-4951-9970-f00ad97cb84a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a5f227-0690-49d6-a7a9-75ef49e76baf]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:17 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:17 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b056ee-fd9f-4388-aaf3-e65f59248ef3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df, portal: 172.16.0.220,3260]
Aug 14 19:53:17 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df, portal: 172.16.0.220,3260] successful.
Aug 14 19:53:17 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8da509-4ac4-4011-a318-b2f31dca37e5]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[152b18b7-e643-4470-be62-1873cc8032dd]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:18 user nova-compute[72782]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df (non-flash)
Aug 14 19:53:18 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:18 user nova-compute[72782]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df (non-flash)
Aug 14 19:53:18 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[882c6c42-1139-42af-b381-f99110dd7ec5]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cHpmeAjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:53:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YEfjthci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:53:18 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:53:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '26237663433616262', 'path': '/dev/sdc'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237663433616262', 'path': '/dev/sdc'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.243s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:53:19 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:53:19 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lazy-loading 'flavor' on Instance uuid 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d27b52-e798-4b9a-9651-e7c144cb6bca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:53:19 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:53:19 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:53:19 user nova-compute[72782]:   <source dev="/dev/sdc"/>
Aug 14 19:53:19 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:53:19 user nova-compute[72782]:   <serial>44facaef-e80a-44ee-b32b-1f8227ab57df</serial>
Aug 14 19:53:19 user nova-compute[72782]: </disk>
Aug 14 19:53:19 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5830959d-33db-48fb-a0cb-b6b05d2d366a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7] added
Aug 14 19:53:19 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[877cfc4c-59d7-45f6-80dc-e2be780d297d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[908dc09b-3782-40dc-af3b-cd7a4ad28d8d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YEfjthci {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YEfjthci" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5bcd5e-2b36-4f7e-a837-bb97aeb5e2b0]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YEfjthci'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ee88cf-48c4-4121-b7cd-4c756ab898ec]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01f78f0-ddf8-4ca0-b05b-9407835b52f3]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:19 user nova-compute[72782]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df (non-flash)
Aug 14 19:53:19 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:19 user nova-compute[72782]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df (non-flash)
Aug 14 19:53:19 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[789e5644-a0c5-4744-96b4-aad3b2a6b4bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7, portal: 172.16.0.220,3260]
Aug 14 19:53:19 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7, portal: 172.16.0.220,3260] successful.
Aug 14 19:53:19 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d59d777-3bad-47be-a3d8-067ed05a86b5]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bcbc76-e6fc-43b3-86e2-3848fa8b99bc]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:19 user nova-compute[72782]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df (non-flash)
Aug 14 19:53:19 user nova-compute[72782]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:53:19 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:19 user nova-compute[72782]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df (non-flash)
Aug 14 19:53:19 user nova-compute[72782]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:53:19 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb5c7a1-3f23-4979-9511-f32167d442a5]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: None {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] No VIF found with MAC fa:16:3e:57:2a:1c, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:53:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4cf515ac-28de-4c1e-850d-97971f2c4004 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.291s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:20 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:53:20 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YEfjthci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:53:20 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:53:20 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] <== connect_volume: return (1680ms) {'type': 'block', 'scsi_wwn': '23336353764376237', 'path': '/dev/sdd'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:53:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336353764376237', 'path': '/dev/sdd'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:53:20 user nova-compute[72782]: DEBUG nova.objects.instance [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'flavor' on Instance uuid e1052af2-5cc1-4d38-9467-032128545267 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:53:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:53:20 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:53:20 user nova-compute[72782]:   <source dev="/dev/sdd"/>
Aug 14 19:53:20 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:53:20 user nova-compute[72782]:   <serial>8619d659-89ff-4f0b-9ad5-819391568db7</serial>
Aug 14 19:53:20 user nova-compute[72782]: </disk>
Aug 14 19:53:20 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:53:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:53:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:53:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] No VIF found with MAC fa:16:3e:e2:66:90, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:53:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-449eee87-34dc-4e2e-bf9e-05eb1455387e tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "e1052af2-5cc1-4d38-9467-032128545267" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.677s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:21 user nova-compute[72782]: INFO nova.compute.manager [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Detaching volume 44facaef-e80a-44ee-b32b-1f8227ab57df
Aug 14 19:53:21 user nova-compute[72782]: INFO nova.virt.block_device [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Attempting to driver detach volume 44facaef-e80a-44ee-b32b-1f8227ab57df from mountpoint /dev/vdb
Aug 14 19:53:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Attempting to detach device vdb from instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:53:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:53:21 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:53:21 user nova-compute[72782]:   <source dev="/dev/sdc"/>
Aug 14 19:53:21 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:53:21 user nova-compute[72782]:   <serial>44facaef-e80a-44ee-b32b-1f8227ab57df</serial>
Aug 14 19:53:21 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:53:21 user nova-compute[72782]: </disk>
Aug 14 19:53:21 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:53:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Successfully detached device vdb from instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f from the persistent domain config.
Aug 14 19:53:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:53:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:53:21 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:53:21 user nova-compute[72782]:   <source dev="/dev/sdc"/>
Aug 14 19:53:21 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:53:21 user nova-compute[72782]:   <serial>44facaef-e80a-44ee-b32b-1f8227ab57df</serial>
Aug 14 19:53:21 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:53:21 user nova-compute[72782]: </disk>
Aug 14 19:53:21 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:53:22 user nova-compute[72782]: INFO nova.compute.manager [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Rebuilding instance
Aug 14 19:53:22 user nova-compute[72782]: DEBUG nova.objects.instance [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'trusted_certs' on Instance uuid e1052af2-5cc1-4d38-9467-032128545267 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG nova.compute.manager [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692042802.5110157, 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:53:22 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Successfully detached device vdb from instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f from the live domain config.
Aug 14 19:53:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cHpmeAjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:53:22 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:53:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1958624-7675-4c9b-ae53-d58e83675ea5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG nova.objects.instance [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'pci_requests' on Instance uuid e1052af2-5cc1-4d38-9467-032128545267 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[310ab38d-fd53-4946-87a1-b24e34e6e15a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:22 user nova-compute[72782]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df (non-flash)
Aug 14 19:53:22 user nova-compute[72782]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:53:22 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:22 user nova-compute[72782]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df (non-flash)
Aug 14 19:53:22 user nova-compute[72782]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:53:22 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e85ab370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df'): ({'sdc'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Removing single pathed devices sdc {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG nova.objects.instance [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'pci_devices' on Instance uuid e1052af2-5cc1-4d38-9467-032128545267 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG nova.objects.instance [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'resources' on Instance uuid e1052af2-5cc1-4d38-9467-032128545267 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e55f020-4baf-4e22-a25a-7368486ec788]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG nova.objects.instance [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'migration_context' on Instance uuid e1052af2-5cc1-4d38-9467-032128545267 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG nova.objects.instance [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72782) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42c35a1-047a-42ea-b439-4bb2194bdaaa]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Flushing IO for device /dev/sdc {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.030s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca368e7-feb1-4602-9ae3-ab366cafc53c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.070s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9db5ad9-d262-4850-aaa2-1f77e4d2633f]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] SCSI volumes sdc have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfd6984-c744-4cda-a7a3-ae03f95fae40]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e43f2ba-7e40-49a4-9155-c70058a6fae8]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df, portal: 172.16.0.220,3260]
Aug 14 19:53:22 user nova-compute[72782]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df, portal: 172.16.0.220,3260] successful.
Aug 14 19:53:22 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44facaef-e80a-44ee-b32b-1f8227ab57df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ab97bf-0072-4eb5-b99f-be924602c9cd]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.441s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] <== disconnect_volume: return (443ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:53:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-3efa2a70-071d-4676-baf8-7b3886b2c4ac req-c7d2b1f6-911c-4bb2-af6b-896310fde59d service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received event network-vif-unplugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3efa2a70-071d-4676-baf8-7b3886b2c4ac req-c7d2b1f6-911c-4bb2-af6b-896310fde59d service nova] Acquiring lock "e1052af2-5cc1-4d38-9467-032128545267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3efa2a70-071d-4676-baf8-7b3886b2c4ac req-c7d2b1f6-911c-4bb2-af6b-896310fde59d service nova] Lock "e1052af2-5cc1-4d38-9467-032128545267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3efa2a70-071d-4676-baf8-7b3886b2c4ac req-c7d2b1f6-911c-4bb2-af6b-896310fde59d service nova] Lock "e1052af2-5cc1-4d38-9467-032128545267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-3efa2a70-071d-4676-baf8-7b3886b2c4ac req-c7d2b1f6-911c-4bb2-af6b-896310fde59d service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] No waiting events found dispatching network-vif-unplugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:53:23 user nova-compute[72782]: WARNING nova.compute.manager [req-3efa2a70-071d-4676-baf8-7b3886b2c4ac req-c7d2b1f6-911c-4bb2-af6b-896310fde59d service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received unexpected event network-vif-unplugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f for instance with vm_state active and task_state rebuilding.
Aug 14 19:53:23 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: e1052af2-5cc1-4d38-9467-032128545267] Instance destroyed successfully.
Aug 14 19:53:23 user nova-compute[72782]: INFO nova.compute.manager [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Detaching volume 8619d659-89ff-4f0b-9ad5-819391568db7
Aug 14 19:53:23 user nova-compute[72782]: INFO nova.virt.block_device [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Attempting to driver detach volume 8619d659-89ff-4f0b-9ad5-819391568db7 from mountpoint /dev/vdb
Aug 14 19:53:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Attempting to detach device vdb from instance e1052af2-5cc1-4d38-9467-032128545267 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:53:23 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:53:23 user nova-compute[72782]:   <source dev="/dev/sdd"/>
Aug 14 19:53:23 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:53:23 user nova-compute[72782]:   <serial>8619d659-89ff-4f0b-9ad5-819391568db7</serial>
Aug 14 19:53:23 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:53:23 user nova-compute[72782]: </disk>
Aug 14 19:53:23 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:53:23 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Successfully detached device vdb from instance e1052af2-5cc1-4d38-9467-032128545267 from the persistent domain config.
Aug 14 19:53:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YEfjthci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:53:23 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 19:53:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b079554b-62cb-4276-8572-98249cccc1ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b4d434-2229-447c-b919-25aeafc0850e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:23 user nova-compute[72782]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:53:23 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:23 user nova-compute[72782]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:53:23 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f641c2b3010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7'): ({'sdd'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Removing single pathed devices sdd {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cbae45-183a-4637-8c4e-46aee596ad0c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[aece75f3-ba9a-4eeb-b290-b9773bb643bb]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Flushing IO for device /dev/sdd {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc7b2e1-81ed-4cb1-814d-9aedf17c17c8]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:53:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e6f397-366d-4e1f-b9bc-02179c5ac8f7]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1d955b-78e6-4bbc-b090-8d160bb71536]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda0893f-8292-4eda-9641-a6c764d58caa]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7, portal: 172.16.0.220,3260]
Aug 14 19:53:24 user nova-compute[72782]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7, portal: 172.16.0.220,3260] successful.
Aug 14 19:53:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabac102-f658-4ca2-abbf-2527718145fe]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] <== disconnect_volume: return (327ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:53:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:53:25 user nova-compute[72782]: DEBUG nova.objects.instance [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lazy-loading 'flavor' on Instance uuid 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:53:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-363c42ba-e19c-4a1e-8cff-ffc5ad328804 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.681s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-36b747ee-b4ad-46d5-85c4-7618b945266e req-a0f926c1-e1ed-41df-afc4-b80b0a82d047 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received event network-vif-plugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:53:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-36b747ee-b4ad-46d5-85c4-7618b945266e req-a0f926c1-e1ed-41df-afc4-b80b0a82d047 service nova] Acquiring lock "e1052af2-5cc1-4d38-9467-032128545267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-36b747ee-b4ad-46d5-85c4-7618b945266e req-a0f926c1-e1ed-41df-afc4-b80b0a82d047 service nova] Lock "e1052af2-5cc1-4d38-9467-032128545267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-36b747ee-b4ad-46d5-85c4-7618b945266e req-a0f926c1-e1ed-41df-afc4-b80b0a82d047 service nova] Lock "e1052af2-5cc1-4d38-9467-032128545267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-36b747ee-b4ad-46d5-85c4-7618b945266e req-a0f926c1-e1ed-41df-afc4-b80b0a82d047 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] No waiting events found dispatching network-vif-plugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:53:25 user nova-compute[72782]: WARNING nova.compute.manager [req-36b747ee-b4ad-46d5-85c4-7618b945266e req-a0f926c1-e1ed-41df-afc4-b80b0a82d047 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received unexpected event network-vif-plugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f for instance with vm_state active and task_state rebuilding.
Aug 14 19:53:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:33 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: e1052af2-5cc1-4d38-9467-032128545267] Instance destroyed successfully.
Aug 14 19:53:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:51:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-490147315',display_name='tempest-ServerActionsTestOtherA-server-1887421973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-490147315',id=19,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV5fiZmeiHTnYtIHzitMZse2ribzsRQ2484EQ9im6HhPR/lFEGGu+BQkl8yoXRtLPpzrj+N0//a8a7yN4uMfP50FthqJ6WC/rfTifEYmo41fdCr/FNWJ/A2uqubY97gOQ==',key_name='tempest-keypair-967502446',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:51:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b6c0483a97574e7794c73fe43e51795e',ramdisk_id='',reservation_id='r-c2v7tgso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-956209876',owner_user_name='tempest-ServerActionsTestOtherA-956209876-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:53:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a38fa907d804b81903eb97ab88ae181',uuid=e1052af2-5cc1-4d38-9467-032128545267,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "address": "fa:16:3e:e2:66:90", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e90c-96", "ovs_interfaceid": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converting VIF {"id": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "address": "fa:16:3e:e2:66:90", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e90c-96", "ovs_interfaceid": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:66:90,bridge_name='br-int',has_traffic_filtering=True,id=aa74e90c-967b-4500-b0a1-9cd530b0e42f,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e90c-96') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG os_vif [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:66:90,bridge_name='br-int',has_traffic_filtering=True,id=aa74e90c-967b-4500-b0a1-9cd530b0e42f,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e90c-96') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa74e90c-96, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:53:33 user nova-compute[72782]: INFO os_vif [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:66:90,bridge_name='br-int',has_traffic_filtering=True,id=aa74e90c-967b-4500-b0a1-9cd530b0e42f,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e90c-96')
Aug 14 19:53:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YEfjthci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:53:33 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 19:53:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f6c533-c15d-4b70-aedd-491160a5f9cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb8a2d3-475b-45b9-a026-35cb040dc637]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:33 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:33 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e86ca8c0>, {}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Disconnecting from: [] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.048s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] <== disconnect_volume: return (49ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:53:33 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Deleting instance files /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267_del
Aug 14 19:53:33 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Deletion of /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267_del complete
Aug 14 19:53:33 user nova-compute[72782]: INFO nova.virt.block_device [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Booting with volume 8619d659-89ff-4f0b-9ad5-819391568db7 at /dev/vdb
Aug 14 19:53:33 user nova-compute[72782]: DEBUG os_brick.utils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86fd533-fdb8-4126-8e76-0e4ec5e0c638]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d426fc63-d981-408a-b5ed-a0655b6d350b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[315d212f-2f97-4e93-afeb-2e24f119d9c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5542dc-8a53-43ba-98a9-54e857a12e83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:53:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:53:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:53:34 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:53:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8d5352-efac-4777-a51f-636b695d62d6]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:53:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:53:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:53:34 user nova-compute[72782]: DEBUG os_brick.utils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:53:34 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Updating existing volume attachment record: f2908845-9f11-44c3-a3c4-0642650a44b5 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:53:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:38 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042803.5292356, e1052af2-5cc1-4d38-9467-032128545267 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:53:38 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: e1052af2-5cc1-4d38-9467-032128545267] VM Stopped (Lifecycle Event)
Aug 14 19:53:38 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f252ab4-3795-43bf-aa5a-e8092fc9099a None None] [instance: e1052af2-5cc1-4d38-9467-032128545267] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:53:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:53:43 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Creating image(s)
Aug 14 19:53:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "/opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "/opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.172s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk 1073741824" returned: 0 in 0.048s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.185s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:43 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:53:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Cannot resize image /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Ensure instance console log exists: /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Start _get_guest_xml network_info=[{"id": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "address": "fa:16:3e:e2:66:90", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e90c-96", "ovs_interfaceid": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'f2908845-9f11-44c3-a3c4-0642650a44b5', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YEfjthci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1052af2-5cc1-4d38-9467-032128545267', 'attached_at': '', 'detached_at': '', 'volume_id': '8619d659-89ff-4f0b-9ad5-819391568db7', 'serial': '8619d659-89ff-4f0b-9ad5-819391568db7'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:53:44 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 19:53:44 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.objects.instance [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'vcpu_model' on Instance uuid e1052af2-5cc1-4d38-9467-032128545267 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YEfjthci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:53:44 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:53:44 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:53:44 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3d9fcc-be62-47fa-8f49-4f53193e81e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:53:44 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3102e2c4-483a-44a9-ae84-0f5a6a5e2c91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7] added
Aug 14 19:53:44 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e2190f-c7d0-49d7-a524-7c70457c6dee]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fced7bc-ea47-4a01-ba01-eb26d14c18df]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YEfjthci {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YEfjthci" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce5273e-fd62-4b59-b2c3-03708f4c5b8d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YEfjthci'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9470fd29-77f2-46de-846e-8dc27f5a64b0]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5948eb-ade9-4c9f-88f1-cc3586e1d87f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:44 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:44 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31b55ad-6fcd-4908-925c-268a76b9b95a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7, portal: 172.16.0.220,3260]
Aug 14 19:53:44 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7, portal: 172.16.0.220,3260] successful.
Aug 14 19:53:44 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8db391d-77b9-42a0-8757-05f67cd0e087]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7162a629-b688-49d1-82f9-7e8f02899f82]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:44 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:53:44 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:53:44 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:53:44 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d07a39a-3867-4389-bdc4-c49f86ced963]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:53:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YEfjthci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23336353764376237', 'path': '/dev/sdc'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336353764376237', 'path': '/dev/sdc'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T19:51:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-490147315',display_name='tempest-ServerActionsTestOtherA-server-1887421973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-490147315',id=19,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV5fiZmeiHTnYtIHzitMZse2ribzsRQ2484EQ9im6HhPR/lFEGGu+BQkl8yoXRtLPpzrj+N0//a8a7yN4uMfP50FthqJ6WC/rfTifEYmo41fdCr/FNWJ/A2uqubY97gOQ==',key_name='tempest-keypair-967502446',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:51:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b6c0483a97574e7794c73fe43e51795e',ramdisk_id='',reservation_id='r-c2v7tgso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-956209876',owner_user_name='tempest-ServerActionsTestOtherA-956209876-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:53:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a38fa907d804b81903eb97ab88ae181',uuid=e1052af2-5cc1-4d38-9467-032128545267,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "address": "fa:16:3e:e2:66:90", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e90c-96", "ovs_interfaceid": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converting VIF {"id": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "address": "fa:16:3e:e2:66:90", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e90c-96", "ovs_interfaceid": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:66:90,bridge_name='br-int',has_traffic_filtering=True,id=aa74e90c-967b-4500-b0a1-9cd530b0e42f,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e90c-96') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:53:45 user nova-compute[72782]:   <uuid>e1052af2-5cc1-4d38-9467-032128545267</uuid>
Aug 14 19:53:45 user nova-compute[72782]:   <name>instance-00000013</name>
Aug 14 19:53:45 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:53:45 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:53:45 user nova-compute[72782]:   <metadata>
Aug 14 19:53:45 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:53:45 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:53:45 user nova-compute[72782]:       <nova:name>tempest-ServerActionsTestOtherA-server-1887421973</nova:name>
Aug 14 19:53:45 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:53:44</nova:creationTime>
Aug 14 19:53:45 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:53:45 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:53:45 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:53:45 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:53:45 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:53:45 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:53:45 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:53:45 user nova-compute[72782]:       <nova:owner>
Aug 14 19:53:45 user nova-compute[72782]:         <nova:user uuid="8a38fa907d804b81903eb97ab88ae181">tempest-ServerActionsTestOtherA-956209876-project-member</nova:user>
Aug 14 19:53:45 user nova-compute[72782]:         <nova:project uuid="b6c0483a97574e7794c73fe43e51795e">tempest-ServerActionsTestOtherA-956209876</nova:project>
Aug 14 19:53:45 user nova-compute[72782]:       </nova:owner>
Aug 14 19:53:45 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:53:45 user nova-compute[72782]:       <nova:ports>
Aug 14 19:53:45 user nova-compute[72782]:         <nova:port uuid="aa74e90c-967b-4500-b0a1-9cd530b0e42f">
Aug 14 19:53:45 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 19:53:45 user nova-compute[72782]:         </nova:port>
Aug 14 19:53:45 user nova-compute[72782]:       </nova:ports>
Aug 14 19:53:45 user nova-compute[72782]:     </nova:instance>
Aug 14 19:53:45 user nova-compute[72782]:   </metadata>
Aug 14 19:53:45 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:53:45 user nova-compute[72782]:     <system>
Aug 14 19:53:45 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:53:45 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:53:45 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:53:45 user nova-compute[72782]:       <entry name="serial">e1052af2-5cc1-4d38-9467-032128545267</entry>
Aug 14 19:53:45 user nova-compute[72782]:       <entry name="uuid">e1052af2-5cc1-4d38-9467-032128545267</entry>
Aug 14 19:53:45 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:53:45 user nova-compute[72782]:     </system>
Aug 14 19:53:45 user nova-compute[72782]:   </sysinfo>
Aug 14 19:53:45 user nova-compute[72782]:   <os>
Aug 14 19:53:45 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:53:45 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:53:45 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:53:45 user nova-compute[72782]:   </os>
Aug 14 19:53:45 user nova-compute[72782]:   <features>
Aug 14 19:53:45 user nova-compute[72782]:     <acpi/>
Aug 14 19:53:45 user nova-compute[72782]:     <apic/>
Aug 14 19:53:45 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:53:45 user nova-compute[72782]:   </features>
Aug 14 19:53:45 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:53:45 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:53:45 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:53:45 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:53:45 user nova-compute[72782]:   </clock>
Aug 14 19:53:45 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:53:45 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:53:45 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:53:45 user nova-compute[72782]:   </cpu>
Aug 14 19:53:45 user nova-compute[72782]:   <devices>
Aug 14 19:53:45 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:53:45 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:53:45 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk"/>
Aug 14 19:53:45 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:53:45 user nova-compute[72782]:     </disk>
Aug 14 19:53:45 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 19:53:45 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:53:45 user nova-compute[72782]:       <source dev="/dev/sdc"/>
Aug 14 19:53:45 user nova-compute[72782]:       <target dev="vdb" bus="virtio"/>
Aug 14 19:53:45 user nova-compute[72782]:       <serial>8619d659-89ff-4f0b-9ad5-819391568db7</serial>
Aug 14 19:53:45 user nova-compute[72782]:     </disk>
Aug 14 19:53:45 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:53:45 user nova-compute[72782]:       <mac address="fa:16:3e:e2:66:90"/>
Aug 14 19:53:45 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:53:45 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:53:45 user nova-compute[72782]:       <target dev="tapaa74e90c-96"/>
Aug 14 19:53:45 user nova-compute[72782]:     </interface>
Aug 14 19:53:45 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:53:45 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/console.log" append="off"/>
Aug 14 19:53:45 user nova-compute[72782]:     </serial>
Aug 14 19:53:45 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:53:45 user nova-compute[72782]:     <video>
Aug 14 19:53:45 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:53:45 user nova-compute[72782]:     </video>
Aug 14 19:53:45 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:53:45 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:53:45 user nova-compute[72782]:     </rng>
Aug 14 19:53:45 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:53:45 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:53:45 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:53:45 user nova-compute[72782]:     </memballoon>
Aug 14 19:53:45 user nova-compute[72782]:   </devices>
Aug 14 19:53:45 user nova-compute[72782]: </domain>
Aug 14 19:53:45 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T19:51:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-490147315',display_name='tempest-ServerActionsTestOtherA-server-1887421973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-490147315',id=19,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV5fiZmeiHTnYtIHzitMZse2ribzsRQ2484EQ9im6HhPR/lFEGGu+BQkl8yoXRtLPpzrj+N0//a8a7yN4uMfP50FthqJ6WC/rfTifEYmo41fdCr/FNWJ/A2uqubY97gOQ==',key_name='tempest-keypair-967502446',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:51:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b6c0483a97574e7794c73fe43e51795e',ramdisk_id='',reservation_id='r-c2v7tgso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-956209876',owner_user_name='tempest-ServerActionsTestOtherA-956209876-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:53:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a38fa907d804b81903eb97ab88ae181',uuid=e1052af2-5cc1-4d38-9467-032128545267,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "address": "fa:16:3e:e2:66:90", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e90c-96", "ovs_interfaceid": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converting VIF {"id": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "address": "fa:16:3e:e2:66:90", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e90c-96", "ovs_interfaceid": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:66:90,bridge_name='br-int',has_traffic_filtering=True,id=aa74e90c-967b-4500-b0a1-9cd530b0e42f,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e90c-96') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG os_vif [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:66:90,bridge_name='br-int',has_traffic_filtering=True,id=aa74e90c-967b-4500-b0a1-9cd530b0e42f,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e90c-96') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa74e90c-96, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaa74e90c-96, col_values=(('external_ids', {'iface-id': 'aa74e90c-967b-4500-b0a1-9cd530b0e42f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:66:90', 'vm-uuid': 'e1052af2-5cc1-4d38-9467-032128545267'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:45 user nova-compute[72782]: INFO os_vif [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:66:90,bridge_name='br-int',has_traffic_filtering=True,id=aa74e90c-967b-4500-b0a1-9cd530b0e42f,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e90c-96')
Aug 14 19:53:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] No VIF found with MAC fa:16:3e:e2:66:90, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:53:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:47 user nova-compute[72782]: DEBUG nova.compute.manager [req-7262121b-e673-4a1c-913f-b318f89ba0f2 req-6f323ab8-0127-4284-ba5b-829c421d6c6c service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received event network-vif-plugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:53:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7262121b-e673-4a1c-913f-b318f89ba0f2 req-6f323ab8-0127-4284-ba5b-829c421d6c6c service nova] Acquiring lock "e1052af2-5cc1-4d38-9467-032128545267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7262121b-e673-4a1c-913f-b318f89ba0f2 req-6f323ab8-0127-4284-ba5b-829c421d6c6c service nova] Lock "e1052af2-5cc1-4d38-9467-032128545267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7262121b-e673-4a1c-913f-b318f89ba0f2 req-6f323ab8-0127-4284-ba5b-829c421d6c6c service nova] Lock "e1052af2-5cc1-4d38-9467-032128545267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:47 user nova-compute[72782]: DEBUG nova.compute.manager [req-7262121b-e673-4a1c-913f-b318f89ba0f2 req-6f323ab8-0127-4284-ba5b-829c421d6c6c service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] No waiting events found dispatching network-vif-plugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:53:47 user nova-compute[72782]: WARNING nova.compute.manager [req-7262121b-e673-4a1c-913f-b318f89ba0f2 req-6f323ab8-0127-4284-ba5b-829c421d6c6c service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received unexpected event network-vif-plugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f for instance with vm_state active and task_state rebuild_spawning.
Aug 14 19:53:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042829.4541986, e1052af2-5cc1-4d38-9467-032128545267 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:53:49 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: e1052af2-5cc1-4d38-9467-032128545267] VM Resumed (Lifecycle Event)
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:53:49 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: e1052af2-5cc1-4d38-9467-032128545267] Instance spawned successfully.
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: e1052af2-5cc1-4d38-9467-032128545267] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: e1052af2-5cc1-4d38-9467-032128545267] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-95cb9de1-c484-4ff6-9c7c-47af5aa1e418 req-375d1094-e065-4a8a-93af-9135f642a869 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received event network-vif-plugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-95cb9de1-c484-4ff6-9c7c-47af5aa1e418 req-375d1094-e065-4a8a-93af-9135f642a869 service nova] Acquiring lock "e1052af2-5cc1-4d38-9467-032128545267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-95cb9de1-c484-4ff6-9c7c-47af5aa1e418 req-375d1094-e065-4a8a-93af-9135f642a869 service nova] Lock "e1052af2-5cc1-4d38-9467-032128545267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-95cb9de1-c484-4ff6-9c7c-47af5aa1e418 req-375d1094-e065-4a8a-93af-9135f642a869 service nova] Lock "e1052af2-5cc1-4d38-9467-032128545267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-95cb9de1-c484-4ff6-9c7c-47af5aa1e418 req-375d1094-e065-4a8a-93af-9135f642a869 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] No waiting events found dispatching network-vif-plugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:53:49 user nova-compute[72782]: WARNING nova.compute.manager [req-95cb9de1-c484-4ff6-9c7c-47af5aa1e418 req-375d1094-e065-4a8a-93af-9135f642a869 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received unexpected event network-vif-plugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f for instance with vm_state active and task_state rebuild_spawning.
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:53:49 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: e1052af2-5cc1-4d38-9467-032128545267] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042829.4566596, e1052af2-5cc1-4d38-9467-032128545267 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:53:49 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: e1052af2-5cc1-4d38-9467-032128545267] VM Started (Lifecycle Event)
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: e1052af2-5cc1-4d38-9467-032128545267] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: e1052af2-5cc1-4d38-9467-032128545267] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:53:49 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: e1052af2-5cc1-4d38-9467-032128545267] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG nova.objects.instance [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72782) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 19:53:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34a2351c-187c-439f-b81e-320da1486020 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.092s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:50 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:53:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lazy-loading 'flavor' on Instance uuid 792f31f1-4079-4443-81f2-b1e364a9ee14 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:51 user nova-compute[72782]: INFO nova.compute.manager [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Attaching volume 192ff840-03a7-4424-b009-dd541b322d4b to /dev/vdb
Aug 14 19:53:51 user nova-compute[72782]: DEBUG os_brick.utils [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91782fb-7e90-4ebd-bed6-7f37a385a582]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[969aa9f9-05d4-4ddd-b387-017a20fdc3cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b348a0e-95e2-4f94-a9f2-37883cd58af6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac9c72f-65f2-4d2d-ab0b-db95e13d7057]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:53:51 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:53:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a54a21b-9771-4789-a8f3-e829b3f9242b]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG os_brick.utils [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:53:51 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Updating existing volume attachment record: 28efc552-35bd-4326-885a-c4a09820f243 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:53:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:54 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:53:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:53:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 19:53:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:55 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:53:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:53:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:53:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:55 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:56 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:53:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:56 user nova-compute[72782]: DEBUG nova.compute.manager [req-1ddcd81f-0033-43ce-82f8-2f02501ade8c req-57016f29-2c3e-4ce3-87f9-4888e9f3fa31 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Received event network-changed-803ee4c4-0603-4e7a-80e3-83bb2b41e3fd {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:53:56 user nova-compute[72782]: DEBUG nova.compute.manager [req-1ddcd81f-0033-43ce-82f8-2f02501ade8c req-57016f29-2c3e-4ce3-87f9-4888e9f3fa31 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Refreshing instance network info cache due to event network-changed-803ee4c4-0603-4e7a-80e3-83bb2b41e3fd. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:53:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ddcd81f-0033-43ce-82f8-2f02501ade8c req-57016f29-2c3e-4ce3-87f9-4888e9f3fa31 service nova] Acquiring lock "refresh_cache-afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:53:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ddcd81f-0033-43ce-82f8-2f02501ade8c req-57016f29-2c3e-4ce3-87f9-4888e9f3fa31 service nova] Acquired lock "refresh_cache-afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:53:56 user nova-compute[72782]: DEBUG nova.network.neutron [req-1ddcd81f-0033-43ce-82f8-2f02501ade8c req-57016f29-2c3e-4ce3-87f9-4888e9f3fa31 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Refreshing network info cache for port 803ee4c4-0603-4e7a-80e3-83bb2b41e3fd {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:53:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059c305c-1279-4eb0-a1c6-b38c2c0ad393/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059c305c-1279-4eb0-a1c6-b38c2c0ad393/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059c305c-1279-4eb0-a1c6-b38c2c0ad393/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059c305c-1279-4eb0-a1c6-b38c2c0ad393/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:57 user nova-compute[72782]: DEBUG nova.network.neutron [req-1ddcd81f-0033-43ce-82f8-2f02501ade8c req-57016f29-2c3e-4ce3-87f9-4888e9f3fa31 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Updated VIF entry in instance network info cache for port 803ee4c4-0603-4e7a-80e3-83bb2b41e3fd. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:53:57 user nova-compute[72782]: DEBUG nova.network.neutron [req-1ddcd81f-0033-43ce-82f8-2f02501ade8c req-57016f29-2c3e-4ce3-87f9-4888e9f3fa31 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Updating instance_info_cache with network_info: [{"id": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "address": "fa:16:3e:7c:2a:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803ee4c4-06", "ovs_interfaceid": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:53:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ddcd81f-0033-43ce-82f8-2f02501ade8c req-57016f29-2c3e-4ce3-87f9-4888e9f3fa31 service nova] Releasing lock "refresh_cache-afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:53:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:53:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:53:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:53:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:53:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:53:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:53:59 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:53:59 user nova-compute[72782]: INFO nova.compute.claims [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Claim successful on node user
Aug 14 19:53:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:53:59 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:53:59 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:53:59 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7260MB free_disk=25.604942321777344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:53:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.045s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.423s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.network.neutron [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:54:00 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 792f31f1-4079-4443-81f2-b1e364a9ee14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance c748103b-a37c-47c5-8394-ea54749f27eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance d0ffe207-a89e-41ef-85af-7927ce06627e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance e1052af2-5cc1-4d38-9467-032128545267 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 4702362b-72ca-43b7-aed2-3545a5f13a98 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 059c305c-1279-4eb0-a1c6-b38c2c0ad393 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance a4ae2e60-c4d4-4a7e-826e-fb315fa98138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:54:00 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Creating image(s)
Aug 14 19:54:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "/opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "/opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.policy [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d0b98a72a4843beafc4bda85ae07f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23edaa22c50450b9b35fc42fcd4f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.206s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.194s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.733s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk 1073741824" returned: 0 in 0.078s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.191s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG nova.network.neutron [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Successfully created port: 06f53b30-4cdd-4b86-a06d-2734de26fb74 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Cannot resize image /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG nova.objects.instance [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lazy-loading 'migration_context' on Instance uuid a4ae2e60-c4d4-4a7e-826e-fb315fa98138 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Ensure instance console log exists: /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'flavor' on Instance uuid afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:01 user nova-compute[72782]: INFO nova.compute.manager [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Attaching volume 7e20f66d-2b90-4941-a757-0fdc6eb8538a to /dev/vdb
Aug 14 19:54:01 user nova-compute[72782]: DEBUG os_brick.utils [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:54:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBfskSnM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:54:02 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:54:02 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:54:02 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef3766e-b314-4773-b953-da4abfee08bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.network.neutron [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Successfully updated port: 06f53b30-4cdd-4b86-a06d-2734de26fb74 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[82085d72-cb17-4215-814c-fb6a394b6993]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:54:02 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f448de-642d-4b2d-ad25-bb0df88bcd4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "refresh_cache-a4ae2e60-c4d4-4a7e-826e-fb315fa98138" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquired lock "refresh_cache-a4ae2e60-c4d4-4a7e-826e-fb315fa98138" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.network.neutron [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[320aeb90-8c3f-4fd7-aff9-37f77de18873]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f152cc2d-1dd1-441e-ad45-c2a5add30538]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b] added
Aug 14 19:54:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9374da5d-c430-4440-9994-00900c3e8974]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1739c585-aa37-4ae7-8016-e58ac3a42ada]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-7094b824-c7c7-48b9-9595-d7c25c21de27 req-700ae8d5-052a-4884-aea5-f962d5e980e1 service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Received event network-changed-06f53b30-4cdd-4b86-a06d-2734de26fb74 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-7094b824-c7c7-48b9-9595-d7c25c21de27 req-700ae8d5-052a-4884-aea5-f962d5e980e1 service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Refreshing instance network info cache due to event network-changed-06f53b30-4cdd-4b86-a06d-2734de26fb74. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7094b824-c7c7-48b9-9595-d7c25c21de27 req-700ae8d5-052a-4884-aea5-f962d5e980e1 service nova] Acquiring lock "refresh_cache-a4ae2e60-c4d4-4a7e-826e-fb315fa98138" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.network.neutron [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:54:02 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3f9e16-3a2c-4b85-9c0c-9373c413187a]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.utils [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Updating existing volume attachment record: dfcc7b79-d1e3-43a3-b05a-c44278307bef {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[513c0f31-0c91-44a8-950b-7c59d2fb3f5a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EBfskSnM {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EBfskSnM" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[142bd1b4-565f-48a2-afb0-5fc5718cccbd]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EBfskSnM'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0e2f8d-24bf-481e-824e-3191d430c104]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[328961a7-89ff-4353-a18a-4fe061a55ebd]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:02 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:02 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1103b324-0ba8-45c5-ad98-ae010c2e569a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b, portal: 172.16.0.220,3260]
Aug 14 19:54:02 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b, portal: 172.16.0.220,3260] successful.
Aug 14 19:54:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[375edf07-227d-48e0-a4cf-eadf8f823335]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4e7cb2-8fd7-47a4-aeba-f9deb9af1e97]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:02 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:02 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:02 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:02 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.031s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3d1252-467a-4f97-aa35-c9e292914696]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBfskSnM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.network.neutron [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Updating instance_info_cache with network_info: [{"id": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "address": "fa:16:3e:2d:5e:cf", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f53b30-4c", "ovs_interfaceid": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Releasing lock "refresh_cache-a4ae2e60-c4d4-4a7e-826e-fb315fa98138" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Instance network_info: |[{"id": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "address": "fa:16:3e:2d:5e:cf", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f53b30-4c", "ovs_interfaceid": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7094b824-c7c7-48b9-9595-d7c25c21de27 req-700ae8d5-052a-4884-aea5-f962d5e980e1 service nova] Acquired lock "refresh_cache-a4ae2e60-c4d4-4a7e-826e-fb315fa98138" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.network.neutron [req-7094b824-c7c7-48b9-9595-d7c25c21de27 req-700ae8d5-052a-4884-aea5-f962d5e980e1 service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Refreshing network info cache for port 06f53b30-4cdd-4b86-a06d-2734de26fb74 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Start _get_guest_xml network_info=[{"id": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "address": "fa:16:3e:2d:5e:cf", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f53b30-4c", "ovs_interfaceid": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:54:02 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:54:02 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-424258125',display_name='tempest-TestStampPattern-server-424258125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-424258125',id=24,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM83rJpi+PWJVg1bcMN9+UzFWK7I+4X1gYs6cuilTIZnJOuWki/JRMmqnsb5/j9U7gZMW4Fb1jbj8E3oTngmEYniu5bxs0zhFngi/h3GEmcDqt3L25ZYVeHugUHVbYP8eA==',key_name='tempest-TestStampPattern-666114121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b23edaa22c50450b9b35fc42fcd4f59f',ramdisk_id='',reservation_id='r-os8wlxsn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-890299113',owner_user_name='tempest-TestStampPattern-890299113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:54:00Z,user_data=None,user_id='9d0b98a72a4843beafc4bda85ae07f61',uuid=a4ae2e60-c4d4-4a7e-826e-fb315fa98138,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "address": "fa:16:3e:2d:5e:cf", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f53b30-4c", "ovs_interfaceid": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Converting VIF {"id": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "address": "fa:16:3e:2d:5e:cf", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f53b30-4c", "ovs_interfaceid": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:5e:cf,bridge_name='br-int',has_traffic_filtering=True,id=06f53b30-4cdd-4b86-a06d-2734de26fb74,network=Network(6cd1aff4-7785-41f1-8881-49783a46d7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f53b30-4c') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.objects.instance [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lazy-loading 'pci_devices' on Instance uuid a4ae2e60-c4d4-4a7e-826e-fb315fa98138 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:54:02 user nova-compute[72782]:   <uuid>a4ae2e60-c4d4-4a7e-826e-fb315fa98138</uuid>
Aug 14 19:54:02 user nova-compute[72782]:   <name>instance-00000018</name>
Aug 14 19:54:02 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:54:02 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:54:02 user nova-compute[72782]:   <metadata>
Aug 14 19:54:02 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:54:02 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:54:02 user nova-compute[72782]:       <nova:name>tempest-TestStampPattern-server-424258125</nova:name>
Aug 14 19:54:02 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:54:02</nova:creationTime>
Aug 14 19:54:02 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:54:02 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:54:02 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:54:02 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:54:02 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:54:02 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:54:02 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:54:02 user nova-compute[72782]:       <nova:owner>
Aug 14 19:54:02 user nova-compute[72782]:         <nova:user uuid="9d0b98a72a4843beafc4bda85ae07f61">tempest-TestStampPattern-890299113-project-member</nova:user>
Aug 14 19:54:02 user nova-compute[72782]:         <nova:project uuid="b23edaa22c50450b9b35fc42fcd4f59f">tempest-TestStampPattern-890299113</nova:project>
Aug 14 19:54:02 user nova-compute[72782]:       </nova:owner>
Aug 14 19:54:02 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:54:02 user nova-compute[72782]:       <nova:ports>
Aug 14 19:54:02 user nova-compute[72782]:         <nova:port uuid="06f53b30-4cdd-4b86-a06d-2734de26fb74">
Aug 14 19:54:02 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 19:54:02 user nova-compute[72782]:         </nova:port>
Aug 14 19:54:02 user nova-compute[72782]:       </nova:ports>
Aug 14 19:54:02 user nova-compute[72782]:     </nova:instance>
Aug 14 19:54:02 user nova-compute[72782]:   </metadata>
Aug 14 19:54:02 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:54:02 user nova-compute[72782]:     <system>
Aug 14 19:54:02 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:54:02 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:54:02 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:54:02 user nova-compute[72782]:       <entry name="serial">a4ae2e60-c4d4-4a7e-826e-fb315fa98138</entry>
Aug 14 19:54:02 user nova-compute[72782]:       <entry name="uuid">a4ae2e60-c4d4-4a7e-826e-fb315fa98138</entry>
Aug 14 19:54:02 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:54:02 user nova-compute[72782]:     </system>
Aug 14 19:54:02 user nova-compute[72782]:   </sysinfo>
Aug 14 19:54:02 user nova-compute[72782]:   <os>
Aug 14 19:54:02 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:54:02 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:54:02 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:54:02 user nova-compute[72782]:   </os>
Aug 14 19:54:02 user nova-compute[72782]:   <features>
Aug 14 19:54:02 user nova-compute[72782]:     <acpi/>
Aug 14 19:54:02 user nova-compute[72782]:     <apic/>
Aug 14 19:54:02 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:54:02 user nova-compute[72782]:   </features>
Aug 14 19:54:02 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:54:02 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:54:02 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:54:02 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:54:02 user nova-compute[72782]:   </clock>
Aug 14 19:54:02 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:54:02 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:54:02 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:54:02 user nova-compute[72782]:   </cpu>
Aug 14 19:54:02 user nova-compute[72782]:   <devices>
Aug 14 19:54:02 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:54:02 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:54:02 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk"/>
Aug 14 19:54:02 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:54:02 user nova-compute[72782]:     </disk>
Aug 14 19:54:02 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:54:02 user nova-compute[72782]:       <mac address="fa:16:3e:2d:5e:cf"/>
Aug 14 19:54:02 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:54:02 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:54:02 user nova-compute[72782]:       <target dev="tap06f53b30-4c"/>
Aug 14 19:54:02 user nova-compute[72782]:     </interface>
Aug 14 19:54:02 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:54:02 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/console.log" append="off"/>
Aug 14 19:54:02 user nova-compute[72782]:     </serial>
Aug 14 19:54:02 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:54:02 user nova-compute[72782]:     <video>
Aug 14 19:54:02 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:54:02 user nova-compute[72782]:     </video>
Aug 14 19:54:02 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:54:02 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:54:02 user nova-compute[72782]:     </rng>
Aug 14 19:54:02 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:54:02 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:54:02 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:54:02 user nova-compute[72782]:     </memballoon>
Aug 14 19:54:02 user nova-compute[72782]:   </devices>
Aug 14 19:54:02 user nova-compute[72782]: </domain>
Aug 14 19:54:02 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-424258125',display_name='tempest-TestStampPattern-server-424258125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-424258125',id=24,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM83rJpi+PWJVg1bcMN9+UzFWK7I+4X1gYs6cuilTIZnJOuWki/JRMmqnsb5/j9U7gZMW4Fb1jbj8E3oTngmEYniu5bxs0zhFngi/h3GEmcDqt3L25ZYVeHugUHVbYP8eA==',key_name='tempest-TestStampPattern-666114121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b23edaa22c50450b9b35fc42fcd4f59f',ramdisk_id='',reservation_id='r-os8wlxsn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-890299113',owner_user_name='tempest-TestStampPattern-890299113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:54:00Z,user_data=None,user_id='9d0b98a72a4843beafc4bda85ae07f61',uuid=a4ae2e60-c4d4-4a7e-826e-fb315fa98138,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "address": "fa:16:3e:2d:5e:cf", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f53b30-4c", "ovs_interfaceid": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Converting VIF {"id": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "address": "fa:16:3e:2d:5e:cf", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f53b30-4c", "ovs_interfaceid": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:5e:cf,bridge_name='br-int',has_traffic_filtering=True,id=06f53b30-4cdd-4b86-a06d-2734de26fb74,network=Network(6cd1aff4-7785-41f1-8881-49783a46d7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f53b30-4c') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG os_vif [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:5e:cf,bridge_name='br-int',has_traffic_filtering=True,id=06f53b30-4cdd-4b86-a06d-2734de26fb74,network=Network(6cd1aff4-7785-41f1-8881-49783a46d7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f53b30-4c') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06f53b30-4c, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06f53b30-4c, col_values=(('external_ids', {'iface-id': '06f53b30-4cdd-4b86-a06d-2734de26fb74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:5e:cf', 'vm-uuid': 'a4ae2e60-c4d4-4a7e-826e-fb315fa98138'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:02 user nova-compute[72782]: INFO os_vif [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:5e:cf,bridge_name='br-int',has_traffic_filtering=True,id=06f53b30-4cdd-4b86-a06d-2734de26fb74,network=Network(6cd1aff4-7785-41f1-8881-49783a46d7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f53b30-4c')
Aug 14 19:54:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:54:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] No VIF found with MAC fa:16:3e:2d:5e:cf, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:54:03 user nova-compute[72782]: DEBUG nova.network.neutron [req-7094b824-c7c7-48b9-9595-d7c25c21de27 req-700ae8d5-052a-4884-aea5-f962d5e980e1 service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Updated VIF entry in instance network info cache for port 06f53b30-4cdd-4b86-a06d-2734de26fb74. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:54:03 user nova-compute[72782]: DEBUG nova.network.neutron [req-7094b824-c7c7-48b9-9595-d7c25c21de27 req-700ae8d5-052a-4884-aea5-f962d5e980e1 service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Updating instance_info_cache with network_info: [{"id": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "address": "fa:16:3e:2d:5e:cf", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f53b30-4c", "ovs_interfaceid": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:54:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7094b824-c7c7-48b9-9595-d7c25c21de27 req-700ae8d5-052a-4884-aea5-f962d5e980e1 service nova] Releasing lock "refresh_cache-a4ae2e60-c4d4-4a7e-826e-fb315fa98138" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:54:03 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:54:03 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23531356661303035', 'path': '/dev/sdd'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:54:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531356661303035', 'path': '/dev/sdd'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:54:03 user nova-compute[72782]: DEBUG nova.objects.instance [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lazy-loading 'flavor' on Instance uuid 792f31f1-4079-4443-81f2-b1e364a9ee14 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:54:03 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:54:03 user nova-compute[72782]:   <source dev="/dev/sdd"/>
Aug 14 19:54:03 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:54:03 user nova-compute[72782]:   <serial>192ff840-03a7-4424-b009-dd541b322d4b</serial>
Aug 14 19:54:03 user nova-compute[72782]: </disk>
Aug 14 19:54:03 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:54:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:54:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:54:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] No VIF found with MAC fa:16:3e:5d:85:34, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:54:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-293761e8-7b03-4868-b1ee-ed9198c9b87b tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.773s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-fadf49fd-f4fb-46f7-bf17-5fff403e5ca9 req-a914cba5-5e7c-4682-a74d-e1664720406a service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Received event network-vif-plugged-06f53b30-4cdd-4b86-a06d-2734de26fb74 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:54:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fadf49fd-f4fb-46f7-bf17-5fff403e5ca9 req-a914cba5-5e7c-4682-a74d-e1664720406a service nova] Acquiring lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fadf49fd-f4fb-46f7-bf17-5fff403e5ca9 req-a914cba5-5e7c-4682-a74d-e1664720406a service nova] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fadf49fd-f4fb-46f7-bf17-5fff403e5ca9 req-a914cba5-5e7c-4682-a74d-e1664720406a service nova] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-fadf49fd-f4fb-46f7-bf17-5fff403e5ca9 req-a914cba5-5e7c-4682-a74d-e1664720406a service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] No waiting events found dispatching network-vif-plugged-06f53b30-4cdd-4b86-a06d-2734de26fb74 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:54:05 user nova-compute[72782]: WARNING nova.compute.manager [req-fadf49fd-f4fb-46f7-bf17-5fff403e5ca9 req-a914cba5-5e7c-4682-a74d-e1664720406a service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Received unexpected event network-vif-plugged-06f53b30-4cdd-4b86-a06d-2734de26fb74 for instance with vm_state building and task_state spawning.
Aug 14 19:54:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:05 user nova-compute[72782]: INFO nova.compute.manager [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Rescuing
Aug 14 19:54:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:54:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquired lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:54:05 user nova-compute[72782]: DEBUG nova.network.neutron [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:54:06 user nova-compute[72782]: DEBUG nova.network.neutron [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Updating instance_info_cache with network_info: [{"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:54:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Releasing lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:54:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:06 user nova-compute[72782]: DEBUG nova.compute.manager [req-b6d22b07-ed0f-4071-bc59-ebafba58146c req-3b300550-9488-4c1a-ba7a-9e83f2a69c6d service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received event network-vif-unplugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:54:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b6d22b07-ed0f-4071-bc59-ebafba58146c req-3b300550-9488-4c1a-ba7a-9e83f2a69c6d service nova] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b6d22b07-ed0f-4071-bc59-ebafba58146c req-3b300550-9488-4c1a-ba7a-9e83f2a69c6d service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b6d22b07-ed0f-4071-bc59-ebafba58146c req-3b300550-9488-4c1a-ba7a-9e83f2a69c6d service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:06 user nova-compute[72782]: DEBUG nova.compute.manager [req-b6d22b07-ed0f-4071-bc59-ebafba58146c req-3b300550-9488-4c1a-ba7a-9e83f2a69c6d service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] No waiting events found dispatching network-vif-unplugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:54:06 user nova-compute[72782]: WARNING nova.compute.manager [req-b6d22b07-ed0f-4071-bc59-ebafba58146c req-3b300550-9488-4c1a-ba7a-9e83f2a69c6d service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received unexpected event network-vif-unplugged-5fae61f6-03b8-4f93-8719-be8733d8590c for instance with vm_state active and task_state rescuing.
Aug 14 19:54:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Instance destroyed successfully.
Aug 14 19:54:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Attempting a stable device rescue
Aug 14 19:54:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72782) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 19:54:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Instance directory exists: not creating {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 19:54:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Creating image(s)
Aug 14 19:54:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "/opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "/opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "/opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:07 user nova-compute[72782]: DEBUG nova.objects.instance [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lazy-loading 'trusted_certs' on Instance uuid 792f31f1-4079-4443-81f2-b1e364a9ee14 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:07 user nova-compute[72782]: DEBUG nova.compute.manager [req-cbdee13c-683c-4bbd-93d9-fec98ab1fe68 req-02d8d6ad-4c22-4d81-ad6d-540cd86b2465 service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Received event network-vif-plugged-06f53b30-4cdd-4b86-a06d-2734de26fb74 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:54:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cbdee13c-683c-4bbd-93d9-fec98ab1fe68 req-02d8d6ad-4c22-4d81-ad6d-540cd86b2465 service nova] Acquiring lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cbdee13c-683c-4bbd-93d9-fec98ab1fe68 req-02d8d6ad-4c22-4d81-ad6d-540cd86b2465 service nova] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cbdee13c-683c-4bbd-93d9-fec98ab1fe68 req-02d8d6ad-4c22-4d81-ad6d-540cd86b2465 service nova] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:07 user nova-compute[72782]: DEBUG nova.compute.manager [req-cbdee13c-683c-4bbd-93d9-fec98ab1fe68 req-02d8d6ad-4c22-4d81-ad6d-540cd86b2465 service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] No waiting events found dispatching network-vif-plugged-06f53b30-4cdd-4b86-a06d-2734de26fb74 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:54:07 user nova-compute[72782]: WARNING nova.compute.manager [req-cbdee13c-683c-4bbd-93d9-fec98ab1fe68 req-02d8d6ad-4c22-4d81-ad6d-540cd86b2465 service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Received unexpected event network-vif-plugged-06f53b30-4cdd-4b86-a06d-2734de26fb74 for instance with vm_state building and task_state spawning.
Aug 14 19:54:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "124cf09669d2c652a7e47d3f9894d52c12c78248" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "124cf09669d2c652a7e47d3f9894d52c12c78248" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/124cf09669d2c652a7e47d3f9894d52c12c78248.part --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:07 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042847.2566361, a4ae2e60-c4d4-4a7e-826e-fb315fa98138 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:54:07 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] VM Resumed (Lifecycle Event)
Aug 14 19:54:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:54:08 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Instance spawned successfully.
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:54:08 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042847.2577932, a4ae2e60-c4d4-4a7e-826e-fb315fa98138 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:54:08 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] VM Started (Lifecycle Event)
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:54:08 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/124cf09669d2c652a7e47d3f9894d52c12c78248.part --force-share --output=json" returned: 0 in 0.210s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.images [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] 412d0d0b-18cc-4cca-87af-55c90f37dd19 was qcow2, converting to raw {{(pid=72782) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.privsep.utils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72782) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/124cf09669d2c652a7e47d3f9894d52c12c78248.part /opt/stack/data/nova/instances/_base/124cf09669d2c652a7e47d3f9894d52c12c78248.converted {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:08 user nova-compute[72782]: INFO nova.compute.manager [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Took 7.85 seconds to spawn the instance on the hypervisor.
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:54:08 user nova-compute[72782]: INFO nova.compute.manager [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Took 9.32 seconds to build instance.
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/124cf09669d2c652a7e47d3f9894d52c12c78248.part /opt/stack/data/nova/instances/_base/124cf09669d2c652a7e47d3f9894d52c12c78248.converted" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/124cf09669d2c652a7e47d3f9894d52c12c78248.converted --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07142a28-d172-4f78-b2ca-ccb6e44a7190 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.517s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/124cf09669d2c652a7e47d3f9894d52c12c78248.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "124cf09669d2c652a7e47d3f9894d52c12c78248" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.400s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "124cf09669d2c652a7e47d3f9894d52c12c78248" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "124cf09669d2c652a7e47d3f9894d52c12c78248" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/124cf09669d2c652a7e47d3f9894d52c12c78248 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-35bacdcf-7e3f-4c11-acdd-634091b9886f req-6e988478-3237-4529-ac7f-7297e0023a33 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received event network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-35bacdcf-7e3f-4c11-acdd-634091b9886f req-6e988478-3237-4529-ac7f-7297e0023a33 service nova] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-35bacdcf-7e3f-4c11-acdd-634091b9886f req-6e988478-3237-4529-ac7f-7297e0023a33 service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-35bacdcf-7e3f-4c11-acdd-634091b9886f req-6e988478-3237-4529-ac7f-7297e0023a33 service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-35bacdcf-7e3f-4c11-acdd-634091b9886f req-6e988478-3237-4529-ac7f-7297e0023a33 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] No waiting events found dispatching network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:54:08 user nova-compute[72782]: WARNING nova.compute.manager [req-35bacdcf-7e3f-4c11-acdd-634091b9886f req-6e988478-3237-4529-ac7f-7297e0023a33 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received unexpected event network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c for instance with vm_state active and task_state rescuing.
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/124cf09669d2c652a7e47d3f9894d52c12c78248 --force-share --output=json" returned: 0 in 0.176s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/124cf09669d2c652a7e47d3f9894d52c12c78248,backing_fmt=raw /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk.rescue {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/124cf09669d2c652a7e47d3f9894d52c12c78248,backing_fmt=raw /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk.rescue" returned: 0 in 0.053s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "124cf09669d2c652a7e47d3f9894d52c12c78248" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.objects.instance [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lazy-loading 'migration_context' on Instance uuid 792f31f1-4079-4443-81f2-b1e364a9ee14 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Start _get_guest_xml network_info=[{"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "vif_mac": "fa:16:3e:5d:85:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '412d0d0b-18cc-4cca-87af-55c90f37dd19', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '28efc552-35bd-4326-885a-c4a09820f243', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBfskSnM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '792f31f1-4079-4443-81f2-b1e364a9ee14', 'attached_at': '', 'detached_at': '', 'volume_id': '192ff840-03a7-4424-b009-dd541b322d4b', 'serial': '192ff840-03a7-4424-b009-dd541b322d4b'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.objects.instance [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lazy-loading 'resources' on Instance uuid 792f31f1-4079-4443-81f2-b1e364a9ee14 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.objects.instance [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lazy-loading 'numa_topology' on Instance uuid 792f31f1-4079-4443-81f2-b1e364a9ee14 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:08 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:54:08 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.objects.instance [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lazy-loading 'vcpu_model' on Instance uuid 792f31f1-4079-4443-81f2-b1e364a9ee14 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBfskSnM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:54:08 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:54:08 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:54:08 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:54:08 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:54:08 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d99e86-0e2a-49ee-9f21-690387ba629f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = EBfskSnM\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 19:54:08 user nova-compute[72782]: node.name = iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b
Aug 14 19:54:08 user nova-compute[72782]: node.tpgt = -1
Aug 14 19:54:08 user nova-compute[72782]: node.startup = automatic
Aug 14 19:54:08 user nova-compute[72782]: node.leading_login = No
Aug 14 19:54:08 user nova-compute[72782]: iface.iscsi_ifacename = default
Aug 14 19:54:08 user nova-compute[72782]: iface.net_ifacename = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.ipaddress = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.prefix_len = 0
Aug 14 19:54:08 user nova-compute[72782]: iface.hwaddress = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.transport_name = tcp
Aug 14 19:54:08 user nova-compute[72782]: iface.initiatorname = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.state = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.vlan_id = 0
Aug 14 19:54:08 user nova-compute[72782]: iface.vlan_priority = 0
Aug 14 19:54:08 user nova-compute[72782]: iface.vlan_state = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.iface_num = 0
Aug 14 19:54:08 user nova-compute[72782]: iface.mtu = 0
Aug 14 19:54:08 user nova-compute[72782]: iface.port = 0
Aug 14 19:54:08 user nova-compute[72782]: iface.bootproto = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.subnet_mask = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.gateway = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.dhcp_alt_client_id = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.dhcp_dns = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.dhcp_learn_iqn = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.dhcp_vendor_id_state = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.dhcp_vendor_id = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.dhcp_slp_da = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.fragmentation = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.gratuitous_arp = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.incoming_forwarding = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.tos_state = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.tos = 0
Aug 14 19:54:08 user nova-compute[72782]: iface.ttl = 0
Aug 14 19:54:08 user nova-compute[72782]: iface.delayed_ack = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.tcp_nagle = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.tcp_wsf_state = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.tcp_wsf = 0
Aug 14 19:54:08 user nova-compute[72782]: iface.tcp_timer_scale = 0
Aug 14 19:54:08 user nova-compute[72782]: iface.tcp_timestamp = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.redirect = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.def_task_mgmt_timeout = 0
Aug 14 19:54:08 user nova-compute[72782]: iface.header_digest = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.data_digest = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.immediate_data = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.initial_r2t = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.data_seq_inorder = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.data_pdu_inorder = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.erl = 0
Aug 14 19:54:08 user nova-compute[72782]: iface.max_receive_data_len = 0
Aug 14 19:54:08 user nova-compute[72782]: iface.first_burst_len = 0
Aug 14 19:54:08 user nova-compute[72782]: iface.max_outstanding_r2t = 0
Aug 14 19:54:08 user nova-compute[72782]: iface.max_burst_len = 0
Aug 14 19:54:08 user nova-compute[72782]: iface.chap_auth = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.bidi_chap = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.strict_login_compliance = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.discovery_auth = <empty>
Aug 14 19:54:08 user nova-compute[72782]: iface.discovery_logout = <empty>
Aug 14 19:54:08 user nova-compute[72782]: node.discovery_address = <empty>
Aug 14 19:54:08 user nova-compute[72782]: node.discovery_port = 0
Aug 14 19:54:08 user nova-compute[72782]: node.discovery_type = static
Aug 14 19:54:08 user nova-compute[72782]: node.session.initial_cmdsn = 0
Aug 14 19:54:08 user nova-compute[72782]: node.session.initial_login_retry_max = 8
Aug 14 19:54:08 user nova-compute[72782]: node.session.xmit_thread_priority = -20
Aug 14 19:54:08 user nova-compute[72782]: node.session.cmds_max = 128
Aug 14 19:54:08 user nova-compute[72782]: node.session.queue_depth = 32
Aug 14 19:54:08 user nova-compute[72782]: node.session.nr_sessions = 1
Aug 14 19:54:08 user nova-compute[72782]: node.session.auth.authmethod = CHAP
Aug 14 19:54:08 user nova-compute[72782]: node.session.auth.username = EBfskSnM
Aug 14 19:54:08 user nova-compute[72782]: node.session.auth.password = ***
Aug 14 19:54:08 user nova-compute[72782]: node.session.auth.username_in = <empty>
Aug 14 19:54:08 user nova-compute[72782]: node.session.auth.password_in = <empty>
Aug 14 19:54:08 user nova-compute[72782]: node.session.auth.chap_algs = MD5
Aug 14 19:54:08 user nova-compute[72782]: node.session.timeo.replacement_timeout = 120
Aug 14 19:54:08 user nova-compute[72782]: node.session.err_timeo.abort_timeout = 15
Aug 14 19:54:08 user nova-compute[72782]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 19:54:08 user nova-compute[72782]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 19:54:08 user nova-compute[72782]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 19:54:08 user nova-compute[72782]: node.session.iscsi.FastAbort = Yes
Aug 14 19:54:08 user nova-compute[72782]: node.session.iscsi.InitialR2T = No
Aug 14 19:54:08 user nova-compute[72782]: node.session.iscsi.ImmediateData = Yes
Aug 14 19:54:08 user nova-compute[72782]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 19:54:08 user nova-compute[72782]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 19:54:08 user nova-compute[72782]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 19:54:08 user nova-compute[72782]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 19:54:08 user nova-compute[72782]: node.session.iscsi.MaxConnections = 1
Aug 14 19:54:08 user nova-compute[72782]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 19:54:08 user nova-compute[72782]: node.session.iscsi.ERL = 0
Aug 14 19:54:08 user nova-compute[72782]: node.session.scan = manual
Aug 14 19:54:08 user nova-compute[72782]: node.session.reopen_max = 0
Aug 14 19:54:08 user nova-compute[72782]: node.conn[0].address = 172.16.0.220
Aug 14 19:54:08 user nova-compute[72782]: node.conn[0].port = 3260
Aug 14 19:54:08 user nova-compute[72782]: node.conn[0].startup = manual
Aug 14 19:54:08 user nova-compute[72782]: node.conn[0].tcp.window_size = 524288
Aug 14 19:54:08 user nova-compute[72782]: node.conn[0].tcp.type_of_service = 0
Aug 14 19:54:08 user nova-compute[72782]: node.conn[0].timeo.logout_timeout = 15
Aug 14 19:54:08 user nova-compute[72782]: node.conn[0].timeo.login_timeout = 15
Aug 14 19:54:08 user nova-compute[72782]: node.conn[0].timeo.auth_timeout = 45
Aug 14 19:54:08 user nova-compute[72782]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 19:54:08 user nova-compute[72782]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 19:54:08 user nova-compute[72782]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 19:54:08 user nova-compute[72782]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 19:54:08 user nova-compute[72782]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 19:54:08 user nova-compute[72782]: node.conn[0].iscsi.DataDigest = None
Aug 14 19:54:08 user nova-compute[72782]: node.conn[0].iscsi.IFMarker = No
Aug 14 19:54:08 user nova-compute[72782]: node.conn[0].iscsi.OFMarker = No
Aug 14 19:54:08 user nova-compute[72782]: # END RECORD
Aug 14 19:54:08 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e39b928-ca4b-42ff-82d9-32b0e3eca406]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db9f5c2-c3d3-4e98-a668-2beab3273341]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EBfskSnM {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EBfskSnM" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ab4fac-9d4f-421b-8258-a894882fdd2b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EBfskSnM'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c10904-3a84-4352-9545-5f8b2f134043]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fef5cb4-b960-422f-acc1-1cca921196c1]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:09 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:09 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:09 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:09 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:09 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:09 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.165s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] HCTL ('35', '0', '0', 0) found on session 27 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a08799b-77a2-4c5f-9c75-882a69aac65c]: (4, ('0 0 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Searching for a device in session 27 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBfskSnM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.190s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] <== connect_volume: return (192ms) {'type': 'block', 'scsi_wwn': '23531356661303035', 'path': '/dev/sdd'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531356661303035', 'path': '/dev/sdd'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:50:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1266743551',display_name='tempest-ServerStableDeviceRescueTest-server-1266743551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1266743551',id=16,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSok8m3pECKylKQt4YbbZRBTqI/K6QdxgBYm6xS5vItg57TPvNxoDIiZG9IxLRCkXCktrW8ZYajxM3mSjn3o49kO+4ovNEETfwGQPkB2hcGmJRPHkPrqcDv4Htsp18h0Q==',key_name='tempest-keypair-18432526',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:50:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='298cebe33d4c4fc8bbe40ba77d058f64',ramdisk_id='',reservation_id='r-isa0e3fk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2103058258',owner_user_name='tempest-ServerStableDeviceRescueTest-2103058258-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:52:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa289079a7d841e98ee102cd64235e92',uuid=792f31f1-4079-4443-81f2-b1e364a9ee14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "vif_mac": "fa:16:3e:5d:85:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Converting VIF {"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "vif_mac": "fa:16:3e:5d:85:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:85:34,bridge_name='br-int',has_traffic_filtering=True,id=5fae61f6-03b8-4f93-8719-be8733d8590c,network=Network(86853807-fa05-438d-9f70-cca7e9ed06bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fae61f6-03') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG nova.objects.instance [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lazy-loading 'pci_devices' on Instance uuid 792f31f1-4079-4443-81f2-b1e364a9ee14 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:54:09 user nova-compute[72782]:   <uuid>792f31f1-4079-4443-81f2-b1e364a9ee14</uuid>
Aug 14 19:54:09 user nova-compute[72782]:   <name>instance-00000010</name>
Aug 14 19:54:09 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:54:09 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:54:09 user nova-compute[72782]:   <metadata>
Aug 14 19:54:09 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:54:09 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:54:09 user nova-compute[72782]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1266743551</nova:name>
Aug 14 19:54:09 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:54:08</nova:creationTime>
Aug 14 19:54:09 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:54:09 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:54:09 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:54:09 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:54:09 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:54:09 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:54:09 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:54:09 user nova-compute[72782]:       <nova:owner>
Aug 14 19:54:09 user nova-compute[72782]:         <nova:user uuid="aa289079a7d841e98ee102cd64235e92">tempest-ServerStableDeviceRescueTest-2103058258-project-member</nova:user>
Aug 14 19:54:09 user nova-compute[72782]:         <nova:project uuid="298cebe33d4c4fc8bbe40ba77d058f64">tempest-ServerStableDeviceRescueTest-2103058258</nova:project>
Aug 14 19:54:09 user nova-compute[72782]:       </nova:owner>
Aug 14 19:54:09 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:54:09 user nova-compute[72782]:       <nova:ports>
Aug 14 19:54:09 user nova-compute[72782]:         <nova:port uuid="5fae61f6-03b8-4f93-8719-be8733d8590c">
Aug 14 19:54:09 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 19:54:09 user nova-compute[72782]:         </nova:port>
Aug 14 19:54:09 user nova-compute[72782]:       </nova:ports>
Aug 14 19:54:09 user nova-compute[72782]:     </nova:instance>
Aug 14 19:54:09 user nova-compute[72782]:   </metadata>
Aug 14 19:54:09 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:54:09 user nova-compute[72782]:     <system>
Aug 14 19:54:09 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:54:09 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:54:09 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:54:09 user nova-compute[72782]:       <entry name="serial">792f31f1-4079-4443-81f2-b1e364a9ee14</entry>
Aug 14 19:54:09 user nova-compute[72782]:       <entry name="uuid">792f31f1-4079-4443-81f2-b1e364a9ee14</entry>
Aug 14 19:54:09 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:54:09 user nova-compute[72782]:     </system>
Aug 14 19:54:09 user nova-compute[72782]:   </sysinfo>
Aug 14 19:54:09 user nova-compute[72782]:   <os>
Aug 14 19:54:09 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:54:09 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:54:09 user nova-compute[72782]:   </os>
Aug 14 19:54:09 user nova-compute[72782]:   <features>
Aug 14 19:54:09 user nova-compute[72782]:     <acpi/>
Aug 14 19:54:09 user nova-compute[72782]:     <apic/>
Aug 14 19:54:09 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:54:09 user nova-compute[72782]:   </features>
Aug 14 19:54:09 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:54:09 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:54:09 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:54:09 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:54:09 user nova-compute[72782]:   </clock>
Aug 14 19:54:09 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:54:09 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:54:09 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:54:09 user nova-compute[72782]:   </cpu>
Aug 14 19:54:09 user nova-compute[72782]:   <devices>
Aug 14 19:54:09 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:54:09 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:54:09 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk"/>
Aug 14 19:54:09 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:54:09 user nova-compute[72782]:     </disk>
Aug 14 19:54:09 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 19:54:09 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:54:09 user nova-compute[72782]:       <source dev="/dev/sdd"/>
Aug 14 19:54:09 user nova-compute[72782]:       <target dev="vdb" bus="virtio"/>
Aug 14 19:54:09 user nova-compute[72782]:       <serial>192ff840-03a7-4424-b009-dd541b322d4b</serial>
Aug 14 19:54:09 user nova-compute[72782]:     </disk>
Aug 14 19:54:09 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:54:09 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:54:09 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk.rescue"/>
Aug 14 19:54:09 user nova-compute[72782]:       <target dev="vdc" bus="virtio"/>
Aug 14 19:54:09 user nova-compute[72782]:       <boot order="1"/>
Aug 14 19:54:09 user nova-compute[72782]:     </disk>
Aug 14 19:54:09 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:54:09 user nova-compute[72782]:       <mac address="fa:16:3e:5d:85:34"/>
Aug 14 19:54:09 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:54:09 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:54:09 user nova-compute[72782]:       <target dev="tap5fae61f6-03"/>
Aug 14 19:54:09 user nova-compute[72782]:     </interface>
Aug 14 19:54:09 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:54:09 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/console.log" append="off"/>
Aug 14 19:54:09 user nova-compute[72782]:     </serial>
Aug 14 19:54:09 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:54:09 user nova-compute[72782]:     <video>
Aug 14 19:54:09 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:54:09 user nova-compute[72782]:     </video>
Aug 14 19:54:09 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:54:09 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:54:09 user nova-compute[72782]:     </rng>
Aug 14 19:54:09 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:54:09 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:54:09 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:54:09 user nova-compute[72782]:     </memballoon>
Aug 14 19:54:09 user nova-compute[72782]:   </devices>
Aug 14 19:54:09 user nova-compute[72782]: </domain>
Aug 14 19:54:09 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:54:09 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Instance destroyed successfully.
Aug 14 19:54:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] No VIF found with MAC fa:16:3e:5d:85:34, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "c748103b-a37c-47c5-8394-ea54749f27eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG nova.objects.instance [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lazy-loading 'flavor' on Instance uuid c748103b-a37c-47c5-8394-ea54749f27eb {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "c748103b-a37c-47c5-8394-ea54749f27eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "c748103b-a37c-47c5-8394-ea54749f27eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:09 user nova-compute[72782]: INFO nova.compute.manager [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Attaching volume 69e9edf2-c2d1-4226-bc9c-3bafe0415b7d to /dev/vdb
Aug 14 19:54:09 user nova-compute[72782]: DEBUG os_brick.utils [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c620e45d-01a7-4d02-9af6-d548a3069485]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b906a9e4-490e-4de8-bca3-ccf6bdb451c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bfec5a-0074-46ba-adf7-ca7c0171c1fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[098f45a2-2b68-4491-81e1-5f6e5eca3324]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:54:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:54:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:54:10 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:54:10 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aae9f01-906e-417b-b470-fdadb60b86a5]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:54:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:54:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:54:10 user nova-compute[72782]: DEBUG os_brick.utils [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:54:10 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Updating existing volume attachment record: c48abd7b-1ad5-457b-ba1a-b9f19422dfc1 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:54:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-b20adc5f-2f5d-4748-badd-f63bfec92d51 req-bd549c7e-737d-4d32-9911-3c840ce9aa42 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received event network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:54:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b20adc5f-2f5d-4748-badd-f63bfec92d51 req-bd549c7e-737d-4d32-9911-3c840ce9aa42 service nova] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b20adc5f-2f5d-4748-badd-f63bfec92d51 req-bd549c7e-737d-4d32-9911-3c840ce9aa42 service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b20adc5f-2f5d-4748-badd-f63bfec92d51 req-bd549c7e-737d-4d32-9911-3c840ce9aa42 service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-b20adc5f-2f5d-4748-badd-f63bfec92d51 req-bd549c7e-737d-4d32-9911-3c840ce9aa42 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] No waiting events found dispatching network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:54:11 user nova-compute[72782]: WARNING nova.compute.manager [req-b20adc5f-2f5d-4748-badd-f63bfec92d51 req-bd549c7e-737d-4d32-9911-3c840ce9aa42 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received unexpected event network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c for instance with vm_state active and task_state rescuing.
Aug 14 19:54:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FerAZVnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:54:12 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:54:12 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:54:12 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7f0075-990a-4106-82f1-135214c8afd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:54:12 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[564e3235-ec2c-4123-b6d2-57670e84691e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a] added
Aug 14 19:54:12 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f4da35-70b7-49f4-8ab6-3a534a8b1dc5]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c942a9-c529-45b2-b6f8-f843df3ea1b8]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FerAZVnp {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FerAZVnp" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0efbd9-aebc-4000-ac42-40b24655aa7c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FerAZVnp'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5afbef-1238-4abb-b520-9cd21e598076]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1bb99c-5b65-4da7-b845-dca8c56de762]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:12 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:12 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:12 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:12 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:12 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:12 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ffb4dd-65db-4f29-a285-ae959a3281d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a, portal: 172.16.0.220,3260]
Aug 14 19:54:12 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a, portal: 172.16.0.220,3260] successful.
Aug 14 19:54:12 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f350d18-676b-4ea2-bc4f-e39a969dedaa]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5b7c06-a6eb-4f61-8b24-c89aa30b1a8b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:12 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:12 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:12 user nova-compute[72782]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a (non-flash)
Aug 14 19:54:12 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:12 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:12 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:12 user nova-compute[72782]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a (non-flash)
Aug 14 19:54:12 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[294aae1e-6082-4966-a74a-d0a75a651964]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:54:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FerAZVnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:54:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-4aa42298-836d-4deb-8a2e-baa45275d860 req-72b5fc31-9575-42ff-ad3e-46f947e3e927 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received event network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:54:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4aa42298-836d-4deb-8a2e-baa45275d860 req-72b5fc31-9575-42ff-ad3e-46f947e3e927 service nova] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4aa42298-836d-4deb-8a2e-baa45275d860 req-72b5fc31-9575-42ff-ad3e-46f947e3e927 service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4aa42298-836d-4deb-8a2e-baa45275d860 req-72b5fc31-9575-42ff-ad3e-46f947e3e927 service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-4aa42298-836d-4deb-8a2e-baa45275d860 req-72b5fc31-9575-42ff-ad3e-46f947e3e927 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] No waiting events found dispatching network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:54:13 user nova-compute[72782]: WARNING nova.compute.manager [req-4aa42298-836d-4deb-8a2e-baa45275d860 req-72b5fc31-9575-42ff-ad3e-46f947e3e927 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received unexpected event network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c for instance with vm_state active and task_state rescuing.
Aug 14 19:54:13 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Removed pending event for 792f31f1-4079-4443-81f2-b1e364a9ee14 due to event {{(pid=72782) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 19:54:13 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042853.195916, 792f31f1-4079-4443-81f2-b1e364a9ee14 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:54:13 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] VM Resumed (Lifecycle Event)
Aug 14 19:54:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c170bb0e-6a1f-4a12-9fb3-994e6ba5aed3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:54:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:54:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:54:13 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 19:54:13 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042853.1979687, 792f31f1-4079-4443-81f2-b1e364a9ee14 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:54:13 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] VM Started (Lifecycle Event)
Aug 14 19:54:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:54:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:54:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:54:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26663323638656336', 'path': '/dev/sde'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:54:13 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663323638656336', 'path': '/dev/sde'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:54:13 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'flavor' on Instance uuid afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:13 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:54:13 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:54:13 user nova-compute[72782]:   <source dev="/dev/sde"/>
Aug 14 19:54:13 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:54:13 user nova-compute[72782]:   <serial>7e20f66d-2b90-4941-a757-0fdc6eb8538a</serial>
Aug 14 19:54:13 user nova-compute[72782]: </disk>
Aug 14 19:54:13 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:54:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:54:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:54:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] No VIF found with MAC fa:16:3e:7c:2a:61, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:54:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5d320242-5f38-4df5-b66e-20c494eeaa26 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.539s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:15 user nova-compute[72782]: INFO nova.compute.manager [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Detaching volume 7e20f66d-2b90-4941-a757-0fdc6eb8538a
Aug 14 19:54:15 user nova-compute[72782]: INFO nova.virt.block_device [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Attempting to driver detach volume 7e20f66d-2b90-4941-a757-0fdc6eb8538a from mountpoint /dev/vdb
Aug 14 19:54:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Attempting to detach device vdb from instance afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:54:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:54:15 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:54:15 user nova-compute[72782]:   <source dev="/dev/sde"/>
Aug 14 19:54:15 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:54:15 user nova-compute[72782]:   <serial>7e20f66d-2b90-4941-a757-0fdc6eb8538a</serial>
Aug 14 19:54:15 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:54:15 user nova-compute[72782]: </disk>
Aug 14 19:54:15 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:54:15 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Successfully detached device vdb from instance afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9 from the persistent domain config.
Aug 14 19:54:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:54:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:54:15 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:54:15 user nova-compute[72782]:   <source dev="/dev/sde"/>
Aug 14 19:54:15 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:54:15 user nova-compute[72782]:   <serial>7e20f66d-2b90-4941-a757-0fdc6eb8538a</serial>
Aug 14 19:54:15 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:54:15 user nova-compute[72782]: </disk>
Aug 14 19:54:15 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:54:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692042855.9813085, afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:54:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:54:15 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Successfully detached device vdb from instance afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9 from the live domain config.
Aug 14 19:54:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:54:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FerAZVnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:54:15 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:54:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:54:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:54:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:54:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bc47e6-14e2-4c58-9368-e8a74426dd0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d6f91e-991a-4097-b997-aa6263042208]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:16 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:16 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:16 user nova-compute[72782]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a (non-flash)
Aug 14 19:54:16 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:16 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:16 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:16 user nova-compute[72782]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a (non-flash)
Aug 14 19:54:16 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f64084d0af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a'): ({'sde'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Removing single pathed devices sde {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1b3748-7d6b-4b2e-8d77-32b203f9d679]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5633c23c-2bd5-457b-98f0-669eb7b26f51]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Flushing IO for device /dev/sde {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8e04f8-d210-41d4-94ef-d50190e4da71]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e8d670-2ebd-44b0-b2ca-8c557e6d13af]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] SCSI volumes sde have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[65885d11-bc6c-4ffe-9b41-a17dc54d2ca0]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f1e38b-bec0-4f7e-9d7b-26d0134c2e9b]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a, portal: 172.16.0.220,3260]
Aug 14 19:54:16 user nova-compute[72782]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a, portal: 172.16.0.220,3260] successful.
Aug 14 19:54:16 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e20f66d-2b90-4941-a757-0fdc6eb8538a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dff818-270e-4c9c-addf-26cc65ba912c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] <== disconnect_volume: return (302ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:54:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:54:17 user nova-compute[72782]: DEBUG nova.objects.instance [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'flavor' on Instance uuid afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-055940cf-fc5a-498e-945c-7ac0a39e75b0 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.743s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyJZBnql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:54:33 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:54:33 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:54:33 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b246c9-1b31-40c1-a8c9-275dc6409020]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:54:33 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38b59b2-2daf-4f36-9da6-dd264f0bf53d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d] added
Aug 14 19:54:33 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29c5f51-cc00-46a8-85ca-6922acb81204]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[784a201a-b2b3-41b6-9f89-c38440cf4960]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NyJZBnql {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NyJZBnql" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[187eaa80-1b37-4afb-a97c-18d7a9b2617e]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NyJZBnql'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eccb067-d5d4-4fff-b670-eb64aab10c96]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f39141-d71c-4ca5-a46f-095abcbed221]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:33 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:33 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:33 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:33 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:33 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:33 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3476cade-4d0a-40fe-bd61-c849ff120a3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260]
Aug 14 19:54:33 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260] successful.
Aug 14 19:54:33 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e682877-cb24-4440-8cc2-fbf8c7a59ca1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a8d195-34a3-4d6f-bb14-ef5cdb00b2fd]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:33 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:33 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:33 user nova-compute[72782]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:54:33 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:33 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:33 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:33 user nova-compute[72782]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:54:33 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b208c6-dc22-4578-a156-0c1da34390aa]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:33 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: None {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:54:34 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:54:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyJZBnql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:54:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:54:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26231656538646536', 'path': '/dev/sde'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:54:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231656538646536', 'path': '/dev/sde'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:54:34 user nova-compute[72782]: DEBUG nova.objects.instance [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lazy-loading 'flavor' on Instance uuid c748103b-a37c-47c5-8394-ea54749f27eb {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:54:34 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:54:34 user nova-compute[72782]:   <source dev="/dev/sde"/>
Aug 14 19:54:34 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:54:34 user nova-compute[72782]:   <serial>69e9edf2-c2d1-4226-bc9c-3bafe0415b7d</serial>
Aug 14 19:54:34 user nova-compute[72782]: </disk>
Aug 14 19:54:34 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:54:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:54:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:54:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] No VIF found with MAC fa:16:3e:5f:41:29, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:54:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-607ea220-3a6b-468a-a542-1658e83ec51f tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "c748103b-a37c-47c5-8394-ea54749f27eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.205s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:37 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Stashing vm_state: active {{(pid=72782) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 14 19:54:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:37 user nova-compute[72782]: DEBUG nova.objects.instance [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lazy-loading 'pci_requests' on Instance uuid c748103b-a37c-47c5-8394-ea54749f27eb {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:37 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:54:37 user nova-compute[72782]: INFO nova.compute.claims [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Claim successful on node user
Aug 14 19:54:37 user nova-compute[72782]: DEBUG nova.objects.instance [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lazy-loading 'resources' on Instance uuid c748103b-a37c-47c5-8394-ea54749f27eb {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:37 user nova-compute[72782]: DEBUG nova.objects.instance [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lazy-loading 'pci_devices' on Instance uuid c748103b-a37c-47c5-8394-ea54749f27eb {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:37 user nova-compute[72782]: INFO nova.compute.resource_tracker [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Updating resource usage from migration 6ef954c9-8e6c-4b42-8034-637eb5d1ef0b
Aug 14 19:54:37 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:54:37 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:54:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.514s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:37 user nova-compute[72782]: INFO nova.compute.manager [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Migrating
Aug 14 19:54:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:54:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:54:37 user nova-compute[72782]: INFO nova.compute.rpcapi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 14 19:54:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:54:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:54:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquired lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:54:37 user nova-compute[72782]: DEBUG nova.network.neutron [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:54:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:38 user nova-compute[72782]: DEBUG nova.network.neutron [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Updating instance_info_cache with network_info: [{"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:54:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Releasing lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:54:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Starting migrate_disk_and_power_off {{(pid=72782) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 14 19:54:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-7e7fe83a-5fca-46ef-8061-e923188979ed req-5ae56c44-11f0-4767-9dfb-5218acd2fa22 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received event network-vif-unplugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:54:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7e7fe83a-5fca-46ef-8061-e923188979ed req-5ae56c44-11f0-4767-9dfb-5218acd2fa22 service nova] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7e7fe83a-5fca-46ef-8061-e923188979ed req-5ae56c44-11f0-4767-9dfb-5218acd2fa22 service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7e7fe83a-5fca-46ef-8061-e923188979ed req-5ae56c44-11f0-4767-9dfb-5218acd2fa22 service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-7e7fe83a-5fca-46ef-8061-e923188979ed req-5ae56c44-11f0-4767-9dfb-5218acd2fa22 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] No waiting events found dispatching network-vif-unplugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:54:38 user nova-compute[72782]: WARNING nova.compute.manager [req-7e7fe83a-5fca-46ef-8061-e923188979ed req-5ae56c44-11f0-4767-9dfb-5218acd2fa22 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received unexpected event network-vif-unplugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 for instance with vm_state active and task_state resize_migrating.
Aug 14 19:54:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:39 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Instance destroyed successfully.
Aug 14 19:54:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-541757814',display_name='tempest-ServerActionsTestOtherB-server-541757814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-541757814',id=17,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAarAxn7T7X51FB9WvWO3LMKvuHfCnYFXmKg73GAqFcCk71N2M9odae+ScSuYIAVSuzCKRu92FXDYUypvnCOyLRjSrxNpiNed5PJ7CB2bOBIRMco4NgzPsIxo+nrGJWEGg==',key_name='tempest-keypair-1073189448',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:50:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b283da9d5774739a1749f7684439c35',ramdisk_id='',reservation_id='r-2esch0g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1314711059',owner_user_name='tempest-ServerActionsTestOtherB-1314711059-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:54:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613ae0366fc5462081f877c1f2c40c7e',uuid=c748103b-a37c-47c5-8394-ea54749f27eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-693085563-network", "vif_mac": "fa:16:3e:5f:41:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Converting VIF {"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-693085563-network", "vif_mac": "fa:16:3e:5f:41:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_vif [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap356eefe9-57, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:39 user nova-compute[72782]: INFO os_vif [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57')
Aug 14 19:54:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyJZBnql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:54:39 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[de259803-b4fa-47f9-a1d5-1b2f52ac728b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[12772ee2-124a-4877-bd78-0892301e4baa]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:39 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:39 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:39 user nova-compute[72782]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:54:39 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:39 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:39 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:39 user nova-compute[72782]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:54:39 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f641c2b2440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d'): ({'sde'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Removing single pathed devices sde {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ac5452-c0f4-4ba1-b1a2-d8791bbfe138]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3766d01-b330-4d51-8b9a-7c91c8f179ab]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Flushing IO for device /dev/sde {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[347a43ab-a723-4d07-957a-ac32a5213ed8]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d312f67e-789f-4020-811a-bf4874b22e28]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] SCSI volumes sde have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b51c13-4679-451e-b579-8c6cdb7dbcae]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde72486-f2ad-4dfd-afd4-71c7ab126680]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260]
Aug 14 19:54:39 user nova-compute[72782]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260] successful.
Aug 14 19:54:39 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[675f7bb2-9916-48b7-831c-71915f9dfa4a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] <== disconnect_volume: return (283ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb_resize/disk /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CMD "cp -r /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb_resize/disk /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk" returned: 0 in 0.329s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb_resize/disk.info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk.info {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CMD "cp -r /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb_resize/disk.info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk.info" returned: 0 in 0.033s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:40 user nova-compute[72782]: DEBUG nova.compute.manager [req-92b88294-832b-432d-8536-0b734fa269ee req-dfed64fd-a40e-499a-8426-40c01c3e3eb8 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received event network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:54:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-92b88294-832b-432d-8536-0b734fa269ee req-dfed64fd-a40e-499a-8426-40c01c3e3eb8 service nova] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-92b88294-832b-432d-8536-0b734fa269ee req-dfed64fd-a40e-499a-8426-40c01c3e3eb8 service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-92b88294-832b-432d-8536-0b734fa269ee req-dfed64fd-a40e-499a-8426-40c01c3e3eb8 service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:40 user nova-compute[72782]: DEBUG nova.compute.manager [req-92b88294-832b-432d-8536-0b734fa269ee req-dfed64fd-a40e-499a-8426-40c01c3e3eb8 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] No waiting events found dispatching network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:54:40 user nova-compute[72782]: WARNING nova.compute.manager [req-92b88294-832b-432d-8536-0b734fa269ee req-dfed64fd-a40e-499a-8426-40c01c3e3eb8 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received unexpected event network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 for instance with vm_state active and task_state resize_migrating.
Aug 14 19:54:41 user nova-compute[72782]: DEBUG nova.network.neutron [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Port 356eefe9-57d0-4af1-b7bd-842e2cfa33d0 binding to destination host user is already ACTIVE {{(pid=72782) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 19:54:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:54:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquired lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:54:41 user nova-compute[72782]: DEBUG nova.network.neutron [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG nova.network.neutron [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Updating instance_info_cache with network_info: [{"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Releasing lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG os_brick.utils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07cbabc-9376-4320-b690-e6341b0e38a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d1b7ed-69d3-4fb8-934b-b4838d69c8ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a7e69c-e6d9-45c1-bf46-10baa8c0ec6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d57ce53-9390-4e51-b9fc-3119f969168f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:54:42 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:54:42 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3541f111-1aae-4db2-9dc9-cb584791a119]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG os_brick.utils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:54:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:54:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-d76119de-41cf-4133-ae27-b7dadfb2c8fb req-d8fa3770-d92a-4d95-b991-48d05e3f4a89 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received event network-changed-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:54:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-d76119de-41cf-4133-ae27-b7dadfb2c8fb req-d8fa3770-d92a-4d95-b991-48d05e3f4a89 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Refreshing instance network info cache due to event network-changed-06846aaf-2a0a-4e50-9b81-c4f15943cd28. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:54:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d76119de-41cf-4133-ae27-b7dadfb2c8fb req-d8fa3770-d92a-4d95-b991-48d05e3f4a89 service nova] Acquiring lock "refresh_cache-4702362b-72ca-43b7-aed2-3545a5f13a98" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:54:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d76119de-41cf-4133-ae27-b7dadfb2c8fb req-d8fa3770-d92a-4d95-b991-48d05e3f4a89 service nova] Acquired lock "refresh_cache-4702362b-72ca-43b7-aed2-3545a5f13a98" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:54:49 user nova-compute[72782]: DEBUG nova.network.neutron [req-d76119de-41cf-4133-ae27-b7dadfb2c8fb req-d8fa3770-d92a-4d95-b991-48d05e3f4a89 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Refreshing network info cache for port 06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquiring lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquiring lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:50 user nova-compute[72782]: INFO nova.compute.manager [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Terminating instance
Aug 14 19:54:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG nova.network.neutron [req-d76119de-41cf-4133-ae27-b7dadfb2c8fb req-d8fa3770-d92a-4d95-b991-48d05e3f4a89 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Updated VIF entry in instance network info cache for port 06846aaf-2a0a-4e50-9b81-c4f15943cd28. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG nova.network.neutron [req-d76119de-41cf-4133-ae27-b7dadfb2c8fb req-d8fa3770-d92a-4d95-b991-48d05e3f4a89 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Updating instance_info_cache with network_info: [{"id": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "address": "fa:16:3e:ea:ce:52", "network": {"id": "400033aa-00fb-41ff-a23d-7deee12714e7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1338285309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2583e13fbf42a995ad5d30af0e1428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06846aaf-2a", "ovs_interfaceid": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d76119de-41cf-4133-ae27-b7dadfb2c8fb req-d8fa3770-d92a-4d95-b991-48d05e3f4a89 service nova] Releasing lock "refresh_cache-4702362b-72ca-43b7-aed2-3545a5f13a98" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG nova.compute.manager [req-07db8230-f1ff-4483-8c75-7bbf4e3049ce req-86a2aab9-7380-4016-a03d-e6d8d483c772 service nova] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Received event network-vif-unplugged-e7a0656c-2802-4e58-b0ab-634570cde84a {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-07db8230-f1ff-4483-8c75-7bbf4e3049ce req-86a2aab9-7380-4016-a03d-e6d8d483c772 service nova] Acquiring lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-07db8230-f1ff-4483-8c75-7bbf4e3049ce req-86a2aab9-7380-4016-a03d-e6d8d483c772 service nova] Lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-07db8230-f1ff-4483-8c75-7bbf4e3049ce req-86a2aab9-7380-4016-a03d-e6d8d483c772 service nova] Lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG nova.compute.manager [req-07db8230-f1ff-4483-8c75-7bbf4e3049ce req-86a2aab9-7380-4016-a03d-e6d8d483c772 service nova] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] No waiting events found dispatching network-vif-unplugged-e7a0656c-2802-4e58-b0ab-634570cde84a {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG nova.compute.manager [req-07db8230-f1ff-4483-8c75-7bbf4e3049ce req-86a2aab9-7380-4016-a03d-e6d8d483c772 service nova] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Received event network-vif-unplugged-e7a0656c-2802-4e58-b0ab-634570cde84a for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:54:50 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Instance destroyed successfully.
Aug 14 19:54:50 user nova-compute[72782]: DEBUG nova.objects.instance [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lazy-loading 'resources' on Instance uuid 059c305c-1279-4eb0-a1c6-b38c2c0ad393 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2137805649',display_name='tempest-ServersNegativeTestJSON-server-2137805649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2137805649',id=22,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:53:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fcc7dac78fa47eab14a10d2fe59d320',ramdisk_id='',reservation_id='r-u81j1e0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1211486287',owner_user_name='tempest-ServersNegativeTestJSON-1211486287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:53:08Z,user_data=None,user_id='1f6db9beff934039b38439a362287274',uuid=059c305c-1279-4eb0-a1c6-b38c2c0ad393,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7a0656c-2802-4e58-b0ab-634570cde84a", "address": "fa:16:3e:e9:8a:0d", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a0656c-28", "ovs_interfaceid": "e7a0656c-2802-4e58-b0ab-634570cde84a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Converting VIF {"id": "e7a0656c-2802-4e58-b0ab-634570cde84a", "address": "fa:16:3e:e9:8a:0d", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a0656c-28", "ovs_interfaceid": "e7a0656c-2802-4e58-b0ab-634570cde84a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:8a:0d,bridge_name='br-int',has_traffic_filtering=True,id=e7a0656c-2802-4e58-b0ab-634570cde84a,network=Network(8e9d9f90-4c74-4a14-9f51-0dc87928a619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a0656c-28') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG os_vif [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:8a:0d,bridge_name='br-int',has_traffic_filtering=True,id=e7a0656c-2802-4e58-b0ab-634570cde84a,network=Network(8e9d9f90-4c74-4a14-9f51-0dc87928a619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a0656c-28') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7a0656c-28, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:54:50 user nova-compute[72782]: INFO os_vif [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:8a:0d,bridge_name='br-int',has_traffic_filtering=True,id=e7a0656c-2802-4e58-b0ab-634570cde84a,network=Network(8e9d9f90-4c74-4a14-9f51-0dc87928a619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a0656c-28')
Aug 14 19:54:50 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Deleting instance files /opt/stack/data/nova/instances/059c305c-1279-4eb0-a1c6-b38c2c0ad393_del
Aug 14 19:54:50 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Deletion of /opt/stack/data/nova/instances/059c305c-1279-4eb0-a1c6-b38c2c0ad393_del complete
Aug 14 19:54:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:54:51 user nova-compute[72782]: INFO nova.compute.manager [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 14 19:54:51 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:54:51 user nova-compute[72782]: INFO nova.compute.manager [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Rebuilding instance
Aug 14 19:54:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4702362b-72ca-43b7-aed2-3545a5f13a98 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lazy-loading 'pci_requests' on Instance uuid 4702362b-72ca-43b7-aed2-3545a5f13a98 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lazy-loading 'pci_devices' on Instance uuid 4702362b-72ca-43b7-aed2-3545a5f13a98 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lazy-loading 'resources' on Instance uuid 4702362b-72ca-43b7-aed2-3545a5f13a98 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lazy-loading 'migration_context' on Instance uuid 4702362b-72ca-43b7-aed2-3545a5f13a98 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72782) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Starting finish_migration {{(pid=72782) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Instance directory exists: not creating {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 19:54:51 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Creating image(s)
Aug 14 19:54:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lazy-loading 'trusted_certs' on Instance uuid c748103b-a37c-47c5-8394-ea54749f27eb {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:54:51 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Took 0.84 seconds to deallocate network for instance.
Aug 14 19:54:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.235s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk. size=21474836480 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:54:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Instance destroyed successfully.
Aug 14 19:54:52 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Instance destroyed successfully.
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1210389445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-746603197',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOegGaETqx1Pztqu1P77PVxvX0dwSMalKmcPN2jtCEazOU38nLPC5/6W1Crj1WtV9Rzil7eKqqLrYgjHm4Eh8onwWMwLp8hfPbbHri4CF+U5X3sE+rRfhsJzXgWjRWix7g==',key_name='tempest-keypair-1783336846',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:53:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d2583e13fbf42a995ad5d30af0e1428',ramdisk_id='',reservation_id='r-ghzpchq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2138678264',owner_user_name='tempest-ServerActionsV293TestJSON-2138678264-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:54:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d2306e51414be6a895a1dc017c782f',uuid=4702362b-72ca-43b7-aed2-3545a5f13a98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "address": "fa:16:3e:ea:ce:52", "network": {"id": "400033aa-00fb-41ff-a23d-7deee12714e7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1338285309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2583e13fbf42a995ad5d30af0e1428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06846aaf-2a", "ovs_interfaceid": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Converting VIF {"id": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "address": "fa:16:3e:ea:ce:52", "network": {"id": "400033aa-00fb-41ff-a23d-7deee12714e7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1338285309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2583e13fbf42a995ad5d30af0e1428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06846aaf-2a", "ovs_interfaceid": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=06846aaf-2a0a-4e50-9b81-c4f15943cd28,network=Network(400033aa-00fb-41ff-a23d-7deee12714e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06846aaf-2a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_vif [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=06846aaf-2a0a-4e50-9b81-c4f15943cd28,network=Network(400033aa-00fb-41ff-a23d-7deee12714e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06846aaf-2a') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06846aaf-2a, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:54:52 user nova-compute[72782]: INFO os_vif [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=06846aaf-2a0a-4e50-9b81-c4f15943cd28,network=Network(400033aa-00fb-41ff-a23d-7deee12714e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06846aaf-2a')
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIqUZeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:54:52 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[16468d57-06c0-4dcc-874d-ecf35dd00369]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk 21474836480 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fae34bc-d18c-4c72-8035-8f541abccb50]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:52 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:52 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:54:52 user nova-compute[72782]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:52 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f640879aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk 21474836480" returned: 0 in 0.065s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Did not create local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Ensure instance console log exists: /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Start _get_guest_xml network_info=[{"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-693085563-network", "vif_mac": "fa:16:3e:5f:41:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '75c54dae-846e-4bf1-9ff4-8a8a7ec10568', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyJZBnql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c748103b-a37c-47c5-8394-ea54749f27eb', 'attached_at': '2023-08-14T19:54:52.000000', 'detached_at': '', 'volume_id': '69e9edf2-c2d1-4226-bc9c-3bafe0415b7d', 'serial': '69e9edf2-c2d1-4226-bc9c-3bafe0415b7d'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[577b7aa1-8926-4d62-aa0a-d22b648bd79e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:54:52 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.objects.instance [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lazy-loading 'vcpu_model' on Instance uuid c748103b-a37c-47c5-8394-ea54749f27eb {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[069a4733-d121-4078-b7d9-8f3492dd41a9]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyJZBnql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:54:52 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffda88e-6b7b-4c1f-a8ee-4de1f540c04b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[76899824-691a-4b6f-9999-a501de2071c3]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c04ba101', '/dev/disk/by-id/scsi-1SCST_BIOc04ba101-1bddcb4445915510', '/dev/disk/by-id/scsi-23162646463623434') {{(pid=83776) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a649193-def9-4f08-8d49-b18ad6a70816]: (4, None) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.591s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[139b5002-10bb-48c8-a759-8e7121315cb3]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Deleted allocations for instance 059c305c-1279-4eb0-a1c6-b38c2c0ad393
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7dc1e6-3c13-44f1-bcc5-dcf78e0e3203]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6, portal: 172.16.0.220,3260]
Aug 14 19:54:52 user nova-compute[72782]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6, portal: 172.16.0.220,3260] successful.
Aug 14 19:54:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee61f9d-14d7-4886-b096-fa5932a8e7f1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] <== disconnect_volume: return (439ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:54:52 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Deleting instance files /opt/stack/data/nova/instances/4702362b-72ca-43b7-aed2-3545a5f13a98_del
Aug 14 19:54:52 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Deletion of /opt/stack/data/nova/instances/4702362b-72ca-43b7-aed2-3545a5f13a98_del complete
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.218s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:54:52 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:54:52 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[af749532-a133-4dce-9cc9-f1d053279c9f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:54:52 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-0746dc06-c205-4c57-8a42-06b1dc7a7326 tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.411s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a70a3f0-b0f8-4e90-b449-bc68e6e227d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d] added
Aug 14 19:54:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65ece49-91a0-4063-8b53-c6b391aca1c9]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Received event network-vif-plugged-e7a0656c-2802-4e58-b0ab-634570cde84a {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] Acquiring lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] Lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] Lock "059c305c-1279-4eb0-a1c6-b38c2c0ad393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] No waiting events found dispatching network-vif-plugged-e7a0656c-2802-4e58-b0ab-634570cde84a {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:54:52 user nova-compute[72782]: WARNING nova.compute.manager [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Received unexpected event network-vif-plugged-e7a0656c-2802-4e58-b0ab-634570cde84a for instance with vm_state deleted and task_state None.
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received event network-vif-unplugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] Acquiring lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] No waiting events found dispatching network-vif-unplugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:54:52 user nova-compute[72782]: WARNING nova.compute.manager [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received unexpected event network-vif-unplugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 for instance with vm_state active and task_state rebuilding.
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Received event network-vif-deleted-e7a0656c-2802-4e58-b0ab-634570cde84a {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received event network-vif-plugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] Acquiring lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] No waiting events found dispatching network-vif-plugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:54:52 user nova-compute[72782]: WARNING nova.compute.manager [req-21fd9d35-c08d-4ca3-b064-5014cf13eb3e req-3f5d2d9b-f720-462d-b086-a94a3e71a08e service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received unexpected event network-vif-plugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 for instance with vm_state active and task_state rebuilding.
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd030a85-c83c-4a5d-8fdf-ba0adc470d7c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NyJZBnql {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NyJZBnql" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ded9748-14c8-433c-986d-33fdbd163ae6]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NyJZBnql'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e115465e-5f8d-4efe-9fa2-543dcb078e2f]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10942ca-9b6e-4624-b55a-b3beec2adcc8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:52 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:52 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[31125e64-6c1f-4ccc-9e58-337d133f9f92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260]
Aug 14 19:54:52 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260] successful.
Aug 14 19:54:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 4702362b-72ca-43b7-aed2-3545a5f13a98 could not be found.
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[610c40f2-ce60-4fe4-b782-81a71508de45]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIqUZeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:54:52 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b754563-b30c-42e4-b16a-d458475ca544]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:52 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:52 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:54:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:52 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:52 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:54:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[13624bdc-b6de-4a79-ac41-b8ca5592520d]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:54:53 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:54:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyJZBnql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:54:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:54:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] <== connect_volume: return (1555ms) {'type': 'block', 'scsi_wwn': '26231656538646536', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:54:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231656538646536', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:54:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.056s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:54:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:54:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:53 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[69461559-5c1f-43b4-953d-f73991e622f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-541757814',display_name='tempest-ServerActionsTestOtherB-server-541757814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-541757814',id=17,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAarAxn7T7X51FB9WvWO3LMKvuHfCnYFXmKg73GAqFcCk71N2M9odae+ScSuYIAVSuzCKRu92FXDYUypvnCOyLRjSrxNpiNed5PJ7CB2bOBIRMco4NgzPsIxo+nrGJWEGg==',key_name='tempest-keypair-1073189448',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:50:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b283da9d5774739a1749f7684439c35',ramdisk_id='',reservation_id='r-2esch0g0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1314711059',owner_user_name='tempest-ServerActionsTestOtherB-1314711059-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613ae0366fc5462081f877c1f2c40c7e',uuid=c748103b-a37c-47c5-8394-ea54749f27eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-693085563-network", "vif_mac": "fa:16:3e:5f:41:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:54:53 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Converting VIF {"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-693085563-network", "vif_mac": "fa:16:3e:5f:41:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:54:53 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:54:54 user nova-compute[72782]:   <uuid>c748103b-a37c-47c5-8394-ea54749f27eb</uuid>
Aug 14 19:54:54 user nova-compute[72782]:   <name>instance-00000011</name>
Aug 14 19:54:54 user nova-compute[72782]:   <memory>2097152</memory>
Aug 14 19:54:54 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:54:54 user nova-compute[72782]:   <metadata>
Aug 14 19:54:54 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:54:54 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:54:54 user nova-compute[72782]:       <nova:name>tempest-ServerActionsTestOtherB-server-541757814</nova:name>
Aug 14 19:54:54 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:54:52</nova:creationTime>
Aug 14 19:54:54 user nova-compute[72782]:       <nova:flavor name="m1.small">
Aug 14 19:54:54 user nova-compute[72782]:         <nova:memory>2048</nova:memory>
Aug 14 19:54:54 user nova-compute[72782]:         <nova:disk>20</nova:disk>
Aug 14 19:54:54 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:54:54 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:54:54 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:54:54 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:54:54 user nova-compute[72782]:       <nova:owner>
Aug 14 19:54:54 user nova-compute[72782]:         <nova:user uuid="613ae0366fc5462081f877c1f2c40c7e">tempest-ServerActionsTestOtherB-1314711059-project-member</nova:user>
Aug 14 19:54:54 user nova-compute[72782]:         <nova:project uuid="7b283da9d5774739a1749f7684439c35">tempest-ServerActionsTestOtherB-1314711059</nova:project>
Aug 14 19:54:54 user nova-compute[72782]:       </nova:owner>
Aug 14 19:54:54 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:54:54 user nova-compute[72782]:       <nova:ports>
Aug 14 19:54:54 user nova-compute[72782]:         <nova:port uuid="356eefe9-57d0-4af1-b7bd-842e2cfa33d0">
Aug 14 19:54:54 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 19:54:54 user nova-compute[72782]:         </nova:port>
Aug 14 19:54:54 user nova-compute[72782]:       </nova:ports>
Aug 14 19:54:54 user nova-compute[72782]:     </nova:instance>
Aug 14 19:54:54 user nova-compute[72782]:   </metadata>
Aug 14 19:54:54 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:54:54 user nova-compute[72782]:     <system>
Aug 14 19:54:54 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:54:54 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:54:54 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:54:54 user nova-compute[72782]:       <entry name="serial">c748103b-a37c-47c5-8394-ea54749f27eb</entry>
Aug 14 19:54:54 user nova-compute[72782]:       <entry name="uuid">c748103b-a37c-47c5-8394-ea54749f27eb</entry>
Aug 14 19:54:54 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:54:54 user nova-compute[72782]:     </system>
Aug 14 19:54:54 user nova-compute[72782]:   </sysinfo>
Aug 14 19:54:54 user nova-compute[72782]:   <os>
Aug 14 19:54:54 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:54:54 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:54:54 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:54:54 user nova-compute[72782]:   </os>
Aug 14 19:54:54 user nova-compute[72782]:   <features>
Aug 14 19:54:54 user nova-compute[72782]:     <acpi/>
Aug 14 19:54:54 user nova-compute[72782]:     <apic/>
Aug 14 19:54:54 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:54:54 user nova-compute[72782]:   </features>
Aug 14 19:54:54 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:54:54 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:54:54 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:54:54 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:54:54 user nova-compute[72782]:   </clock>
Aug 14 19:54:54 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:54:54 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:54:54 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:54:54 user nova-compute[72782]:   </cpu>
Aug 14 19:54:54 user nova-compute[72782]:   <devices>
Aug 14 19:54:54 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:54:54 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:54:54 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk"/>
Aug 14 19:54:54 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:54:54 user nova-compute[72782]:     </disk>
Aug 14 19:54:54 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 19:54:54 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:54:54 user nova-compute[72782]:       <source dev="/dev/sdb"/>
Aug 14 19:54:54 user nova-compute[72782]:       <target dev="vdb" bus="virtio"/>
Aug 14 19:54:54 user nova-compute[72782]:       <serial>69e9edf2-c2d1-4226-bc9c-3bafe0415b7d</serial>
Aug 14 19:54:54 user nova-compute[72782]:     </disk>
Aug 14 19:54:54 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:54:54 user nova-compute[72782]:       <mac address="fa:16:3e:5f:41:29"/>
Aug 14 19:54:54 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:54:54 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:54:54 user nova-compute[72782]:       <target dev="tap356eefe9-57"/>
Aug 14 19:54:54 user nova-compute[72782]:     </interface>
Aug 14 19:54:54 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:54:54 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/console.log" append="off"/>
Aug 14 19:54:54 user nova-compute[72782]:     </serial>
Aug 14 19:54:54 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:54:54 user nova-compute[72782]:     <video>
Aug 14 19:54:54 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:54:54 user nova-compute[72782]:     </video>
Aug 14 19:54:54 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:54:54 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:54:54 user nova-compute[72782]:     </rng>
Aug 14 19:54:54 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:54:54 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:54:54 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:54:54 user nova-compute[72782]:     </memballoon>
Aug 14 19:54:54 user nova-compute[72782]:   </devices>
Aug 14 19:54:54 user nova-compute[72782]: </domain>
Aug 14 19:54:54 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-541757814',display_name='tempest-ServerActionsTestOtherB-server-541757814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-541757814',id=17,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAarAxn7T7X51FB9WvWO3LMKvuHfCnYFXmKg73GAqFcCk71N2M9odae+ScSuYIAVSuzCKRu92FXDYUypvnCOyLRjSrxNpiNed5PJ7CB2bOBIRMco4NgzPsIxo+nrGJWEGg==',key_name='tempest-keypair-1073189448',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:50:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b283da9d5774739a1749f7684439c35',ramdisk_id='',reservation_id='r-2esch0g0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1314711059',owner_user_name='tempest-ServerActionsTestOtherB-1314711059-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613ae0366fc5462081f877c1f2c40c7e',uuid=c748103b-a37c-47c5-8394-ea54749f27eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-693085563-network", "vif_mac": "fa:16:3e:5f:41:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Converting VIF {"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-693085563-network", "vif_mac": "fa:16:3e:5f:41:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG os_vif [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap356eefe9-57, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap356eefe9-57, col_values=(('external_ids', {'iface-id': '356eefe9-57d0-4af1-b7bd-842e2cfa33d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:41:29', 'vm-uuid': 'c748103b-a37c-47c5-8394-ea54749f27eb'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9560e692-5ce0-45c1-a06f-0d7d6f35babf]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:54 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:54 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:54:54 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:54:54 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:54:54 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:54:54 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f64084d24d0>, {}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Disconnecting from: [] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.049s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] <== disconnect_volume: return (1105ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:54 user nova-compute[72782]: INFO os_vif [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57')
Aug 14 19:54:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] No VIF found with MAC fa:16:3e:5f:41:29, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042879.1987407, c748103b-a37c-47c5-8394-ea54749f27eb => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:54:54 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] VM Stopped (Lifecycle Event)
Aug 14 19:54:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-39b2d23f-3fee-46b3-90de-2cdd5f302bc1 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Updating instance_info_cache with network_info: [{"id": "2dad6c60-4f31-4548-bfe7-31c85495c454", "address": "fa:16:3e:57:2a:1c", "network": {"id": "16825893-d7a0-4b45-8921-c96e6333c811", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1870839756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1bf9f154f641798504207c6db32799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad6c60-4f", "ovs_interfaceid": "2dad6c60-4f31-4548-bfe7-31c85495c454", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Preparing to wait for external event volume-reimaged-b3f8e876-2e28-4709-b96b-c5f20ee56ab6 {{(pid=72782) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Acquiring lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:55 user nova-compute[72782]: DEBUG nova.compute.manager [req-8eae9138-5bbb-4106-88bf-a94e61862dc7 req-eee32d96-6045-44db-a0a8-90fd0996fd45 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received event network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:54:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8eae9138-5bbb-4106-88bf-a94e61862dc7 req-eee32d96-6045-44db-a0a8-90fd0996fd45 service nova] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8eae9138-5bbb-4106-88bf-a94e61862dc7 req-eee32d96-6045-44db-a0a8-90fd0996fd45 service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8eae9138-5bbb-4106-88bf-a94e61862dc7 req-eee32d96-6045-44db-a0a8-90fd0996fd45 service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:55 user nova-compute[72782]: DEBUG nova.compute.manager [req-8eae9138-5bbb-4106-88bf-a94e61862dc7 req-eee32d96-6045-44db-a0a8-90fd0996fd45 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] No waiting events found dispatching network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:54:55 user nova-compute[72782]: WARNING nova.compute.manager [req-8eae9138-5bbb-4106-88bf-a94e61862dc7 req-eee32d96-6045-44db-a0a8-90fd0996fd45 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received unexpected event network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 for instance with vm_state active and task_state resize_finish.
Aug 14 19:54:56 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:54:56 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:54:56 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:54:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:56 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:54:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:56 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:54:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:56 user nova-compute[72782]: DEBUG nova.compute.manager [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:54:57 user nova-compute[72782]: INFO nova.compute.manager [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] instance snapshotting
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:57 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Beginning live snapshot process
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json -f qcow2 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json -f qcow2 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json -f qcow2" returned: 0 in 0.260s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042897.8049488, c748103b-a37c-47c5-8394-ea54749f27eb => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:54:57 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] VM Resumed (Lifecycle Event)
Aug 14 19:54:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-b9bc878c-2fb8-4927-abfb-a14939194497 req-1e6b6819-36fd-4472-8891-538055c6dbbe service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received event network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b9bc878c-2fb8-4927-abfb-a14939194497 req-1e6b6819-36fd-4472-8891-538055c6dbbe service nova] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b9bc878c-2fb8-4927-abfb-a14939194497 req-1e6b6819-36fd-4472-8891-538055c6dbbe service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b9bc878c-2fb8-4927-abfb-a14939194497 req-1e6b6819-36fd-4472-8891-538055c6dbbe service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-b9bc878c-2fb8-4927-abfb-a14939194497 req-1e6b6819-36fd-4472-8891-538055c6dbbe service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] No waiting events found dispatching network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:54:57 user nova-compute[72782]: WARNING nova.compute.manager [req-b9bc878c-2fb8-4927-abfb-a14939194497 req-1e6b6819-36fd-4472-8891-538055c6dbbe service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received unexpected event network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 for instance with vm_state active and task_state resize_finish.
Aug 14 19:54:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:54:57 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Instance running successfully.
Aug 14 19:54:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Failed to set time: agent not configured {{(pid=72782) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf2406d8-97fb-4fea-8cd1-45245cb462bd tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] finish_migration finished successfully. {{(pid=72782) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 14 19:54:57 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 19:54:57 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042897.806227, c748103b-a37c-47c5-8394-ea54749f27eb => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:54:57 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] VM Started (Lifecycle Event)
Aug 14 19:54:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.194s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj652_1bn/2a339d69933e4879ac54337b8ecb6d9e.delta 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj652_1bn/2a339d69933e4879ac54337b8ecb6d9e.delta 1073741824" returned: 0 in 0.056s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:58 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 19:54:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:54:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:58 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 19:54:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:54:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] COPY block job progress, current cursor: 2293760 final cursor: 75497472 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:54:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:54:59 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 19:54:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:59 user nova-compute[72782]: DEBUG nova.privsep.utils [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72782) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 19:54:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj652_1bn/2a339d69933e4879ac54337b8ecb6d9e.delta /opt/stack/data/nova/instances/snapshots/tmpj652_1bn/2a339d69933e4879ac54337b8ecb6d9e {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:54:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:54:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj652_1bn/2a339d69933e4879ac54337b8ecb6d9e.delta /opt/stack/data/nova/instances/snapshots/tmpj652_1bn/2a339d69933e4879ac54337b8ecb6d9e" returned: 0 in 0.505s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:00 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Snapshot extracted, beginning image upload
Aug 14 19:55:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:01 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:55:01 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:55:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7307MB free_disk=25.43973159790039GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Applying migration context for instance c748103b-a37c-47c5-8394-ea54749f27eb as it has an incoming, in-progress migration 6ef954c9-8e6c-4b42-8034-637eb5d1ef0b. Migration status is finished {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 19:55:01 user nova-compute[72782]: INFO nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Updating resource usage from migration 6ef954c9-8e6c-4b42-8034-637eb5d1ef0b
Aug 14 19:55:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 792f31f1-4079-4443-81f2-b1e364a9ee14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance d0ffe207-a89e-41ef-85af-7927ce06627e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance e1052af2-5cc1-4d38-9467-032128545267 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 4702362b-72ca-43b7-aed2-3545a5f13a98 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance a4ae2e60-c4d4-4a7e-826e-fb315fa98138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Migration 6ef954c9-8e6c-4b42-8034-637eb5d1ef0b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance c748103b-a37c-47c5-8394-ea54749f27eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:55:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:55:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:55:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:55:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:55:03 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Snapshot image upload complete
Aug 14 19:55:03 user nova-compute[72782]: INFO nova.compute.manager [None req-98df781c-c704-46c5-babf-f048665b05a6 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Took 6.63 seconds to snapshot the instance on the hypervisor.
Aug 14 19:55:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:55:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:05 user nova-compute[72782]: INFO nova.compute.manager [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Terminating instance
Aug 14 19:55:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:55:05 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042890.8854976, 059c305c-1279-4eb0-a1c6-b38c2c0ad393 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:55:05 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] VM Stopped (Lifecycle Event)
Aug 14 19:55:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-227e6c49-3eb3-4a1d-bdce-3f9f0ededafe None None] [instance: 059c305c-1279-4eb0-a1c6-b38c2c0ad393] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:55:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:06 user nova-compute[72782]: DEBUG nova.compute.manager [req-2824ba32-f2b5-45a7-a3d8-5e234ea3004e req-fff5120c-11fd-4c42-a801-38d52ececeb8 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Received event network-vif-unplugged-803ee4c4-0603-4e7a-80e3-83bb2b41e3fd {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:55:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2824ba32-f2b5-45a7-a3d8-5e234ea3004e req-fff5120c-11fd-4c42-a801-38d52ececeb8 service nova] Acquiring lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2824ba32-f2b5-45a7-a3d8-5e234ea3004e req-fff5120c-11fd-4c42-a801-38d52ececeb8 service nova] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2824ba32-f2b5-45a7-a3d8-5e234ea3004e req-fff5120c-11fd-4c42-a801-38d52ececeb8 service nova] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:06 user nova-compute[72782]: DEBUG nova.compute.manager [req-2824ba32-f2b5-45a7-a3d8-5e234ea3004e req-fff5120c-11fd-4c42-a801-38d52ececeb8 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] No waiting events found dispatching network-vif-unplugged-803ee4c4-0603-4e7a-80e3-83bb2b41e3fd {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:55:06 user nova-compute[72782]: DEBUG nova.compute.manager [req-2824ba32-f2b5-45a7-a3d8-5e234ea3004e req-fff5120c-11fd-4c42-a801-38d52ececeb8 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Received event network-vif-unplugged-803ee4c4-0603-4e7a-80e3-83bb2b41e3fd for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:55:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:06 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Instance destroyed successfully.
Aug 14 19:55:06 user nova-compute[72782]: DEBUG nova.objects.instance [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'resources' on Instance uuid afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:55:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1862824055',display_name='tempest-AttachVolumeNegativeTest-server-1862824055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1862824055',id=20,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGG1KUAEYko3X5nPJLENR0zSkHunj8YcsP1iOIy0vwlHsFikeQmZevxGlRZT/0vxMtlNeznB55Uf/dZu9yExs3S0modsxSE31TB7SkdEZbQuJj22T9qshXWLMFTu8ZKVbQ==',key_name='tempest-keypair-11616787',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:52:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2c26e0199de48ee8c48dde8177bc519',ramdisk_id='',reservation_id='r-20fpc77x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1229463629',owner_user_name='tempest-AttachVolumeNegativeTest-1229463629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0cada11ffdb4ebc8d9e80218818ec3b',uuid=afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "address": "fa:16:3e:7c:2a:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803ee4c4-06", "ovs_interfaceid": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:55:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converting VIF {"id": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "address": "fa:16:3e:7c:2a:61", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803ee4c4-06", "ovs_interfaceid": "803ee4c4-0603-4e7a-80e3-83bb2b41e3fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:55:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:2a:61,bridge_name='br-int',has_traffic_filtering=True,id=803ee4c4-0603-4e7a-80e3-83bb2b41e3fd,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803ee4c4-06') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:55:06 user nova-compute[72782]: DEBUG os_vif [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:2a:61,bridge_name='br-int',has_traffic_filtering=True,id=803ee4c4-0603-4e7a-80e3-83bb2b41e3fd,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803ee4c4-06') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:55:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap803ee4c4-06, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:55:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:55:06 user nova-compute[72782]: INFO os_vif [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:2a:61,bridge_name='br-int',has_traffic_filtering=True,id=803ee4c4-0603-4e7a-80e3-83bb2b41e3fd,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803ee4c4-06')
Aug 14 19:55:06 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Deleting instance files /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9_del
Aug 14 19:55:06 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Deletion of /opt/stack/data/nova/instances/afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9_del complete
Aug 14 19:55:06 user nova-compute[72782]: INFO nova.compute.manager [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 14 19:55:06 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:55:06 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:55:06 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:55:07 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042892.1224644, 4702362b-72ca-43b7-aed2-3545a5f13a98 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:55:07 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] VM Stopped (Lifecycle Event)
Aug 14 19:55:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b0052a86-3896-42ba-8ed0-a3bd798d93d5 None None] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:55:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-aafa0909-eea4-47cd-a6df-b33b0cc806b5 req-af66b75d-5755-4f9d-a449-af62125313b5 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Received event network-vif-plugged-803ee4c4-0603-4e7a-80e3-83bb2b41e3fd {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:55:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-aafa0909-eea4-47cd-a6df-b33b0cc806b5 req-af66b75d-5755-4f9d-a449-af62125313b5 service nova] Acquiring lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-aafa0909-eea4-47cd-a6df-b33b0cc806b5 req-af66b75d-5755-4f9d-a449-af62125313b5 service nova] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-aafa0909-eea4-47cd-a6df-b33b0cc806b5 req-af66b75d-5755-4f9d-a449-af62125313b5 service nova] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-aafa0909-eea4-47cd-a6df-b33b0cc806b5 req-af66b75d-5755-4f9d-a449-af62125313b5 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] No waiting events found dispatching network-vif-plugged-803ee4c4-0603-4e7a-80e3-83bb2b41e3fd {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:55:08 user nova-compute[72782]: WARNING nova.compute.manager [req-aafa0909-eea4-47cd-a6df-b33b0cc806b5 req-af66b75d-5755-4f9d-a449-af62125313b5 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Received unexpected event network-vif-plugged-803ee4c4-0603-4e7a-80e3-83bb2b41e3fd for instance with vm_state active and task_state deleting.
Aug 14 19:55:08 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:55:08 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Took 1.50 seconds to deallocate network for instance.
Aug 14 19:55:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-2dd43d5d-8778-4a18-a2d7-74969b99329c req-0d1ae029-d07b-4c4b-87c7-d7a63f940879 service nova] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Received event network-vif-deleted-803ee4c4-0603-4e7a-80e3-83bb2b41e3fd {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:55:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:08 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:55:08 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:55:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:08 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Deleted allocations for instance afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9
Aug 14 19:55:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6694eb30-9111-442d-a84c-f943154015b1 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.085s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-fd494320-d5c8-48a9-9e14-9b242893aa34 req-0b327367-aa13-4881-95be-8d1bd6f5068e service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received event volume-reimaged-b3f8e876-2e28-4709-b96b-c5f20ee56ab6 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fd494320-d5c8-48a9-9e14-9b242893aa34 req-0b327367-aa13-4881-95be-8d1bd6f5068e service nova] Acquiring lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fd494320-d5c8-48a9-9e14-9b242893aa34 req-0b327367-aa13-4881-95be-8d1bd6f5068e service nova] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fd494320-d5c8-48a9-9e14-9b242893aa34 req-0b327367-aa13-4881-95be-8d1bd6f5068e service nova] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-fd494320-d5c8-48a9-9e14-9b242893aa34 req-0b327367-aa13-4881-95be-8d1bd6f5068e service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Processing event volume-reimaged-b3f8e876-2e28-4709-b96b-c5f20ee56ab6 {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:55:13 user nova-compute[72782]: INFO nova.virt.block_device [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Booting with volume b3f8e876-2e28-4709-b96b-c5f20ee56ab6 at /dev/vda
Aug 14 19:55:13 user nova-compute[72782]: DEBUG os_brick.utils [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0103da2-bbc8-4cec-8fbb-44f8eb1b2d8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a230bc-ac19-47a2-bfc9-a1d474ff32c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdac2d7a-4c20-41a2-8ae6-b1fd83db9064]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdd9ea0-0825-4b74-9798-7c6f727c78fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:55:13 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:55:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a8f7bd-5d1e-4a24-9453-d6d3f2f9a326]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG os_brick.utils [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:55:13 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Updating existing volume attachment record: e69a262f-361e-4a98-9688-3403cb341054 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:55:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:21 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042906.6648083, afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:55:21 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] VM Stopped (Lifecycle Event)
Aug 14 19:55:21 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6cd0ea22-1a87-43bb-a80d-128377544e46 None None] [instance: afda0a8e-3c65-4ab9-911f-3ddf5ce1eda9] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:55:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:22 user nova-compute[72782]: INFO nova.compute.manager [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Terminating instance
Aug 14 19:55:22 user nova-compute[72782]: DEBUG nova.compute.manager [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:55:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:55:23 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Creating image(s)
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Did not create local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Ensure instance console log exists: /opt/stack/data/nova/instances/4702362b-72ca-43b7-aed2-3545a5f13a98/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Start _get_guest_xml network_info=[{"id": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "address": "fa:16:3e:ea:ce:52", "network": {"id": "400033aa-00fb-41ff-a23d-7deee12714e7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1338285309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2583e13fbf42a995ad5d30af0e1428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06846aaf-2a", "ovs_interfaceid": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'e69a262f-361e-4a98-9688-3403cb341054', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIqUZeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4702362b-72ca-43b7-aed2-3545a5f13a98', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3f8e876-2e28-4709-b96b-c5f20ee56ab6', 'serial': 'b3f8e876-2e28-4709-b96b-c5f20ee56ab6'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:55:23 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 19:55:23 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4702362b-72ca-43b7-aed2-3545a5f13a98 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIqUZeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:55:23 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:55:23 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:55:23 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a63efb5-02f7-429c-a99e-8d3ac920303b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:55:23 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47aa28a-8be5-406f-a8ab-066e14e18463]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6] added
Aug 14 19:55:23 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1a20dd-6068-4a86-8b31-d362525185d6]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-4d7ca79f-95be-4a67-bfb8-6e933437513e req-e4f6f072-8fcd-4c30-870c-b93c6bb24164 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Received event network-vif-unplugged-2dad6c60-4f31-4548-bfe7-31c85495c454 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4d7ca79f-95be-4a67-bfb8-6e933437513e req-e4f6f072-8fcd-4c30-870c-b93c6bb24164 service nova] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4d7ca79f-95be-4a67-bfb8-6e933437513e req-e4f6f072-8fcd-4c30-870c-b93c6bb24164 service nova] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4d7ca79f-95be-4a67-bfb8-6e933437513e req-e4f6f072-8fcd-4c30-870c-b93c6bb24164 service nova] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-4d7ca79f-95be-4a67-bfb8-6e933437513e req-e4f6f072-8fcd-4c30-870c-b93c6bb24164 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] No waiting events found dispatching network-vif-unplugged-2dad6c60-4f31-4548-bfe7-31c85495c454 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-4d7ca79f-95be-4a67-bfb8-6e933437513e req-e4f6f072-8fcd-4c30-870c-b93c6bb24164 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Received event network-vif-unplugged-2dad6c60-4f31-4548-bfe7-31c85495c454 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc2d8a6-8c08-49c2-8064-a5e1bd49d54d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YIqUZeQP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YIqUZeQP" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2b2d36-d810-4ef9-86e8-f57b24ff6c61]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YIqUZeQP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.122s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c2688c-bf17-42ac-8761-08ba99427fc8]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f824d4-feb4-4f11-ad53-fbdd84f6abdb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:55:23 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:55:23 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:55:23 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:55:23 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:55:23 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:55:23 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed32c4a3-2e95-4c80-a71a-6f6ed26a7536]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6, portal: 172.16.0.220,3260]
Aug 14 19:55:23 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6, portal: 172.16.0.220,3260] successful.
Aug 14 19:55:23 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8ef8c2-e12a-4610-a763-0a715a730f0f]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:23 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Instance destroyed successfully.
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.objects.instance [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lazy-loading 'resources' on Instance uuid 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9fde47-29b6-40a0-91ac-454a5de0831d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:55:23 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:55:23 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:55:23 user nova-compute[72782]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:55:23 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:55:23 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:55:23 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:55:23 user nova-compute[72782]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:55:23 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.414s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:46:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-719660631',display_name='tempest-SnapshotDataIntegrityTests-server-719660631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-719660631',id=10,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVG52vwPdA4Czn3J9NeyppiWVKqNRObR1xG0c6JuI0HYUCS0yQzgQzgKEePv8osGDNHleJ31NaUmxVuJTOlD0W5/3w+P50jXPGzy8QSkjaGfttIMIb2afTfOhnjc8tWJg==',key_name='tempest-keypair-11702859',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:47:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a1bf9f154f641798504207c6db32799',ramdisk_id='',reservation_id='r-5g3537t8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1958576853',owner_user_name='tempest-SnapshotDataIntegrityTests-1958576853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:47:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b27442ebb5704123ad7c8f0f78660176',uuid=28cfad06-8232-4d29-9d06-4bd0f2ac3e1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dad6c60-4f31-4548-bfe7-31c85495c454", "address": "fa:16:3e:57:2a:1c", "network": {"id": "16825893-d7a0-4b45-8921-c96e6333c811", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1870839756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1bf9f154f641798504207c6db32799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad6c60-4f", "ovs_interfaceid": "2dad6c60-4f31-4548-bfe7-31c85495c454", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Converting VIF {"id": "2dad6c60-4f31-4548-bfe7-31c85495c454", "address": "fa:16:3e:57:2a:1c", "network": {"id": "16825893-d7a0-4b45-8921-c96e6333c811", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1870839756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1bf9f154f641798504207c6db32799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad6c60-4f", "ovs_interfaceid": "2dad6c60-4f31-4548-bfe7-31c85495c454", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:2a:1c,bridge_name='br-int',has_traffic_filtering=True,id=2dad6c60-4f31-4548-bfe7-31c85495c454,network=Network(16825893-d7a0-4b45-8921-c96e6333c811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad6c60-4f') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_vif [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:2a:1c,bridge_name='br-int',has_traffic_filtering=True,id=2dad6c60-4f31-4548-bfe7-31c85495c454,network=Network(16825893-d7a0-4b45-8921-c96e6333c811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad6c60-4f') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dad6c60-4f, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:23 user nova-compute[72782]: INFO os_vif [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:2a:1c,bridge_name='br-int',has_traffic_filtering=True,id=2dad6c60-4f31-4548-bfe7-31c85495c454,network=Network(16825893-d7a0-4b45-8921-c96e6333c811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad6c60-4f')
Aug 14 19:55:23 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Deleting instance files /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f_del
Aug 14 19:55:23 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Deletion of /opt/stack/data/nova/instances/28cfad06-8232-4d29-9d06-4bd0f2ac3e1f_del complete
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b8ec5f-2caa-4b26-9f7e-b4d4e2994dc2]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIqUZeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:55:23 user nova-compute[72782]: INFO nova.compute.manager [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 14 19:55:23 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:55:23 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '23162646463623434', 'path': '/dev/sde'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162646463623434', 'path': '/dev/sde'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T19:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1210389445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-746603197',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOegGaETqx1Pztqu1P77PVxvX0dwSMalKmcPN2jtCEazOU38nLPC5/6W1Crj1WtV9Rzil7eKqqLrYgjHm4Eh8onwWMwLp8hfPbbHri4CF+U5X3sE+rRfhsJzXgWjRWix7g==',key_name='tempest-keypair-1783336846',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:53:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d2583e13fbf42a995ad5d30af0e1428',ramdisk_id='',reservation_id='r-ghzpchq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2138678264',owner_user_name='tempest-ServerActionsV293TestJSON-2138678264-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:55:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d2306e51414be6a895a1dc017c782f',uuid=4702362b-72ca-43b7-aed2-3545a5f13a98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "address": "fa:16:3e:ea:ce:52", "network": {"id": "400033aa-00fb-41ff-a23d-7deee12714e7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1338285309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2583e13fbf42a995ad5d30af0e1428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06846aaf-2a", "ovs_interfaceid": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Converting VIF {"id": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "address": "fa:16:3e:ea:ce:52", "network": {"id": "400033aa-00fb-41ff-a23d-7deee12714e7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1338285309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2583e13fbf42a995ad5d30af0e1428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06846aaf-2a", "ovs_interfaceid": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=06846aaf-2a0a-4e50-9b81-c4f15943cd28,network=Network(400033aa-00fb-41ff-a23d-7deee12714e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06846aaf-2a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:55:24 user nova-compute[72782]:   <uuid>4702362b-72ca-43b7-aed2-3545a5f13a98</uuid>
Aug 14 19:55:24 user nova-compute[72782]:   <name>instance-00000015</name>
Aug 14 19:55:24 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:55:24 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:55:24 user nova-compute[72782]:   <metadata>
Aug 14 19:55:24 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:55:24 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:55:24 user nova-compute[72782]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1210389445</nova:name>
Aug 14 19:55:24 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:55:23</nova:creationTime>
Aug 14 19:55:24 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:55:24 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:55:24 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:55:24 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:55:24 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:55:24 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:55:24 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:55:24 user nova-compute[72782]:       <nova:owner>
Aug 14 19:55:24 user nova-compute[72782]:         <nova:user uuid="31d2306e51414be6a895a1dc017c782f">tempest-ServerActionsV293TestJSON-2138678264-project-member</nova:user>
Aug 14 19:55:24 user nova-compute[72782]:         <nova:project uuid="3d2583e13fbf42a995ad5d30af0e1428">tempest-ServerActionsV293TestJSON-2138678264</nova:project>
Aug 14 19:55:24 user nova-compute[72782]:       </nova:owner>
Aug 14 19:55:24 user nova-compute[72782]:       <nova:ports>
Aug 14 19:55:24 user nova-compute[72782]:         <nova:port uuid="06846aaf-2a0a-4e50-9b81-c4f15943cd28">
Aug 14 19:55:24 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 19:55:24 user nova-compute[72782]:         </nova:port>
Aug 14 19:55:24 user nova-compute[72782]:       </nova:ports>
Aug 14 19:55:24 user nova-compute[72782]:     </nova:instance>
Aug 14 19:55:24 user nova-compute[72782]:   </metadata>
Aug 14 19:55:24 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:55:24 user nova-compute[72782]:     <system>
Aug 14 19:55:24 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:55:24 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:55:24 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:55:24 user nova-compute[72782]:       <entry name="serial">4702362b-72ca-43b7-aed2-3545a5f13a98</entry>
Aug 14 19:55:24 user nova-compute[72782]:       <entry name="uuid">4702362b-72ca-43b7-aed2-3545a5f13a98</entry>
Aug 14 19:55:24 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:55:24 user nova-compute[72782]:     </system>
Aug 14 19:55:24 user nova-compute[72782]:   </sysinfo>
Aug 14 19:55:24 user nova-compute[72782]:   <os>
Aug 14 19:55:24 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:55:24 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:55:24 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:55:24 user nova-compute[72782]:   </os>
Aug 14 19:55:24 user nova-compute[72782]:   <features>
Aug 14 19:55:24 user nova-compute[72782]:     <acpi/>
Aug 14 19:55:24 user nova-compute[72782]:     <apic/>
Aug 14 19:55:24 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:55:24 user nova-compute[72782]:   </features>
Aug 14 19:55:24 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:55:24 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:55:24 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:55:24 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:55:24 user nova-compute[72782]:   </clock>
Aug 14 19:55:24 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:55:24 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:55:24 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:55:24 user nova-compute[72782]:   </cpu>
Aug 14 19:55:24 user nova-compute[72782]:   <devices>
Aug 14 19:55:24 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 19:55:24 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:55:24 user nova-compute[72782]:       <source dev="/dev/sde"/>
Aug 14 19:55:24 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:55:24 user nova-compute[72782]:       <serial>b3f8e876-2e28-4709-b96b-c5f20ee56ab6</serial>
Aug 14 19:55:24 user nova-compute[72782]:     </disk>
Aug 14 19:55:24 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:55:24 user nova-compute[72782]:       <mac address="fa:16:3e:ea:ce:52"/>
Aug 14 19:55:24 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:55:24 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:55:24 user nova-compute[72782]:       <target dev="tap06846aaf-2a"/>
Aug 14 19:55:24 user nova-compute[72782]:     </interface>
Aug 14 19:55:24 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:55:24 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/4702362b-72ca-43b7-aed2-3545a5f13a98/console.log" append="off"/>
Aug 14 19:55:24 user nova-compute[72782]:     </serial>
Aug 14 19:55:24 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:55:24 user nova-compute[72782]:     <video>
Aug 14 19:55:24 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:55:24 user nova-compute[72782]:     </video>
Aug 14 19:55:24 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:55:24 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:55:24 user nova-compute[72782]:     </rng>
Aug 14 19:55:24 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:55:24 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:55:24 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:55:24 user nova-compute[72782]:     </memballoon>
Aug 14 19:55:24 user nova-compute[72782]:   </devices>
Aug 14 19:55:24 user nova-compute[72782]: </domain>
Aug 14 19:55:24 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T19:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1210389445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-746603197',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOegGaETqx1Pztqu1P77PVxvX0dwSMalKmcPN2jtCEazOU38nLPC5/6W1Crj1WtV9Rzil7eKqqLrYgjHm4Eh8onwWMwLp8hfPbbHri4CF+U5X3sE+rRfhsJzXgWjRWix7g==',key_name='tempest-keypair-1783336846',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:53:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d2583e13fbf42a995ad5d30af0e1428',ramdisk_id='',reservation_id='r-ghzpchq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2138678264',owner_user_name='tempest-ServerActionsV293TestJSON-2138678264-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:55:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d2306e51414be6a895a1dc017c782f',uuid=4702362b-72ca-43b7-aed2-3545a5f13a98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "address": "fa:16:3e:ea:ce:52", "network": {"id": "400033aa-00fb-41ff-a23d-7deee12714e7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1338285309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2583e13fbf42a995ad5d30af0e1428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06846aaf-2a", "ovs_interfaceid": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Converting VIF {"id": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "address": "fa:16:3e:ea:ce:52", "network": {"id": "400033aa-00fb-41ff-a23d-7deee12714e7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1338285309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2583e13fbf42a995ad5d30af0e1428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06846aaf-2a", "ovs_interfaceid": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=06846aaf-2a0a-4e50-9b81-c4f15943cd28,network=Network(400033aa-00fb-41ff-a23d-7deee12714e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06846aaf-2a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG os_vif [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=06846aaf-2a0a-4e50-9b81-c4f15943cd28,network=Network(400033aa-00fb-41ff-a23d-7deee12714e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06846aaf-2a') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06846aaf-2a, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06846aaf-2a, col_values=(('external_ids', {'iface-id': '06846aaf-2a0a-4e50-9b81-c4f15943cd28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:ce:52', 'vm-uuid': '4702362b-72ca-43b7-aed2-3545a5f13a98'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:24 user nova-compute[72782]: INFO os_vif [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=06846aaf-2a0a-4e50-9b81-c4f15943cd28,network=Network(400033aa-00fb-41ff-a23d-7deee12714e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06846aaf-2a')
Aug 14 19:55:24 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Took 1.00 seconds to deallocate network for instance.
Aug 14 19:55:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:55:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] No VIF found with MAC fa:16:3e:ea:ce:52, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:55:25 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:55:25 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:55:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:25 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Deleted allocations for instance 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f
Aug 14 19:55:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d95beea5-08b7-42f5-b0e0-5056579f2408 tempest-SnapshotDataIntegrityTests-1958576853 tempest-SnapshotDataIntegrityTests-1958576853-project-member] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.361s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-74c3cd98-7876-4f2b-8ccb-235c56d56e62 req-708214e7-62fa-4aba-a95d-0b2ec3b65b01 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Received event network-vif-plugged-2dad6c60-4f31-4548-bfe7-31c85495c454 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:55:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-74c3cd98-7876-4f2b-8ccb-235c56d56e62 req-708214e7-62fa-4aba-a95d-0b2ec3b65b01 service nova] Acquiring lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-74c3cd98-7876-4f2b-8ccb-235c56d56e62 req-708214e7-62fa-4aba-a95d-0b2ec3b65b01 service nova] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-74c3cd98-7876-4f2b-8ccb-235c56d56e62 req-708214e7-62fa-4aba-a95d-0b2ec3b65b01 service nova] Lock "28cfad06-8232-4d29-9d06-4bd0f2ac3e1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-74c3cd98-7876-4f2b-8ccb-235c56d56e62 req-708214e7-62fa-4aba-a95d-0b2ec3b65b01 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] No waiting events found dispatching network-vif-plugged-2dad6c60-4f31-4548-bfe7-31c85495c454 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:55:25 user nova-compute[72782]: WARNING nova.compute.manager [req-74c3cd98-7876-4f2b-8ccb-235c56d56e62 req-708214e7-62fa-4aba-a95d-0b2ec3b65b01 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Received unexpected event network-vif-plugged-2dad6c60-4f31-4548-bfe7-31c85495c454 for instance with vm_state deleted and task_state None.
Aug 14 19:55:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-74c3cd98-7876-4f2b-8ccb-235c56d56e62 req-708214e7-62fa-4aba-a95d-0b2ec3b65b01 service nova] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Received event network-vif-deleted-2dad6c60-4f31-4548-bfe7-31c85495c454 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:55:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-d2959198-b185-4c2e-8707-13a3923f4efd req-7f8e29be-9cc2-40fb-9a70-1a074cde40fa service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received event network-vif-plugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:55:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d2959198-b185-4c2e-8707-13a3923f4efd req-7f8e29be-9cc2-40fb-9a70-1a074cde40fa service nova] Acquiring lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d2959198-b185-4c2e-8707-13a3923f4efd req-7f8e29be-9cc2-40fb-9a70-1a074cde40fa service nova] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d2959198-b185-4c2e-8707-13a3923f4efd req-7f8e29be-9cc2-40fb-9a70-1a074cde40fa service nova] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-d2959198-b185-4c2e-8707-13a3923f4efd req-7f8e29be-9cc2-40fb-9a70-1a074cde40fa service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] No waiting events found dispatching network-vif-plugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:55:27 user nova-compute[72782]: WARNING nova.compute.manager [req-d2959198-b185-4c2e-8707-13a3923f4efd req-7f8e29be-9cc2-40fb-9a70-1a074cde40fa service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received unexpected event network-vif-plugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 for instance with vm_state active and task_state rebuild_spawning.
Aug 14 19:55:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-d2959198-b185-4c2e-8707-13a3923f4efd req-7f8e29be-9cc2-40fb-9a70-1a074cde40fa service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received event network-vif-plugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:55:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d2959198-b185-4c2e-8707-13a3923f4efd req-7f8e29be-9cc2-40fb-9a70-1a074cde40fa service nova] Acquiring lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d2959198-b185-4c2e-8707-13a3923f4efd req-7f8e29be-9cc2-40fb-9a70-1a074cde40fa service nova] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d2959198-b185-4c2e-8707-13a3923f4efd req-7f8e29be-9cc2-40fb-9a70-1a074cde40fa service nova] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-d2959198-b185-4c2e-8707-13a3923f4efd req-7f8e29be-9cc2-40fb-9a70-1a074cde40fa service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] No waiting events found dispatching network-vif-plugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:55:27 user nova-compute[72782]: WARNING nova.compute.manager [req-d2959198-b185-4c2e-8707-13a3923f4efd req-7f8e29be-9cc2-40fb-9a70-1a074cde40fa service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received unexpected event network-vif-plugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 for instance with vm_state active and task_state rebuild_spawning.
Aug 14 19:55:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:28 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042928.070737, 4702362b-72ca-43b7-aed2-3545a5f13a98 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:55:28 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] VM Resumed (Lifecycle Event)
Aug 14 19:55:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:55:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:55:28 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Instance spawned successfully.
Aug 14 19:55:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:55:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:55:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:55:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:55:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:55:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:55:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:55:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:55:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:55:28 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 19:55:28 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042928.0727718, 4702362b-72ca-43b7-aed2-3545a5f13a98 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:55:28 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] VM Started (Lifecycle Event)
Aug 14 19:55:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:55:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:55:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:55:28 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 19:55:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:28 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72782) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 19:55:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fd494320-d5c8-48a9-9e14-9b242893aa34 tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.070s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:38 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042923.610395, 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:55:38 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] VM Stopped (Lifecycle Event)
Aug 14 19:55:38 user nova-compute[72782]: DEBUG nova.compute.manager [None req-312928ba-9204-4536-bb73-3049e7acd634 None None] [instance: 28cfad06-8232-4d29-9d06-4bd0f2ac3e1f] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:55:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:55:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:55:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:55:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:55:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:55:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:50 user nova-compute[72782]: DEBUG nova.compute.manager [req-0d677400-aab3-4362-af34-a09b5b32395f req-ebd6e2f3-f171-47b1-ae13-62cde69fa1a8 service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Received event network-changed-06f53b30-4cdd-4b86-a06d-2734de26fb74 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:55:50 user nova-compute[72782]: DEBUG nova.compute.manager [req-0d677400-aab3-4362-af34-a09b5b32395f req-ebd6e2f3-f171-47b1-ae13-62cde69fa1a8 service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Refreshing instance network info cache due to event network-changed-06f53b30-4cdd-4b86-a06d-2734de26fb74. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:55:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0d677400-aab3-4362-af34-a09b5b32395f req-ebd6e2f3-f171-47b1-ae13-62cde69fa1a8 service nova] Acquiring lock "refresh_cache-a4ae2e60-c4d4-4a7e-826e-fb315fa98138" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:55:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0d677400-aab3-4362-af34-a09b5b32395f req-ebd6e2f3-f171-47b1-ae13-62cde69fa1a8 service nova] Acquired lock "refresh_cache-a4ae2e60-c4d4-4a7e-826e-fb315fa98138" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:55:50 user nova-compute[72782]: DEBUG nova.network.neutron [req-0d677400-aab3-4362-af34-a09b5b32395f req-ebd6e2f3-f171-47b1-ae13-62cde69fa1a8 service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Refreshing network info cache for port 06f53b30-4cdd-4b86-a06d-2734de26fb74 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG nova.network.neutron [req-0d677400-aab3-4362-af34-a09b5b32395f req-ebd6e2f3-f171-47b1-ae13-62cde69fa1a8 service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Updated VIF entry in instance network info cache for port 06f53b30-4cdd-4b86-a06d-2734de26fb74. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG nova.network.neutron [req-0d677400-aab3-4362-af34-a09b5b32395f req-ebd6e2f3-f171-47b1-ae13-62cde69fa1a8 service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Updating instance_info_cache with network_info: [{"id": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "address": "fa:16:3e:2d:5e:cf", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f53b30-4c", "ovs_interfaceid": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lazy-loading 'flavor' on Instance uuid a4ae2e60-c4d4-4a7e-826e-fb315fa98138 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0d677400-aab3-4362-af34-a09b5b32395f req-ebd6e2f3-f171-47b1-ae13-62cde69fa1a8 service nova] Releasing lock "refresh_cache-a4ae2e60-c4d4-4a7e-826e-fb315fa98138" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:51 user nova-compute[72782]: INFO nova.compute.manager [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Attaching volume 4e55f4b6-384c-4013-b6a2-b6512ffc5519 to /dev/vdb
Aug 14 19:55:51 user nova-compute[72782]: DEBUG os_brick.utils [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fade16-5e88-47e5-85a1-8e173e5346dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3012e18d-b175-4a91-96f6-9b4221f947ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64c17b8-cd05-4a26-86b8-23f75043224a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e74f657-3bc4-4a8a-b5ff-4ae5459dbabc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:55:51 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:55:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed32b21-bb45-4830-997d-718f94250077]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG os_brick.utils [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:55:51 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Updating existing volume attachment record: 6d2a521f-f459-409d-98ad-dc8bdd545041 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:55:52 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:55:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:54 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:55:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:55:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:55:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:55:54 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:55:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:54 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Updating instance_info_cache with network_info: [{"id": "35b9955c-a82a-42b9-a936-5f3429cda375", "address": "fa:16:3e:36:7a:36", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b9955c-a8", "ovs_interfaceid": "35b9955c-a82a-42b9-a936-5f3429cda375", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:55:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:55:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:55:56 user nova-compute[72782]: INFO nova.compute.manager [None req-4c21de9c-07ca-490c-80fd-9c54721e985c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Unrescuing
Aug 14 19:55:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4c21de9c-07ca-490c-80fd-9c54721e985c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:55:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4c21de9c-07ca-490c-80fd-9c54721e985c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquired lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:55:56 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4c21de9c-07ca-490c-80fd-9c54721e985c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:55:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4c21de9c-07ca-490c-80fd-9c54721e985c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Updating instance_info_cache with network_info: [{"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4c21de9c-07ca-490c-80fd-9c54721e985c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Releasing lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4c21de9c-07ca-490c-80fd-9c54721e985c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lazy-loading 'flavor' on Instance uuid 792f31f1-4079-4443-81f2-b1e364a9ee14 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-6e7a1f67-4904-48f9-9562-ac534c4e2f6d req-43233c30-3411-4839-aca7-3a2abe38f14b service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received event network-vif-unplugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6e7a1f67-4904-48f9-9562-ac534c4e2f6d req-43233c30-3411-4839-aca7-3a2abe38f14b service nova] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6e7a1f67-4904-48f9-9562-ac534c4e2f6d req-43233c30-3411-4839-aca7-3a2abe38f14b service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6e7a1f67-4904-48f9-9562-ac534c4e2f6d req-43233c30-3411-4839-aca7-3a2abe38f14b service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-6e7a1f67-4904-48f9-9562-ac534c4e2f6d req-43233c30-3411-4839-aca7-3a2abe38f14b service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] No waiting events found dispatching network-vif-unplugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:55:57 user nova-compute[72782]: WARNING nova.compute.manager [req-6e7a1f67-4904-48f9-9562-ac534c4e2f6d req-43233c30-3411-4839-aca7-3a2abe38f14b service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received unexpected event network-vif-unplugged-5fae61f6-03b8-4f93-8719-be8733d8590c for instance with vm_state rescued and task_state unrescuing.
Aug 14 19:55:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:58 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Instance destroyed successfully.
Aug 14 19:55:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:58 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:55:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:58 user nova-compute[72782]: DEBUG nova.compute.manager [req-c7a29de8-851b-40ab-8484-13ba85490177 req-3ac24faf-e3c7-4358-b759-553790ee744a service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received event network-changed-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:55:58 user nova-compute[72782]: DEBUG nova.compute.manager [req-c7a29de8-851b-40ab-8484-13ba85490177 req-3ac24faf-e3c7-4358-b759-553790ee744a service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Refreshing instance network info cache due to event network-changed-5fae61f6-03b8-4f93-8719-be8733d8590c. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:55:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c7a29de8-851b-40ab-8484-13ba85490177 req-3ac24faf-e3c7-4358-b759-553790ee744a service nova] Acquiring lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:55:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c7a29de8-851b-40ab-8484-13ba85490177 req-3ac24faf-e3c7-4358-b759-553790ee744a service nova] Acquired lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:55:58 user nova-compute[72782]: DEBUG nova.network.neutron [req-c7a29de8-851b-40ab-8484-13ba85490177 req-3ac24faf-e3c7-4358-b759-553790ee744a service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Refreshing network info cache for port 5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:55:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:58 user nova-compute[72782]: DEBUG nova.network.neutron [req-c7a29de8-851b-40ab-8484-13ba85490177 req-3ac24faf-e3c7-4358-b759-553790ee744a service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Updated VIF entry in instance network info cache for port 5fae61f6-03b8-4f93-8719-be8733d8590c. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:55:58 user nova-compute[72782]: DEBUG nova.network.neutron [req-c7a29de8-851b-40ab-8484-13ba85490177 req-3ac24faf-e3c7-4358-b759-553790ee744a service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Updating instance_info_cache with network_info: [{"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:55:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c7a29de8-851b-40ab-8484-13ba85490177 req-3ac24faf-e3c7-4358-b759-553790ee744a service nova] Releasing lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:55:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:55:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:55:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:55:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-56130024-2cff-4601-9c18-9e4bf983e692 req-d779bb0b-a199-417e-af52-0d22c18367d6 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received event network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-56130024-2cff-4601-9c18-9e4bf983e692 req-d779bb0b-a199-417e-af52-0d22c18367d6 service nova] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-56130024-2cff-4601-9c18-9e4bf983e692 req-d779bb0b-a199-417e-af52-0d22c18367d6 service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-56130024-2cff-4601-9c18-9e4bf983e692 req-d779bb0b-a199-417e-af52-0d22c18367d6 service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-56130024-2cff-4601-9c18-9e4bf983e692 req-d779bb0b-a199-417e-af52-0d22c18367d6 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] No waiting events found dispatching network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:56:00 user nova-compute[72782]: WARNING nova.compute.manager [req-56130024-2cff-4601-9c18-9e4bf983e692 req-d779bb0b-a199-417e-af52-0d22c18367d6 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received unexpected event network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c for instance with vm_state rescued and task_state unrescuing.
Aug 14 19:56:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-a0ea3a9d-1dc2-4982-9153-3eb3a45ac31b req-f796843e-fe37-4f78-a0bd-9dc01c272543 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received event network-changed-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-a0ea3a9d-1dc2-4982-9153-3eb3a45ac31b req-f796843e-fe37-4f78-a0bd-9dc01c272543 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Refreshing instance network info cache due to event network-changed-5fae61f6-03b8-4f93-8719-be8733d8590c. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a0ea3a9d-1dc2-4982-9153-3eb3a45ac31b req-f796843e-fe37-4f78-a0bd-9dc01c272543 service nova] Acquiring lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a0ea3a9d-1dc2-4982-9153-3eb3a45ac31b req-f796843e-fe37-4f78-a0bd-9dc01c272543 service nova] Acquired lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG nova.network.neutron [req-a0ea3a9d-1dc2-4982-9153-3eb3a45ac31b req-f796843e-fe37-4f78-a0bd-9dc01c272543 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Refreshing network info cache for port 5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG nova.network.neutron [req-a0ea3a9d-1dc2-4982-9153-3eb3a45ac31b req-f796843e-fe37-4f78-a0bd-9dc01c272543 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Updated VIF entry in instance network info cache for port 5fae61f6-03b8-4f93-8719-be8733d8590c. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG nova.network.neutron [req-a0ea3a9d-1dc2-4982-9153-3eb3a45ac31b req-f796843e-fe37-4f78-a0bd-9dc01c272543 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Updating instance_info_cache with network_info: [{"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a0ea3a9d-1dc2-4982-9153-3eb3a45ac31b req-f796843e-fe37-4f78-a0bd-9dc01c272543 service nova] Releasing lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4c21de9c-07ca-490c-80fd-9c54721e985c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Removed pending event for 792f31f1-4079-4443-81f2-b1e364a9ee14 due to event {{(pid=72782) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042961.583704, 792f31f1-4079-4443-81f2-b1e364a9ee14 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:56:01 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] VM Resumed (Lifecycle Event)
Aug 14 19:56:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "f057c9c2-9c75-4c4b-8f95-444f135e4056" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXkYdLnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:56:01 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:56:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:56:01 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:56:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:56:01 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:56:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:01 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:56:01 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:56:01 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7345MB free_disk=25.442420959472656GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1ee30a-9291-4e51-8af2-0c2b98230e2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:56:01 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8240732b-86a0-4540-8d4d-3b571baff9a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519] added
Aug 14 19:56:01 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc69b9c-6423-41fb-a123-8afbbf5dcd4c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:02 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042961.5856695, 792f31f1-4079-4443-81f2-b1e364a9ee14 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:56:02 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] VM Started (Lifecycle Event)
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b77dd8f-b4be-44a4-aa9c-ca666a6dffbd]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WXkYdLnU {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Applying migration context for instance c748103b-a37c-47c5-8394-ea54749f27eb as it has an incoming, in-progress migration 6ef954c9-8e6c-4b42-8034-637eb5d1ef0b. Migration status is finished {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 19:56:02 user nova-compute[72782]: INFO nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Updating resource usage from migration 6ef954c9-8e6c-4b42-8034-637eb5d1ef0b
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WXkYdLnU" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4f5a59-6107-4121-8ff2-a90a3c69b86c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WXkYdLnU'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e2c523-1ce9-478c-9ffd-358f1c79ff08]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-310c19c8-bbc8-46b3-b954-f6939664e3eb req-0db6d627-46e9-4e78-9417-5db72df426e7 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received event network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-310c19c8-bbc8-46b3-b954-f6939664e3eb req-0db6d627-46e9-4e78-9417-5db72df426e7 service nova] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-310c19c8-bbc8-46b3-b954-f6939664e3eb req-0db6d627-46e9-4e78-9417-5db72df426e7 service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-310c19c8-bbc8-46b3-b954-f6939664e3eb req-0db6d627-46e9-4e78-9417-5db72df426e7 service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-310c19c8-bbc8-46b3-b954-f6939664e3eb req-0db6d627-46e9-4e78-9417-5db72df426e7 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] No waiting events found dispatching network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:56:02 user nova-compute[72782]: WARNING nova.compute.manager [req-310c19c8-bbc8-46b3-b954-f6939664e3eb req-0db6d627-46e9-4e78-9417-5db72df426e7 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received unexpected event network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c for instance with vm_state active and task_state None.
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-310c19c8-bbc8-46b3-b954-f6939664e3eb req-0db6d627-46e9-4e78-9417-5db72df426e7 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received event network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-310c19c8-bbc8-46b3-b954-f6939664e3eb req-0db6d627-46e9-4e78-9417-5db72df426e7 service nova] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-310c19c8-bbc8-46b3-b954-f6939664e3eb req-0db6d627-46e9-4e78-9417-5db72df426e7 service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-310c19c8-bbc8-46b3-b954-f6939664e3eb req-0db6d627-46e9-4e78-9417-5db72df426e7 service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-310c19c8-bbc8-46b3-b954-f6939664e3eb req-0db6d627-46e9-4e78-9417-5db72df426e7 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] No waiting events found dispatching network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:56:02 user nova-compute[72782]: WARNING nova.compute.manager [req-310c19c8-bbc8-46b3-b954-f6939664e3eb req-0db6d627-46e9-4e78-9417-5db72df426e7 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received unexpected event network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c for instance with vm_state active and task_state None.
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f965ba-c882-4f4c-99b7-c5ac1bd089e6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0960c4-7d5e-41a2-ba1d-937e3dcd9f20 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7f7577-6a97-4a80-b5cc-91d1f1e65a37 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0960c4-7d5e-41a2-ba1d-937e3dcd9f20 (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7f7577-6a97-4a80-b5cc-91d1f1e65a37 (non-flash)
Aug 14 19:56:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0960c4-7d5e-41a2-ba1d-937e3dcd9f20 (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7f7577-6a97-4a80-b5cc-91d1f1e65a37 (non-flash)
Aug 14 19:56:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 792f31f1-4079-4443-81f2-b1e364a9ee14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance d0ffe207-a89e-41ef-85af-7927ce06627e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance e1052af2-5cc1-4d38-9467-032128545267 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 4702362b-72ca-43b7-aed2-3545a5f13a98 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance a4ae2e60-c4d4-4a7e-826e-fb315fa98138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Migration 6ef954c9-8e6c-4b42-8034-637eb5d1ef0b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance c748103b-a37c-47c5-8394-ea54749f27eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance f057c9c2-9c75-4c4b-8f95-444f135e4056 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing inventories for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda56791-d38f-4d21-a0db-66b67b92ea1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519, portal: 172.16.0.220,3260]
Aug 14 19:56:02 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519, portal: 172.16.0.220,3260] successful.
Aug 14 19:56:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating ProviderTree inventory for provider d26c9e3b-40e6-476e-9664-3119ebf5873b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b11cfa2-f92c-4f06-a472-d6d90f0ef3db]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing aggregate associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, aggregates: None {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[926c2ce5-5ca1-427b-9a79-3e42a03bb459]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0960c4-7d5e-41a2-ba1d-937e3dcd9f20 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7f7577-6a97-4a80-b5cc-91d1f1e65a37 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0960c4-7d5e-41a2-ba1d-937e3dcd9f20 (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7f7577-6a97-4a80-b5cc-91d1f1e65a37 (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 (non-flash)
Aug 14 19:56:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0960c4-7d5e-41a2-ba1d-937e3dcd9f20 (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7f7577-6a97-4a80-b5cc-91d1f1e65a37 (non-flash)
Aug 14 19:56:02 user nova-compute[72782]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 (non-flash)
Aug 14 19:56:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] HCTL ('39', '-', '-', 0) found on session 35 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing trait associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cae8688-40b1-4e0c-b172-38c3eeb21d49]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Searching for a device in session 35 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXkYdLnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.732s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.542s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:56:02 user nova-compute[72782]: INFO nova.compute.claims [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Claim successful on node user
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] There are 0 instances to clean {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72782) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 19:56:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG nova.compute.manager [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG nova.compute.manager [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:56:03 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:56:03 user nova-compute[72782]: DEBUG nova.compute.manager [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG nova.policy [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0cada11ffdb4ebc8d9e80218818ec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c26e0199de48ee8c48dde8177bc519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '26532646266356234', 'path': '/dev/sdh'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532646266356234', 'path': '/dev/sdh'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG nova.objects.instance [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lazy-loading 'flavor' on Instance uuid a4ae2e60-c4d4-4a7e-826e-fb315fa98138 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:56:03 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:56:03 user nova-compute[72782]:   <source dev="/dev/sdh"/>
Aug 14 19:56:03 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:56:03 user nova-compute[72782]:   <serial>4e55f4b6-384c-4013-b6a2-b6512ffc5519</serial>
Aug 14 19:56:03 user nova-compute[72782]: </disk>
Aug 14 19:56:03 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG nova.compute.manager [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:56:03 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Creating image(s)
Aug 14 19:56:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "/opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "/opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "/opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.193s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/disk 1073741824" returned: 0 in 0.058s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:56:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] No VIF found with MAC fa:16:3e:2d:5e:cf, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:56:04 user nova-compute[72782]: DEBUG nova.network.neutron [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Successfully created port: 4a2c9016-fb98-43d4-8d02-ccc26f4698bb {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:56:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.202s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:04 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:56:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3a3bd7af-907f-49df-889a-dbd9f118ad8d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.524s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:04 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Cannot resize image /opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:56:04 user nova-compute[72782]: DEBUG nova.objects.instance [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'migration_context' on Instance uuid f057c9c2-9c75-4c4b-8f95-444f135e4056 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:56:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:56:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Ensure instance console log exists: /opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:56:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:05 user nova-compute[72782]: DEBUG nova.network.neutron [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Successfully updated port: 4a2c9016-fb98-43d4-8d02-ccc26f4698bb {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:56:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "refresh_cache-f057c9c2-9c75-4c4b-8f95-444f135e4056" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:56:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquired lock "refresh_cache-f057c9c2-9c75-4c4b-8f95-444f135e4056" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:56:05 user nova-compute[72782]: DEBUG nova.network.neutron [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:56:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-e5462eb1-d2a0-45ba-b4fe-ecf9003f9c34 req-9e7c3385-4203-4c98-9c18-32cd3c0830f6 service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Received event network-changed-4a2c9016-fb98-43d4-8d02-ccc26f4698bb {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:56:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-e5462eb1-d2a0-45ba-b4fe-ecf9003f9c34 req-9e7c3385-4203-4c98-9c18-32cd3c0830f6 service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Refreshing instance network info cache due to event network-changed-4a2c9016-fb98-43d4-8d02-ccc26f4698bb. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:56:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e5462eb1-d2a0-45ba-b4fe-ecf9003f9c34 req-9e7c3385-4203-4c98-9c18-32cd3c0830f6 service nova] Acquiring lock "refresh_cache-f057c9c2-9c75-4c4b-8f95-444f135e4056" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:56:05 user nova-compute[72782]: DEBUG nova.network.neutron [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.network.neutron [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Updating instance_info_cache with network_info: [{"id": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "address": "fa:16:3e:43:c6:df", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c9016-fb", "ovs_interfaceid": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Releasing lock "refresh_cache-f057c9c2-9c75-4c4b-8f95-444f135e4056" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Instance network_info: |[{"id": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "address": "fa:16:3e:43:c6:df", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c9016-fb", "ovs_interfaceid": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e5462eb1-d2a0-45ba-b4fe-ecf9003f9c34 req-9e7c3385-4203-4c98-9c18-32cd3c0830f6 service nova] Acquired lock "refresh_cache-f057c9c2-9c75-4c4b-8f95-444f135e4056" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.network.neutron [req-e5462eb1-d2a0-45ba-b4fe-ecf9003f9c34 req-9e7c3385-4203-4c98-9c18-32cd3c0830f6 service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Refreshing network info cache for port 4a2c9016-fb98-43d4-8d02-ccc26f4698bb {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Start _get_guest_xml network_info=[{"id": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "address": "fa:16:3e:43:c6:df", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c9016-fb", "ovs_interfaceid": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:56:06 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:56:06 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-516756219',display_name='tempest-AttachVolumeNegativeTest-server-516756219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-516756219',id=25,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPL93JDJNiwO4gbzcF47ql19bRsBAdBx6MvY/SUJw3D7FAqil4AexoHt74dlw+j7BCQeEDhJCtbE7GB/Ntaa2Gq8osw6GzLVJHiKhTJTpw7ir0XfejLXL48P9ELNukAtQ==',key_name='tempest-keypair-41767071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2c26e0199de48ee8c48dde8177bc519',ramdisk_id='',reservation_id='r-umfo4qep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1229463629',owner_user_name='tempest-AttachVolumeNegativeTest-1229463629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:56:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0cada11ffdb4ebc8d9e80218818ec3b',uuid=f057c9c2-9c75-4c4b-8f95-444f135e4056,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "address": "fa:16:3e:43:c6:df", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c9016-fb", "ovs_interfaceid": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converting VIF {"id": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "address": "fa:16:3e:43:c6:df", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c9016-fb", "ovs_interfaceid": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:c6:df,bridge_name='br-int',has_traffic_filtering=True,id=4a2c9016-fb98-43d4-8d02-ccc26f4698bb,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2c9016-fb') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.objects.instance [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'pci_devices' on Instance uuid f057c9c2-9c75-4c4b-8f95-444f135e4056 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:56:06 user nova-compute[72782]:   <uuid>f057c9c2-9c75-4c4b-8f95-444f135e4056</uuid>
Aug 14 19:56:06 user nova-compute[72782]:   <name>instance-00000019</name>
Aug 14 19:56:06 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:56:06 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:56:06 user nova-compute[72782]:   <metadata>
Aug 14 19:56:06 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:56:06 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:56:06 user nova-compute[72782]:       <nova:name>tempest-AttachVolumeNegativeTest-server-516756219</nova:name>
Aug 14 19:56:06 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:56:06</nova:creationTime>
Aug 14 19:56:06 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:56:06 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:56:06 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:56:06 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:56:06 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:56:06 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:56:06 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:56:06 user nova-compute[72782]:       <nova:owner>
Aug 14 19:56:06 user nova-compute[72782]:         <nova:user uuid="b0cada11ffdb4ebc8d9e80218818ec3b">tempest-AttachVolumeNegativeTest-1229463629-project-member</nova:user>
Aug 14 19:56:06 user nova-compute[72782]:         <nova:project uuid="f2c26e0199de48ee8c48dde8177bc519">tempest-AttachVolumeNegativeTest-1229463629</nova:project>
Aug 14 19:56:06 user nova-compute[72782]:       </nova:owner>
Aug 14 19:56:06 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:56:06 user nova-compute[72782]:       <nova:ports>
Aug 14 19:56:06 user nova-compute[72782]:         <nova:port uuid="4a2c9016-fb98-43d4-8d02-ccc26f4698bb">
Aug 14 19:56:06 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 19:56:06 user nova-compute[72782]:         </nova:port>
Aug 14 19:56:06 user nova-compute[72782]:       </nova:ports>
Aug 14 19:56:06 user nova-compute[72782]:     </nova:instance>
Aug 14 19:56:06 user nova-compute[72782]:   </metadata>
Aug 14 19:56:06 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:56:06 user nova-compute[72782]:     <system>
Aug 14 19:56:06 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:56:06 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:56:06 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:56:06 user nova-compute[72782]:       <entry name="serial">f057c9c2-9c75-4c4b-8f95-444f135e4056</entry>
Aug 14 19:56:06 user nova-compute[72782]:       <entry name="uuid">f057c9c2-9c75-4c4b-8f95-444f135e4056</entry>
Aug 14 19:56:06 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:56:06 user nova-compute[72782]:     </system>
Aug 14 19:56:06 user nova-compute[72782]:   </sysinfo>
Aug 14 19:56:06 user nova-compute[72782]:   <os>
Aug 14 19:56:06 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:56:06 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:56:06 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:56:06 user nova-compute[72782]:   </os>
Aug 14 19:56:06 user nova-compute[72782]:   <features>
Aug 14 19:56:06 user nova-compute[72782]:     <acpi/>
Aug 14 19:56:06 user nova-compute[72782]:     <apic/>
Aug 14 19:56:06 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:56:06 user nova-compute[72782]:   </features>
Aug 14 19:56:06 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:56:06 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:56:06 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:56:06 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:56:06 user nova-compute[72782]:   </clock>
Aug 14 19:56:06 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:56:06 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:56:06 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:56:06 user nova-compute[72782]:   </cpu>
Aug 14 19:56:06 user nova-compute[72782]:   <devices>
Aug 14 19:56:06 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:56:06 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:56:06 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/disk"/>
Aug 14 19:56:06 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:56:06 user nova-compute[72782]:     </disk>
Aug 14 19:56:06 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:56:06 user nova-compute[72782]:       <mac address="fa:16:3e:43:c6:df"/>
Aug 14 19:56:06 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:56:06 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:56:06 user nova-compute[72782]:       <target dev="tap4a2c9016-fb"/>
Aug 14 19:56:06 user nova-compute[72782]:     </interface>
Aug 14 19:56:06 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:56:06 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/console.log" append="off"/>
Aug 14 19:56:06 user nova-compute[72782]:     </serial>
Aug 14 19:56:06 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:56:06 user nova-compute[72782]:     <video>
Aug 14 19:56:06 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:56:06 user nova-compute[72782]:     </video>
Aug 14 19:56:06 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:56:06 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:56:06 user nova-compute[72782]:     </rng>
Aug 14 19:56:06 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:56:06 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:56:06 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:56:06 user nova-compute[72782]:     </memballoon>
Aug 14 19:56:06 user nova-compute[72782]:   </devices>
Aug 14 19:56:06 user nova-compute[72782]: </domain>
Aug 14 19:56:06 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-516756219',display_name='tempest-AttachVolumeNegativeTest-server-516756219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-516756219',id=25,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPL93JDJNiwO4gbzcF47ql19bRsBAdBx6MvY/SUJw3D7FAqil4AexoHt74dlw+j7BCQeEDhJCtbE7GB/Ntaa2Gq8osw6GzLVJHiKhTJTpw7ir0XfejLXL48P9ELNukAtQ==',key_name='tempest-keypair-41767071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2c26e0199de48ee8c48dde8177bc519',ramdisk_id='',reservation_id='r-umfo4qep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1229463629',owner_user_name='tempest-AttachVolumeNegativeTest-1229463629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:56:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0cada11ffdb4ebc8d9e80218818ec3b',uuid=f057c9c2-9c75-4c4b-8f95-444f135e4056,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "address": "fa:16:3e:43:c6:df", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c9016-fb", "ovs_interfaceid": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converting VIF {"id": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "address": "fa:16:3e:43:c6:df", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c9016-fb", "ovs_interfaceid": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:c6:df,bridge_name='br-int',has_traffic_filtering=True,id=4a2c9016-fb98-43d4-8d02-ccc26f4698bb,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2c9016-fb') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG os_vif [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:c6:df,bridge_name='br-int',has_traffic_filtering=True,id=4a2c9016-fb98-43d4-8d02-ccc26f4698bb,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2c9016-fb') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a2c9016-fb, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a2c9016-fb, col_values=(('external_ids', {'iface-id': '4a2c9016-fb98-43d4-8d02-ccc26f4698bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:c6:df', 'vm-uuid': 'f057c9c2-9c75-4c4b-8f95-444f135e4056'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:06 user nova-compute[72782]: INFO os_vif [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:c6:df,bridge_name='br-int',has_traffic_filtering=True,id=4a2c9016-fb98-43d4-8d02-ccc26f4698bb,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2c9016-fb')
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] No VIF found with MAC fa:16:3e:43:c6:df, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:56:06 user nova-compute[72782]: INFO nova.compute.claims [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Claim successful on node user
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.network.neutron [req-e5462eb1-d2a0-45ba-b4fe-ecf9003f9c34 req-9e7c3385-4203-4c98-9c18-32cd3c0830f6 service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Updated VIF entry in instance network info cache for port 4a2c9016-fb98-43d4-8d02-ccc26f4698bb. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG nova.network.neutron [req-e5462eb1-d2a0-45ba-b4fe-ecf9003f9c34 req-9e7c3385-4203-4c98-9c18-32cd3c0830f6 service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Updating instance_info_cache with network_info: [{"id": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "address": "fa:16:3e:43:c6:df", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c9016-fb", "ovs_interfaceid": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e5462eb1-d2a0-45ba-b4fe-ecf9003f9c34 req-9e7c3385-4203-4c98-9c18-32cd3c0830f6 service nova] Releasing lock "refresh_cache-f057c9c2-9c75-4c4b-8f95-444f135e4056" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:06 user nova-compute[72782]: INFO nova.compute.manager [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Detaching volume 4e55f4b6-384c-4013-b6a2-b6512ffc5519
Aug 14 19:56:07 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:56:07 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:56:07 user nova-compute[72782]: INFO nova.virt.block_device [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Attempting to driver detach volume 4e55f4b6-384c-4013-b6a2-b6512ffc5519 from mountpoint /dev/vdb
Aug 14 19:56:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Attempting to detach device vdb from instance a4ae2e60-c4d4-4a7e-826e-fb315fa98138 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:56:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:56:07 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:56:07 user nova-compute[72782]:   <source dev="/dev/sdh"/>
Aug 14 19:56:07 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:56:07 user nova-compute[72782]:   <serial>4e55f4b6-384c-4013-b6a2-b6512ffc5519</serial>
Aug 14 19:56:07 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:56:07 user nova-compute[72782]: </disk>
Aug 14 19:56:07 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:56:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:56:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Successfully detached device vdb from instance a4ae2e60-c4d4-4a7e-826e-fb315fa98138 from the persistent domain config.
Aug 14 19:56:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4ae2e60-c4d4-4a7e-826e-fb315fa98138 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:56:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:56:07 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:56:07 user nova-compute[72782]:   <source dev="/dev/sdh"/>
Aug 14 19:56:07 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:56:07 user nova-compute[72782]:   <serial>4e55f4b6-384c-4013-b6a2-b6512ffc5519</serial>
Aug 14 19:56:07 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:56:07 user nova-compute[72782]: </disk>
Aug 14 19:56:07 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:56:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:56:07 user nova-compute[72782]: DEBUG nova.network.neutron [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:56:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:56:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:56:07 user nova-compute[72782]: INFO nova.virt.block_device [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Booting with blank volume at /dev/vda
Aug 14 19:56:07 user nova-compute[72782]: DEBUG nova.policy [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12fb8b10952b4c6b8dc6823610830241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9f312ba4414905a8d6eb44933e430e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:56:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692042967.9512117, a4ae2e60-c4d4-4a7e-826e-fb315fa98138 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:56:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4ae2e60-c4d4-4a7e-826e-fb315fa98138 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:56:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Successfully detached device vdb from instance a4ae2e60-c4d4-4a7e-826e-fb315fa98138 from the live domain config.
Aug 14 19:56:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:56:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXkYdLnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:56:07 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:56:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:56:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:56:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:56:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2341594-6fc5-4631-9c74-87e3b3b6e6a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c7f7577-6a97-4a80-b5cc-91d1f1e65a37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be0960c4-7d5e-41a2-ba1d-937e3dcd9f20\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[021d5615-f5d9-402c-b304-e3b45682d5b2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0960c4-7d5e-41a2-ba1d-937e3dcd9f20 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7f7577-6a97-4a80-b5cc-91d1f1e65a37 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:56:08 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:56:08 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:56:08 user nova-compute[72782]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:08 user nova-compute[72782]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0960c4-7d5e-41a2-ba1d-937e3dcd9f20 (non-flash)
Aug 14 19:56:08 user nova-compute[72782]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7f7577-6a97-4a80-b5cc-91d1f1e65a37 (non-flash)
Aug 14 19:56:08 user nova-compute[72782]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 (non-flash)
Aug 14 19:56:08 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:56:08 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:56:08 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:56:08 user nova-compute[72782]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:08 user nova-compute[72782]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be0960c4-7d5e-41a2-ba1d-937e3dcd9f20 (non-flash)
Aug 14 19:56:08 user nova-compute[72782]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7f7577-6a97-4a80-b5cc-91d1f1e65a37 (non-flash)
Aug 14 19:56:08 user nova-compute[72782]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 (non-flash)
Aug 14 19:56:08 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e86cbc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519'): ({'sdh'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Removing single pathed devices sdh {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c48bd2-705e-47bd-9e16-622bf530a345]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG nova.network.neutron [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Successfully created port: 2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[005b322f-fa1c-455f-829e-7289c2407e61]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Flushing IO for device /dev/sdh {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cce66f9-23a7-4b7a-8264-d128cd457b3f]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ba749a-3f89-4f5b-8d29-3c5952fa4d5d]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] SCSI volumes sdh have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e524e0b-4a6d-4380-aae9-ce6d8947a74e]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c54645-a456-4d68-8c8e-ddef22ed76e7]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519, portal: 172.16.0.220,3260]
Aug 14 19:56:08 user nova-compute[72782]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519, portal: 172.16.0.220,3260] successful.
Aug 14 19:56:08 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e55f4b6-384c-4013-b6a2-b6512ffc5519 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.063s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7854d1-0232-410b-af4c-57fe6c01cde1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] <== disconnect_volume: return (433ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-f36fedcb-6ef3-41df-811d-9fe727c13b14 req-861c6750-7dad-4db0-95ae-81d0f445ef49 service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Received event network-vif-plugged-4a2c9016-fb98-43d4-8d02-ccc26f4698bb {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f36fedcb-6ef3-41df-811d-9fe727c13b14 req-861c6750-7dad-4db0-95ae-81d0f445ef49 service nova] Acquiring lock "f057c9c2-9c75-4c4b-8f95-444f135e4056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f36fedcb-6ef3-41df-811d-9fe727c13b14 req-861c6750-7dad-4db0-95ae-81d0f445ef49 service nova] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f36fedcb-6ef3-41df-811d-9fe727c13b14 req-861c6750-7dad-4db0-95ae-81d0f445ef49 service nova] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-f36fedcb-6ef3-41df-811d-9fe727c13b14 req-861c6750-7dad-4db0-95ae-81d0f445ef49 service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] No waiting events found dispatching network-vif-plugged-4a2c9016-fb98-43d4-8d02-ccc26f4698bb {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:56:08 user nova-compute[72782]: WARNING nova.compute.manager [req-f36fedcb-6ef3-41df-811d-9fe727c13b14 req-861c6750-7dad-4db0-95ae-81d0f445ef49 service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Received unexpected event network-vif-plugged-4a2c9016-fb98-43d4-8d02-ccc26f4698bb for instance with vm_state building and task_state spawning.
Aug 14 19:56:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:09 user nova-compute[72782]: DEBUG nova.network.neutron [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Successfully updated port: 2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:56:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "refresh_cache-ad4011a9-ab9f-4647-b677-a1c6337d2c2c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:56:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquired lock "refresh_cache-ad4011a9-ab9f-4647-b677-a1c6337d2c2c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:56:09 user nova-compute[72782]: DEBUG nova.network.neutron [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:56:09 user nova-compute[72782]: DEBUG nova.network.neutron [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.network.neutron [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Updating instance_info_cache with network_info: [{"id": "2858462d-1715-4c67-aee3-a0c15eac235b", "address": "fa:16:3e:f1:85:57", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2858462d-17", "ovs_interfaceid": "2858462d-1715-4c67-aee3-a0c15eac235b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Releasing lock "refresh_cache-ad4011a9-ab9f-4647-b677-a1c6337d2c2c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Instance network_info: |[{"id": "2858462d-1715-4c67-aee3-a0c15eac235b", "address": "fa:16:3e:f1:85:57", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2858462d-17", "ovs_interfaceid": "2858462d-1715-4c67-aee3-a0c15eac235b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042970.9089274, f057c9c2-9c75-4c4b-8f95-444f135e4056 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:56:10 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] VM Resumed (Lifecycle Event)
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.compute.manager [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:56:10 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Instance spawned successfully.
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-4aabbb76-8eb6-4917-b902-1d392d045072 req-e0ff6ce1-f342-41cf-816f-f7c9aeee59cf service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Received event network-vif-plugged-4a2c9016-fb98-43d4-8d02-ccc26f4698bb {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4aabbb76-8eb6-4917-b902-1d392d045072 req-e0ff6ce1-f342-41cf-816f-f7c9aeee59cf service nova] Acquiring lock "f057c9c2-9c75-4c4b-8f95-444f135e4056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4aabbb76-8eb6-4917-b902-1d392d045072 req-e0ff6ce1-f342-41cf-816f-f7c9aeee59cf service nova] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4aabbb76-8eb6-4917-b902-1d392d045072 req-e0ff6ce1-f342-41cf-816f-f7c9aeee59cf service nova] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-4aabbb76-8eb6-4917-b902-1d392d045072 req-e0ff6ce1-f342-41cf-816f-f7c9aeee59cf service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] No waiting events found dispatching network-vif-plugged-4a2c9016-fb98-43d4-8d02-ccc26f4698bb {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:56:10 user nova-compute[72782]: WARNING nova.compute.manager [req-4aabbb76-8eb6-4917-b902-1d392d045072 req-e0ff6ce1-f342-41cf-816f-f7c9aeee59cf service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Received unexpected event network-vif-plugged-4a2c9016-fb98-43d4-8d02-ccc26f4698bb for instance with vm_state building and task_state spawning.
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-4aabbb76-8eb6-4917-b902-1d392d045072 req-e0ff6ce1-f342-41cf-816f-f7c9aeee59cf service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received event network-changed-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-4aabbb76-8eb6-4917-b902-1d392d045072 req-e0ff6ce1-f342-41cf-816f-f7c9aeee59cf service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Refreshing instance network info cache due to event network-changed-2858462d-1715-4c67-aee3-a0c15eac235b. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4aabbb76-8eb6-4917-b902-1d392d045072 req-e0ff6ce1-f342-41cf-816f-f7c9aeee59cf service nova] Acquiring lock "refresh_cache-ad4011a9-ab9f-4647-b677-a1c6337d2c2c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4aabbb76-8eb6-4917-b902-1d392d045072 req-e0ff6ce1-f342-41cf-816f-f7c9aeee59cf service nova] Acquired lock "refresh_cache-ad4011a9-ab9f-4647-b677-a1c6337d2c2c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.network.neutron [req-4aabbb76-8eb6-4917-b902-1d392d045072 req-e0ff6ce1-f342-41cf-816f-f7c9aeee59cf service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Refreshing network info cache for port 2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:56:10 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:56:10 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042970.9105906, f057c9c2-9c75-4c4b-8f95-444f135e4056 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:56:10 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] VM Started (Lifecycle Event)
Aug 14 19:56:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:56:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:56:11 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:56:11 user nova-compute[72782]: INFO nova.compute.manager [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Took 7.67 seconds to spawn the instance on the hypervisor.
Aug 14 19:56:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:56:11 user nova-compute[72782]: INFO nova.compute.manager [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Took 9.19 seconds to build instance.
Aug 14 19:56:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2a3a2aed-d959-48d3-9c65-91b296266a7e tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.361s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:11 user nova-compute[72782]: DEBUG nova.network.neutron [req-4aabbb76-8eb6-4917-b902-1d392d045072 req-e0ff6ce1-f342-41cf-816f-f7c9aeee59cf service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Updated VIF entry in instance network info cache for port 2858462d-1715-4c67-aee3-a0c15eac235b. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:56:11 user nova-compute[72782]: DEBUG nova.network.neutron [req-4aabbb76-8eb6-4917-b902-1d392d045072 req-e0ff6ce1-f342-41cf-816f-f7c9aeee59cf service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Updating instance_info_cache with network_info: [{"id": "2858462d-1715-4c67-aee3-a0c15eac235b", "address": "fa:16:3e:f1:85:57", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2858462d-17", "ovs_interfaceid": "2858462d-1715-4c67-aee3-a0c15eac235b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:56:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4aabbb76-8eb6-4917-b902-1d392d045072 req-e0ff6ce1-f342-41cf-816f-f7c9aeee59cf service nova] Releasing lock "refresh_cache-ad4011a9-ab9f-4647-b677-a1c6337d2c2c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:56:12 user nova-compute[72782]: DEBUG nova.objects.instance [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lazy-loading 'flavor' on Instance uuid a4ae2e60-c4d4-4a7e-826e-fb315fa98138 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:56:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34e751b4-53e6-4edd-b2b1-25e081b9df7e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.427s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG os_brick.utils [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc5f21b-3931-4f04-ae94-a975202a246a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.039s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ab5a28-79c3-465a-a9c8-b36ff369be52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0ccb41-71e3-487f-ac31-ba8a7bbe84bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1b1e31-21c8-4ab6-8aa0-5a61a74dc03e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:56:13 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:56:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[47035cd2-04e0-4b54-bd35-7fadf0e0813e]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG os_brick.utils [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] <== get_connector_properties: return (196ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:56:13 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Updating existing volume attachment record: 49180b9b-9125-42b2-9f9b-abd55c23f34c {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:56:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "e1052af2-5cc1-4d38-9467-032128545267" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "e1052af2-5cc1-4d38-9467-032128545267" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:14 user nova-compute[72782]: INFO nova.compute.manager [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Detaching volume 8619d659-89ff-4f0b-9ad5-819391568db7
Aug 14 19:56:14 user nova-compute[72782]: INFO nova.virt.block_device [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Attempting to driver detach volume 8619d659-89ff-4f0b-9ad5-819391568db7 from mountpoint /dev/vdb
Aug 14 19:56:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Attempting to detach device vdb from instance e1052af2-5cc1-4d38-9467-032128545267 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:56:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:56:14 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:56:14 user nova-compute[72782]:   <source dev="/dev/sdc"/>
Aug 14 19:56:14 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:56:14 user nova-compute[72782]:   <serial>8619d659-89ff-4f0b-9ad5-819391568db7</serial>
Aug 14 19:56:14 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 19:56:14 user nova-compute[72782]: </disk>
Aug 14 19:56:14 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:56:14 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Successfully detached device vdb from instance e1052af2-5cc1-4d38-9467-032128545267 from the persistent domain config.
Aug 14 19:56:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1052af2-5cc1-4d38-9467-032128545267 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:56:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:56:14 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:56:14 user nova-compute[72782]:   <source dev="/dev/sdc"/>
Aug 14 19:56:14 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:56:14 user nova-compute[72782]:   <serial>8619d659-89ff-4f0b-9ad5-819391568db7</serial>
Aug 14 19:56:14 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 19:56:14 user nova-compute[72782]: </disk>
Aug 14 19:56:14 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:56:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692042974.9332557, e1052af2-5cc1-4d38-9467-032128545267 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:56:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1052af2-5cc1-4d38-9467-032128545267 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:56:14 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Successfully detached device vdb from instance e1052af2-5cc1-4d38-9467-032128545267 from the live domain config.
Aug 14 19:56:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:56:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YEfjthci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:56:14 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:56:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:56:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:56:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:56:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:14 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7fc729-9393-4f72-b5fb-8bfbd626b37c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c7f7577-6a97-4a80-b5cc-91d1f1e65a37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be0960c4-7d5e-41a2-ba1d-937e3dcd9f20\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[668f4f7d-3671-446c-8d13-ae11f25b48b3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7f7577-6a97-4a80-b5cc-91d1f1e65a37 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:56:15 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:56:15 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:56:15 user nova-compute[72782]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:15 user nova-compute[72782]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7f7577-6a97-4a80-b5cc-91d1f1e65a37 (non-flash)
Aug 14 19:56:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 (non-flash)
Aug 14 19:56:15 user nova-compute[72782]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:56:15 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:56:15 user nova-compute[72782]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:15 user nova-compute[72782]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c7f7577-6a97-4a80-b5cc-91d1f1e65a37 (non-flash)
Aug 14 19:56:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e8690700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7'): ({'sdc'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Removing single pathed devices sdc {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a5c9e4-8827-48bb-bec3-4eaa2ccafc2e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3bae1d-0ba4-44d4-874d-d4a9e325e241]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Flushing IO for device /dev/sdc {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[410f7b09-c9df-4c9b-9884-ec99bd86d654]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[da97a56d-fa3e-4f57-9036-69ff75aa188d]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] SCSI volumes sdc have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[860c6194-299f-45ee-8a09-23ec981e98e9]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ac959b-10d5-4cbd-9ecb-58f5e451e2b7]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7, portal: 172.16.0.220,3260]
Aug 14 19:56:15 user nova-compute[72782]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7, portal: 172.16.0.220,3260] successful.
Aug 14 19:56:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8619d659-89ff-4f0b-9ad5-819391568db7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd45a60-1a39-4001-a524-0bd008a7e66f]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] <== disconnect_volume: return (365ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:56:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:56:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:23 user nova-compute[72782]: DEBUG nova.objects.instance [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'flavor' on Instance uuid e1052af2-5cc1-4d38-9467-032128545267 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-28a8721c-eae3-45bb-b71d-5ade1a78bf71 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "e1052af2-5cc1-4d38-9467-032128545267" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.974s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:56:24 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Creating image(s)
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Did not create local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Ensure instance console log exists: /opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Start _get_guest_xml network_info=[{"id": "2858462d-1715-4c67-aee3-a0c15eac235b", "address": "fa:16:3e:f1:85:57", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2858462d-17", "ovs_interfaceid": "2858462d-1715-4c67-aee3-a0c15eac235b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '49180b9b-9125-42b2-9f9b-abd55c23f34c', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAyaHErp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ad4011a9-ab9f-4647-b677-a1c6337d2c2c', 'attached_at': '', 'detached_at': '', 'volume_id': '29d8d5e8-35a6-4a5b-86f8-bb40c3282801', 'serial': '29d8d5e8-35a6-4a5b-86f8-bb40c3282801'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:56:24 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:56:24 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAyaHErp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:56:24 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:56:24 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:56:24 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7de250-79d1-456a-8644-f575f19486cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:56:24 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8942bb38-9105-4cdc-8fe3-b0715dfd8496]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801] added
Aug 14 19:56:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[db827ce7-f412-4d09-b153-eca5cc2a4b4f]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c8d3af-6a94-4ffc-b6bd-860230ce4dae]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAyaHErp {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAyaHErp" returned: 0 in 0.055s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1aef68-7d7e-4e79-9809-5c54359e4105]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tAyaHErp'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e40c668-04e2-40fd-9310-690ed60922fe]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0f0c84-6c91-45a9-bc2c-c436fcd7aa42]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:56:24 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:56:24 user nova-compute[72782]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:56:24 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:56:24 user nova-compute[72782]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d81406-d8d9-4a08-899d-ecb26f610d82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801, portal: 172.16.0.220,3260]
Aug 14 19:56:24 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801, portal: 172.16.0.220,3260] successful.
Aug 14 19:56:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fbe50b-e878-4f9b-b6cc-616824927d93]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[908a4398-a270-4caf-bacb-1f0078f745a5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:56:24 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:56:24 user nova-compute[72782]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:24 user nova-compute[72782]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:56:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:56:24 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:56:24 user nova-compute[72782]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:24 user nova-compute[72782]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:56:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76d238b-8f03-4889-86ed-094330f82f50]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:56:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAyaHErp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23838306466386536', 'path': '/dev/sdc'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838306466386536', 'path': '/dev/sdc'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:56:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1616735295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1616735295',id=26,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f9f312ba4414905a8d6eb44933e430e',ramdisk_id='',reservation_id='r-tabsp0yl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:56:07Z,user_data=None,user_id='12fb8b10952b4c6b8dc6823610830241',uuid=ad4011a9-ab9f-4647-b677-a1c6337d2c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2858462d-1715-4c67-aee3-a0c15eac235b", "address": "fa:16:3e:f1:85:57", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2858462d-17", "ovs_interfaceid": "2858462d-1715-4c67-aee3-a0c15eac235b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converting VIF {"id": "2858462d-1715-4c67-aee3-a0c15eac235b", "address": "fa:16:3e:f1:85:57", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2858462d-17", "ovs_interfaceid": "2858462d-1715-4c67-aee3-a0c15eac235b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:85:57,bridge_name='br-int',has_traffic_filtering=True,id=2858462d-1715-4c67-aee3-a0c15eac235b,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2858462d-17') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG nova.objects.instance [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'pci_devices' on Instance uuid ad4011a9-ab9f-4647-b677-a1c6337d2c2c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:56:25 user nova-compute[72782]:   <uuid>ad4011a9-ab9f-4647-b677-a1c6337d2c2c</uuid>
Aug 14 19:56:25 user nova-compute[72782]:   <name>instance-0000001a</name>
Aug 14 19:56:25 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:56:25 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:56:25 user nova-compute[72782]:   <metadata>
Aug 14 19:56:25 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:56:25 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:56:25 user nova-compute[72782]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1616735295</nova:name>
Aug 14 19:56:25 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:56:24</nova:creationTime>
Aug 14 19:56:25 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:56:25 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:56:25 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:56:25 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:56:25 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:56:25 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:56:25 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:56:25 user nova-compute[72782]:       <nova:owner>
Aug 14 19:56:25 user nova-compute[72782]:         <nova:user uuid="12fb8b10952b4c6b8dc6823610830241">tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member</nova:user>
Aug 14 19:56:25 user nova-compute[72782]:         <nova:project uuid="4f9f312ba4414905a8d6eb44933e430e">tempest-ServerBootFromVolumeStableRescueTest-1102073842</nova:project>
Aug 14 19:56:25 user nova-compute[72782]:       </nova:owner>
Aug 14 19:56:25 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:56:25 user nova-compute[72782]:       <nova:ports>
Aug 14 19:56:25 user nova-compute[72782]:         <nova:port uuid="2858462d-1715-4c67-aee3-a0c15eac235b">
Aug 14 19:56:25 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 19:56:25 user nova-compute[72782]:         </nova:port>
Aug 14 19:56:25 user nova-compute[72782]:       </nova:ports>
Aug 14 19:56:25 user nova-compute[72782]:     </nova:instance>
Aug 14 19:56:25 user nova-compute[72782]:   </metadata>
Aug 14 19:56:25 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:56:25 user nova-compute[72782]:     <system>
Aug 14 19:56:25 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:56:25 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:56:25 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:56:25 user nova-compute[72782]:       <entry name="serial">ad4011a9-ab9f-4647-b677-a1c6337d2c2c</entry>
Aug 14 19:56:25 user nova-compute[72782]:       <entry name="uuid">ad4011a9-ab9f-4647-b677-a1c6337d2c2c</entry>
Aug 14 19:56:25 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:56:25 user nova-compute[72782]:     </system>
Aug 14 19:56:25 user nova-compute[72782]:   </sysinfo>
Aug 14 19:56:25 user nova-compute[72782]:   <os>
Aug 14 19:56:25 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:56:25 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:56:25 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:56:25 user nova-compute[72782]:   </os>
Aug 14 19:56:25 user nova-compute[72782]:   <features>
Aug 14 19:56:25 user nova-compute[72782]:     <acpi/>
Aug 14 19:56:25 user nova-compute[72782]:     <apic/>
Aug 14 19:56:25 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:56:25 user nova-compute[72782]:   </features>
Aug 14 19:56:25 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:56:25 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:56:25 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:56:25 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:56:25 user nova-compute[72782]:   </clock>
Aug 14 19:56:25 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:56:25 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:56:25 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:56:25 user nova-compute[72782]:   </cpu>
Aug 14 19:56:25 user nova-compute[72782]:   <devices>
Aug 14 19:56:25 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 19:56:25 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:56:25 user nova-compute[72782]:       <source dev="/dev/sdc"/>
Aug 14 19:56:25 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:56:25 user nova-compute[72782]:       <serial>29d8d5e8-35a6-4a5b-86f8-bb40c3282801</serial>
Aug 14 19:56:25 user nova-compute[72782]:     </disk>
Aug 14 19:56:25 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:56:25 user nova-compute[72782]:       <mac address="fa:16:3e:f1:85:57"/>
Aug 14 19:56:25 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:56:25 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:56:25 user nova-compute[72782]:       <target dev="tap2858462d-17"/>
Aug 14 19:56:25 user nova-compute[72782]:     </interface>
Aug 14 19:56:25 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:56:25 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c/console.log" append="off"/>
Aug 14 19:56:25 user nova-compute[72782]:     </serial>
Aug 14 19:56:25 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:56:25 user nova-compute[72782]:     <video>
Aug 14 19:56:25 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:56:25 user nova-compute[72782]:     </video>
Aug 14 19:56:25 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:56:25 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:56:25 user nova-compute[72782]:     </rng>
Aug 14 19:56:25 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:56:25 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:56:25 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:56:25 user nova-compute[72782]:     </memballoon>
Aug 14 19:56:25 user nova-compute[72782]:   </devices>
Aug 14 19:56:25 user nova-compute[72782]: </domain>
Aug 14 19:56:25 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:56:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1616735295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1616735295',id=26,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f9f312ba4414905a8d6eb44933e430e',ramdisk_id='',reservation_id='r-tabsp0yl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:56:07Z,user_data=None,user_id='12fb8b10952b4c6b8dc6823610830241',uuid=ad4011a9-ab9f-4647-b677-a1c6337d2c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2858462d-1715-4c67-aee3-a0c15eac235b", "address": "fa:16:3e:f1:85:57", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2858462d-17", "ovs_interfaceid": "2858462d-1715-4c67-aee3-a0c15eac235b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converting VIF {"id": "2858462d-1715-4c67-aee3-a0c15eac235b", "address": "fa:16:3e:f1:85:57", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2858462d-17", "ovs_interfaceid": "2858462d-1715-4c67-aee3-a0c15eac235b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:85:57,bridge_name='br-int',has_traffic_filtering=True,id=2858462d-1715-4c67-aee3-a0c15eac235b,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2858462d-17') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG os_vif [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:85:57,bridge_name='br-int',has_traffic_filtering=True,id=2858462d-1715-4c67-aee3-a0c15eac235b,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2858462d-17') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2858462d-17, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2858462d-17, col_values=(('external_ids', {'iface-id': '2858462d-1715-4c67-aee3-a0c15eac235b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:85:57', 'vm-uuid': 'ad4011a9-ab9f-4647-b677-a1c6337d2c2c'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:56:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:25 user nova-compute[72782]: INFO os_vif [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:85:57,bridge_name='br-int',has_traffic_filtering=True,id=2858462d-1715-4c67-aee3-a0c15eac235b,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2858462d-17')
Aug 14 19:56:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:56:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] No VIF found with MAC fa:16:3e:f1:85:57, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG nova.network.neutron [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Port 356eefe9-57d0-4af1-b7bd-842e2cfa33d0 binding to destination host user is already ACTIVE {{(pid=72782) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquired lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG nova.network.neutron [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-5e769340-1e07-4590-964b-3677dd3f24fc req-c36d811b-2298-407a-a1cf-a70cccaf67c5 service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received event network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5e769340-1e07-4590-964b-3677dd3f24fc req-c36d811b-2298-407a-a1cf-a70cccaf67c5 service nova] Acquiring lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5e769340-1e07-4590-964b-3677dd3f24fc req-c36d811b-2298-407a-a1cf-a70cccaf67c5 service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5e769340-1e07-4590-964b-3677dd3f24fc req-c36d811b-2298-407a-a1cf-a70cccaf67c5 service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-5e769340-1e07-4590-964b-3677dd3f24fc req-c36d811b-2298-407a-a1cf-a70cccaf67c5 service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] No waiting events found dispatching network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:56:27 user nova-compute[72782]: WARNING nova.compute.manager [req-5e769340-1e07-4590-964b-3677dd3f24fc req-c36d811b-2298-407a-a1cf-a70cccaf67c5 service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received unexpected event network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b for instance with vm_state building and task_state spawning.
Aug 14 19:56:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG nova.network.neutron [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Updating instance_info_cache with network_info: [{"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Releasing lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Creating tmpfile /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/tmpojaombeg to verify with other compute node that the instance is on the same shared storage. {{(pid=72782) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:28 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Instance destroyed successfully.
Aug 14 19:56:28 user nova-compute[72782]: DEBUG nova.objects.instance [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lazy-loading 'resources' on Instance uuid c748103b-a37c-47c5-8394-ea54749f27eb {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-541757814',display_name='tempest-ServerActionsTestOtherB-server-541757814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-541757814',id=17,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAarAxn7T7X51FB9WvWO3LMKvuHfCnYFXmKg73GAqFcCk71N2M9odae+ScSuYIAVSuzCKRu92FXDYUypvnCOyLRjSrxNpiNed5PJ7CB2bOBIRMco4NgzPsIxo+nrGJWEGg==',key_name='tempest-keypair-1073189448',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:54:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b283da9d5774739a1749f7684439c35',ramdisk_id='',reservation_id='r-2esch0g0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1314711059',owner_user_name='tempest-ServerActionsTestOtherB-1314711059-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:54:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613ae0366fc5462081f877c1f2c40c7e',uuid=c748103b-a37c-47c5-8394-ea54749f27eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Converting VIF {"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_vif [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap356eefe9-57, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:56:28 user nova-compute[72782]: INFO os_vif [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57')
Aug 14 19:56:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyJZBnql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:56:28 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e304dd8-e19f-484d-86a0-b5455b5c20dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5569927b-d00b-4ce4-91b6-4720efc7ec60]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:56:28 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:56:28 user nova-compute[72782]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:28 user nova-compute[72782]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:56:28 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:56:28 user nova-compute[72782]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:56:28 user nova-compute[72782]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:28 user nova-compute[72782]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:56:28 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f641c2b3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc758a2-2817-42c2-bde3-5d246d2089eb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f461dedb-6f60-4cd5-826e-9c5490a2b3a0]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24ae021-1d29-43b0-b1fe-ff53c43c0c73]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5f5b8b-1dd0-4672-9b97-6345de11deba]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4b2f01-c982-4b12-8cf0-4b4090868217]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e58e5c-79b1-4e4d-ac38-684726baa098]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260]
Aug 14 19:56:28 user nova-compute[72782]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260] successful.
Aug 14 19:56:28 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fc4342-4daa-4ba8-a99e-46e1ad14552c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] <== disconnect_volume: return (303ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:56:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042989.536876, ad4011a9-ab9f-4647-b677-a1c6337d2c2c => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:56:29 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] VM Resumed (Lifecycle Event)
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:56:29 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Instance spawned successfully.
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:56:29 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692042989.5381262, ad4011a9-ab9f-4647-b677-a1c6337d2c2c => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:56:29 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] VM Started (Lifecycle Event)
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:56:29 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:56:29 user nova-compute[72782]: INFO nova.compute.manager [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Took 5.23 seconds to spawn the instance on the hypervisor.
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:56:29 user nova-compute[72782]: INFO nova.compute.manager [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Took 23.33 seconds to build instance.
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-1ee72ffb-5955-44ab-bcc1-004ed06e1971 req-ccab35d7-a441-4e83-bf51-69dbaf08422d service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received event network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ee72ffb-5955-44ab-bcc1-004ed06e1971 req-ccab35d7-a441-4e83-bf51-69dbaf08422d service nova] Acquiring lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ee72ffb-5955-44ab-bcc1-004ed06e1971 req-ccab35d7-a441-4e83-bf51-69dbaf08422d service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ee72ffb-5955-44ab-bcc1-004ed06e1971 req-ccab35d7-a441-4e83-bf51-69dbaf08422d service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-1ee72ffb-5955-44ab-bcc1-004ed06e1971 req-ccab35d7-a441-4e83-bf51-69dbaf08422d service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] No waiting events found dispatching network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:56:29 user nova-compute[72782]: WARNING nova.compute.manager [req-1ee72ffb-5955-44ab-bcc1-004ed06e1971 req-ccab35d7-a441-4e83-bf51-69dbaf08422d service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received unexpected event network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b for instance with vm_state building and task_state spawning.
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-1ee72ffb-5955-44ab-bcc1-004ed06e1971 req-ccab35d7-a441-4e83-bf51-69dbaf08422d service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received event network-vif-unplugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ee72ffb-5955-44ab-bcc1-004ed06e1971 req-ccab35d7-a441-4e83-bf51-69dbaf08422d service nova] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ee72ffb-5955-44ab-bcc1-004ed06e1971 req-ccab35d7-a441-4e83-bf51-69dbaf08422d service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ee72ffb-5955-44ab-bcc1-004ed06e1971 req-ccab35d7-a441-4e83-bf51-69dbaf08422d service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-1ee72ffb-5955-44ab-bcc1-004ed06e1971 req-ccab35d7-a441-4e83-bf51-69dbaf08422d service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] No waiting events found dispatching network-vif-unplugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:56:29 user nova-compute[72782]: WARNING nova.compute.manager [req-1ee72ffb-5955-44ab-bcc1-004ed06e1971 req-ccab35d7-a441-4e83-bf51-69dbaf08422d service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received unexpected event network-vif-unplugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 for instance with vm_state resized and task_state resize_reverting.
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-1ee72ffb-5955-44ab-bcc1-004ed06e1971 req-ccab35d7-a441-4e83-bf51-69dbaf08422d service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received event network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ee72ffb-5955-44ab-bcc1-004ed06e1971 req-ccab35d7-a441-4e83-bf51-69dbaf08422d service nova] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ee72ffb-5955-44ab-bcc1-004ed06e1971 req-ccab35d7-a441-4e83-bf51-69dbaf08422d service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ee72ffb-5955-44ab-bcc1-004ed06e1971 req-ccab35d7-a441-4e83-bf51-69dbaf08422d service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-1ee72ffb-5955-44ab-bcc1-004ed06e1971 req-ccab35d7-a441-4e83-bf51-69dbaf08422d service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] No waiting events found dispatching network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:56:29 user nova-compute[72782]: WARNING nova.compute.manager [req-1ee72ffb-5955-44ab-bcc1-004ed06e1971 req-ccab35d7-a441-4e83-bf51-69dbaf08422d service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received unexpected event network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 for instance with vm_state resized and task_state resize_reverting.
Aug 14 19:56:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f7f57215-9d5c-40f2-8379-692717c09c7d tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.469s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:29 user nova-compute[72782]: DEBUG nova.objects.instance [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lazy-loading 'migration_context' on Instance uuid c748103b-a37c-47c5-8394-ea54749f27eb {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:30 user nova-compute[72782]: INFO nova.compute.manager [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Detaching volume 192ff840-03a7-4424-b009-dd541b322d4b
Aug 14 19:56:30 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:56:30 user nova-compute[72782]: INFO nova.virt.block_device [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Attempting to driver detach volume 192ff840-03a7-4424-b009-dd541b322d4b from mountpoint /dev/vdb
Aug 14 19:56:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Attempting to detach device vdb from instance 792f31f1-4079-4443-81f2-b1e364a9ee14 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:56:30 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:56:30 user nova-compute[72782]:   <source dev="/dev/sdd"/>
Aug 14 19:56:30 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:56:30 user nova-compute[72782]:   <serial>192ff840-03a7-4424-b009-dd541b322d4b</serial>
Aug 14 19:56:30 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:56:30 user nova-compute[72782]: </disk>
Aug 14 19:56:30 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:56:30 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Successfully detached device vdb from instance 792f31f1-4079-4443-81f2-b1e364a9ee14 from the persistent domain config.
Aug 14 19:56:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 792f31f1-4079-4443-81f2-b1e364a9ee14 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:56:30 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:56:30 user nova-compute[72782]:   <source dev="/dev/sdd"/>
Aug 14 19:56:30 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:56:30 user nova-compute[72782]:   <serial>192ff840-03a7-4424-b009-dd541b322d4b</serial>
Aug 14 19:56:30 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:56:30 user nova-compute[72782]: </disk>
Aug 14 19:56:30 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.454s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:30 user nova-compute[72782]: INFO nova.compute.manager [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Swapping old allocation on dict_keys(['d26c9e3b-40e6-476e-9664-3119ebf5873b']) held by migration 6ef954c9-8e6c-4b42-8034-637eb5d1ef0b for instance
Aug 14 19:56:30 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Overwriting current allocation {'allocations': {'d26c9e3b-40e6-476e-9664-3119ebf5873b': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 30}}, 'project_id': '7b283da9d5774739a1749f7684439c35', 'user_id': '613ae0366fc5462081f877c1f2c40c7e', 'consumer_generation': 1} on consumer c748103b-a37c-47c5-8394-ea54749f27eb {{(pid=72782) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquired lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG nova.network.neutron [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692042990.691785, 792f31f1-4079-4443-81f2-b1e364a9ee14 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 792f31f1-4079-4443-81f2-b1e364a9ee14 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:56:30 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Successfully detached device vdb from instance 792f31f1-4079-4443-81f2-b1e364a9ee14 from the live domain config.
Aug 14 19:56:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBfskSnM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:56:30 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:56:30 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[92178bba-c283-49e5-b5ec-338e3d6352f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f51e7d8-60fd-40be-9907-5b1bc38e9ec7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:56:30 user nova-compute[72782]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:30 user nova-compute[72782]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:56:30 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b (non-flash)
Aug 14 19:56:30 user nova-compute[72782]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:30 user nova-compute[72782]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:56:30 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e8410040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b'): ({'sdd'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Removing single pathed devices sdd {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f66eb2-ca1a-47ba-a868-11326e80e007]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[139f0539-04c3-4b11-b496-45095c33c228]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Flushing IO for device /dev/sdd {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf7b545-6788-4bf9-95ad-c9258869438c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b687fb-c787-4586-8a60-3043baa6dfb2]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7986bfc6-2733-4ee4-8b3e-a06feb33737b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c1ae36-3876-4f6d-8da6-86ecf6d9b2cc]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b, portal: 172.16.0.220,3260]
Aug 14 19:56:30 user nova-compute[72782]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b, portal: 172.16.0.220,3260] successful.
Aug 14 19:56:30 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192ff840-03a7-4424-b009-dd541b322d4b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6aa1f9-ff1a-4754-9d38-7e1a8b68d8a5]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] <== disconnect_volume: return (305ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG nova.network.neutron [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Updating instance_info_cache with network_info: [{"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Releasing lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG os_brick.utils [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edf8dd1-7388-4ffb-bff3-8675004e8f1e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6096abad-5ff7-4df4-be6a-22bc536e2c02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[168a08e1-5d48-4853-9fd1-defbb8f0eacd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b068a170-1f40-43d3-b49d-a62bae956073]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:56:31 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20b6f1c-b711-45b9-a521-1d30d5e98e2a]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG os_brick.utils [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG nova.objects.instance [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lazy-loading 'flavor' on Instance uuid 792f31f1-4079-4443-81f2-b1e364a9ee14 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:56:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ef02da4d-bd9d-448b-96a0-f3196c7be9d3 tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.713s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Starting finish_revert_migration {{(pid=72782) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Start _get_guest_xml network_info=[{"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '2c6d858e-939c-4334-98fc-eb88b0ad389c', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyJZBnql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c748103b-a37c-47c5-8394-ea54749f27eb', 'attached_at': '2023-08-14T19:56:40.000000', 'detached_at': '', 'volume_id': '69e9edf2-c2d1-4226-bc9c-3bafe0415b7d', 'serial': '69e9edf2-c2d1-4226-bc9c-3bafe0415b7d'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:56:39 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:56:39 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.objects.instance [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lazy-loading 'vcpu_model' on Instance uuid c748103b-a37c-47c5-8394-ea54749f27eb {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyJZBnql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:56:39 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:56:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:56:39 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:56:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:56:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:56:39 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:56:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f64b417-94f1-438b-87b8-05ac73151515]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:56:40 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5978bb5f-d068-4e79-9767-4612f34bb92e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d] added
Aug 14 19:56:40 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8428d0e3-a1fc-4597-91b4-6e1fcc32dbb1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[939b2cc3-acb0-41bb-8340-3edda26b4812]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NyJZBnql {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NyJZBnql" returned: 0 in 0.028s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8590a21-38b3-46d6-b862-9d3fb907134b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NyJZBnql'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5492f844-f31e-4522-b3f5-00283994b29d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[641efd65-3151-46e5-8a0c-dea9eca71120]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:40 user nova-compute[72782]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:56:40 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:40 user nova-compute[72782]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:56:40 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b90c97-921a-488f-9254-1cbaada79cec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260]
Aug 14 19:56:40 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260] successful.
Aug 14 19:56:40 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[017bc504-803f-4c09-b0ce-8ac177d0bd60]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c1e8f7-1f3a-4105-bb08-b58830af4c31]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:40 user nova-compute[72782]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:56:40 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:56:40 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:40 user nova-compute[72782]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:56:40 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:56:40 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d1743f-be5b-48d7-be03-a8ed95ad68ac]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:40 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: None {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyJZBnql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26231656538646536', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231656538646536', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-541757814',display_name='tempest-ServerActionsTestOtherB-server-541757814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-541757814',id=17,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAarAxn7T7X51FB9WvWO3LMKvuHfCnYFXmKg73GAqFcCk71N2M9odae+ScSuYIAVSuzCKRu92FXDYUypvnCOyLRjSrxNpiNed5PJ7CB2bOBIRMco4NgzPsIxo+nrGJWEGg==',key_name='tempest-keypair-1073189448',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:54:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b283da9d5774739a1749f7684439c35',ramdisk_id='',reservation_id='r-2esch0g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1314711059',owner_user_name='tempest-ServerActionsTestOtherB-1314711059-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:56:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613ae0366fc5462081f877c1f2c40c7e',uuid=c748103b-a37c-47c5-8394-ea54749f27eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Converting VIF {"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:56:41 user nova-compute[72782]:   <uuid>c748103b-a37c-47c5-8394-ea54749f27eb</uuid>
Aug 14 19:56:41 user nova-compute[72782]:   <name>instance-00000011</name>
Aug 14 19:56:41 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:56:41 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:56:41 user nova-compute[72782]:   <metadata>
Aug 14 19:56:41 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:56:41 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:56:41 user nova-compute[72782]:       <nova:name>tempest-ServerActionsTestOtherB-server-541757814</nova:name>
Aug 14 19:56:41 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:56:39</nova:creationTime>
Aug 14 19:56:41 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:56:41 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:56:41 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:56:41 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:56:41 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:56:41 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:56:41 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:56:41 user nova-compute[72782]:       <nova:owner>
Aug 14 19:56:41 user nova-compute[72782]:         <nova:user uuid="613ae0366fc5462081f877c1f2c40c7e">tempest-ServerActionsTestOtherB-1314711059-project-member</nova:user>
Aug 14 19:56:41 user nova-compute[72782]:         <nova:project uuid="7b283da9d5774739a1749f7684439c35">tempest-ServerActionsTestOtherB-1314711059</nova:project>
Aug 14 19:56:41 user nova-compute[72782]:       </nova:owner>
Aug 14 19:56:41 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:56:41 user nova-compute[72782]:       <nova:ports>
Aug 14 19:56:41 user nova-compute[72782]:         <nova:port uuid="356eefe9-57d0-4af1-b7bd-842e2cfa33d0">
Aug 14 19:56:41 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 19:56:41 user nova-compute[72782]:         </nova:port>
Aug 14 19:56:41 user nova-compute[72782]:       </nova:ports>
Aug 14 19:56:41 user nova-compute[72782]:     </nova:instance>
Aug 14 19:56:41 user nova-compute[72782]:   </metadata>
Aug 14 19:56:41 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:56:41 user nova-compute[72782]:     <system>
Aug 14 19:56:41 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:56:41 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:56:41 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:56:41 user nova-compute[72782]:       <entry name="serial">c748103b-a37c-47c5-8394-ea54749f27eb</entry>
Aug 14 19:56:41 user nova-compute[72782]:       <entry name="uuid">c748103b-a37c-47c5-8394-ea54749f27eb</entry>
Aug 14 19:56:41 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:56:41 user nova-compute[72782]:     </system>
Aug 14 19:56:41 user nova-compute[72782]:   </sysinfo>
Aug 14 19:56:41 user nova-compute[72782]:   <os>
Aug 14 19:56:41 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:56:41 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:56:41 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:56:41 user nova-compute[72782]:   </os>
Aug 14 19:56:41 user nova-compute[72782]:   <features>
Aug 14 19:56:41 user nova-compute[72782]:     <acpi/>
Aug 14 19:56:41 user nova-compute[72782]:     <apic/>
Aug 14 19:56:41 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:56:41 user nova-compute[72782]:   </features>
Aug 14 19:56:41 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:56:41 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:56:41 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:56:41 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:56:41 user nova-compute[72782]:   </clock>
Aug 14 19:56:41 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:56:41 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:56:41 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:56:41 user nova-compute[72782]:   </cpu>
Aug 14 19:56:41 user nova-compute[72782]:   <devices>
Aug 14 19:56:41 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:56:41 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:56:41 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk"/>
Aug 14 19:56:41 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:56:41 user nova-compute[72782]:     </disk>
Aug 14 19:56:41 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 19:56:41 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:56:41 user nova-compute[72782]:       <source dev="/dev/sdb"/>
Aug 14 19:56:41 user nova-compute[72782]:       <target dev="vdb" bus="virtio"/>
Aug 14 19:56:41 user nova-compute[72782]:       <serial>69e9edf2-c2d1-4226-bc9c-3bafe0415b7d</serial>
Aug 14 19:56:41 user nova-compute[72782]:     </disk>
Aug 14 19:56:41 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:56:41 user nova-compute[72782]:       <mac address="fa:16:3e:5f:41:29"/>
Aug 14 19:56:41 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:56:41 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:56:41 user nova-compute[72782]:       <target dev="tap356eefe9-57"/>
Aug 14 19:56:41 user nova-compute[72782]:     </interface>
Aug 14 19:56:41 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:56:41 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/console.log" append="off"/>
Aug 14 19:56:41 user nova-compute[72782]:     </serial>
Aug 14 19:56:41 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:56:41 user nova-compute[72782]:     <video>
Aug 14 19:56:41 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:56:41 user nova-compute[72782]:     </video>
Aug 14 19:56:41 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:56:41 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:56:41 user nova-compute[72782]:     </rng>
Aug 14 19:56:41 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:56:41 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:56:41 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:56:41 user nova-compute[72782]:     </memballoon>
Aug 14 19:56:41 user nova-compute[72782]:   </devices>
Aug 14 19:56:41 user nova-compute[72782]: </domain>
Aug 14 19:56:41 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-541757814',display_name='tempest-ServerActionsTestOtherB-server-541757814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-541757814',id=17,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAarAxn7T7X51FB9WvWO3LMKvuHfCnYFXmKg73GAqFcCk71N2M9odae+ScSuYIAVSuzCKRu92FXDYUypvnCOyLRjSrxNpiNed5PJ7CB2bOBIRMco4NgzPsIxo+nrGJWEGg==',key_name='tempest-keypair-1073189448',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:54:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b283da9d5774739a1749f7684439c35',ramdisk_id='',reservation_id='r-2esch0g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1314711059',owner_user_name='tempest-ServerActionsTestOtherB-1314711059-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:56:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613ae0366fc5462081f877c1f2c40c7e',uuid=c748103b-a37c-47c5-8394-ea54749f27eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Converting VIF {"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG os_vif [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap356eefe9-57, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap356eefe9-57, col_values=(('external_ids', {'iface-id': '356eefe9-57d0-4af1-b7bd-842e2cfa33d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:41:29', 'vm-uuid': 'c748103b-a37c-47c5-8394-ea54749f27eb'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:56:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:41 user nova-compute[72782]: INFO os_vif [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57')
Aug 14 19:56:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Acquiring lock "4702362b-72ca-43b7-aed2-3545a5f13a98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Acquiring lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:42 user nova-compute[72782]: INFO nova.compute.manager [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Terminating instance
Aug 14 19:56:42 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:56:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG nova.compute.manager [req-e52c540c-3f44-44cd-8325-e094fc06cc6f req-b5646b3e-de01-4ede-96f3-81cb122d1979 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received event network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e52c540c-3f44-44cd-8325-e094fc06cc6f req-b5646b3e-de01-4ede-96f3-81cb122d1979 service nova] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e52c540c-3f44-44cd-8325-e094fc06cc6f req-b5646b3e-de01-4ede-96f3-81cb122d1979 service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e52c540c-3f44-44cd-8325-e094fc06cc6f req-b5646b3e-de01-4ede-96f3-81cb122d1979 service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG nova.compute.manager [req-e52c540c-3f44-44cd-8325-e094fc06cc6f req-b5646b3e-de01-4ede-96f3-81cb122d1979 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] No waiting events found dispatching network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:56:43 user nova-compute[72782]: WARNING nova.compute.manager [req-e52c540c-3f44-44cd-8325-e094fc06cc6f req-b5646b3e-de01-4ede-96f3-81cb122d1979 service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received unexpected event network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 for instance with vm_state resized and task_state resize_reverting.
Aug 14 19:56:43 user nova-compute[72782]: DEBUG nova.compute.manager [req-64121bde-292c-4653-aad0-9759fa61b642 req-99722483-8e24-4ffc-947b-bb83e1de7b68 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received event network-vif-unplugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-64121bde-292c-4653-aad0-9759fa61b642 req-99722483-8e24-4ffc-947b-bb83e1de7b68 service nova] Acquiring lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-64121bde-292c-4653-aad0-9759fa61b642 req-99722483-8e24-4ffc-947b-bb83e1de7b68 service nova] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-64121bde-292c-4653-aad0-9759fa61b642 req-99722483-8e24-4ffc-947b-bb83e1de7b68 service nova] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG nova.compute.manager [req-64121bde-292c-4653-aad0-9759fa61b642 req-99722483-8e24-4ffc-947b-bb83e1de7b68 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] No waiting events found dispatching network-vif-unplugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG nova.compute.manager [req-64121bde-292c-4653-aad0-9759fa61b642 req-99722483-8e24-4ffc-947b-bb83e1de7b68 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received event network-vif-unplugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692042988.5459836, c748103b-a37c-47c5-8394-ea54749f27eb => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:56:43 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] VM Stopped (Lifecycle Event)
Aug 14 19:56:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-753c3108-eda0-496c-aed1-057a2e4ed87f None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:56:43 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Instance destroyed successfully.
Aug 14 19:56:43 user nova-compute[72782]: DEBUG nova.objects.instance [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lazy-loading 'resources' on Instance uuid 4702362b-72ca-43b7-aed2-3545a5f13a98 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T19:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1210389445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-746603197',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOegGaETqx1Pztqu1P77PVxvX0dwSMalKmcPN2jtCEazOU38nLPC5/6W1Crj1WtV9Rzil7eKqqLrYgjHm4Eh8onwWMwLp8hfPbbHri4CF+U5X3sE+rRfhsJzXgWjRWix7g==',key_name='tempest-keypair-1783336846',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:55:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d2583e13fbf42a995ad5d30af0e1428',ramdisk_id='',reservation_id='r-ghzpchq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2138678264',owner_user_name='tempest-ServerActionsV293TestJSON-2138678264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:55:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31d2306e51414be6a895a1dc017c782f',uuid=4702362b-72ca-43b7-aed2-3545a5f13a98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "address": "fa:16:3e:ea:ce:52", "network": {"id": "400033aa-00fb-41ff-a23d-7deee12714e7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1338285309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2583e13fbf42a995ad5d30af0e1428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06846aaf-2a", "ovs_interfaceid": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Converting VIF {"id": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "address": "fa:16:3e:ea:ce:52", "network": {"id": "400033aa-00fb-41ff-a23d-7deee12714e7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1338285309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2583e13fbf42a995ad5d30af0e1428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06846aaf-2a", "ovs_interfaceid": "06846aaf-2a0a-4e50-9b81-c4f15943cd28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=06846aaf-2a0a-4e50-9b81-c4f15943cd28,network=Network(400033aa-00fb-41ff-a23d-7deee12714e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06846aaf-2a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_vif [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=06846aaf-2a0a-4e50-9b81-c4f15943cd28,network=Network(400033aa-00fb-41ff-a23d-7deee12714e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06846aaf-2a') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06846aaf-2a, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:56:43 user nova-compute[72782]: INFO os_vif [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=06846aaf-2a0a-4e50-9b81-c4f15943cd28,network=Network(400033aa-00fb-41ff-a23d-7deee12714e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06846aaf-2a')
Aug 14 19:56:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIqUZeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:56:43 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[678ec024-ceab-4418-a7e8-b590ab861720]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[698d0c57-9ca9-410f-8aff-b36f350a29c1]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:43 user nova-compute[72782]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:56:43 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:56:43 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 (non-flash)
Aug 14 19:56:43 user nova-compute[72782]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:56:43 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:56:43 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e84139a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6'): ({'sde'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Removing single pathed devices sde {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eda8847-2b98-4641-b2c4-0c9b8f00a66b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee94ef8-fc1a-4d0d-a2c6-bc3acabb7090]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Flushing IO for device /dev/sde {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c758bd-6c61-4b61-ae59-98ab83c52dfb]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3da8ad-2805-444c-89e0-5df6efa424b5]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] SCSI volumes sde have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c04ba101', '/dev/disk/by-id/scsi-1SCST_BIOc04ba101-1bddcb4445915510', '/dev/disk/by-id/scsi-23162646463623434') {{(pid=83776) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e926e7cf-1082-4a9e-b04f-1bfe25832eeb]: (4, None) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3c3b10-ecb8-4e6c-8352-5841bcf521fa]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c01973c-a14c-45d6-8344-7cb2658a2c21]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6, portal: 172.16.0.220,3260]
Aug 14 19:56:43 user nova-compute[72782]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6, portal: 172.16.0.220,3260] successful.
Aug 14 19:56:43 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3f8e876-2e28-4709-b96b-c5f20ee56ab6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54dcf45-d2db-4244-a1f0-1e7088c18fb4]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] <== disconnect_volume: return (344ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:56:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:56:43 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Deleting instance files /opt/stack/data/nova/instances/4702362b-72ca-43b7-aed2-3545a5f13a98_del
Aug 14 19:56:43 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Deletion of /opt/stack/data/nova/instances/4702362b-72ca-43b7-aed2-3545a5f13a98_del complete
Aug 14 19:56:44 user nova-compute[72782]: INFO nova.compute.manager [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Took 1.37 seconds to destroy the instance on the hypervisor.
Aug 14 19:56:44 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:56:44 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:56:44 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:56:44 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:56:44 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Took 0.86 seconds to deallocate network for instance.
Aug 14 19:56:45 user nova-compute[72782]: DEBUG nova.compute.manager [req-1165ea4f-a1c9-4910-ab17-6fb9ec6d5f00 req-5d47122c-66b3-449b-b343-b04a2982244f service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received event network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:56:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1165ea4f-a1c9-4910-ab17-6fb9ec6d5f00 req-5d47122c-66b3-449b-b343-b04a2982244f service nova] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1165ea4f-a1c9-4910-ab17-6fb9ec6d5f00 req-5d47122c-66b3-449b-b343-b04a2982244f service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1165ea4f-a1c9-4910-ab17-6fb9ec6d5f00 req-5d47122c-66b3-449b-b343-b04a2982244f service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:45 user nova-compute[72782]: DEBUG nova.compute.manager [req-1165ea4f-a1c9-4910-ab17-6fb9ec6d5f00 req-5d47122c-66b3-449b-b343-b04a2982244f service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] No waiting events found dispatching network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:56:45 user nova-compute[72782]: WARNING nova.compute.manager [req-1165ea4f-a1c9-4910-ab17-6fb9ec6d5f00 req-5d47122c-66b3-449b-b343-b04a2982244f service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received unexpected event network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 for instance with vm_state resized and task_state resize_reverting.
Aug 14 19:56:45 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043005.1588902, c748103b-a37c-47c5-8394-ea54749f27eb => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:56:45 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] VM Resumed (Lifecycle Event)
Aug 14 19:56:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:56:45 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Instance running successfully.
Aug 14 19:56:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] finish_revert_migration finished successfully. {{(pid=72782) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 14 19:56:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:56:45 user nova-compute[72782]: DEBUG nova.compute.manager [req-a9cece78-a5ce-4c3e-9085-bb1516fa809c req-c4c50baf-5701-47bd-9d16-ef701d0a5831 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received event network-vif-plugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:56:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a9cece78-a5ce-4c3e-9085-bb1516fa809c req-c4c50baf-5701-47bd-9d16-ef701d0a5831 service nova] Acquiring lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a9cece78-a5ce-4c3e-9085-bb1516fa809c req-c4c50baf-5701-47bd-9d16-ef701d0a5831 service nova] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a9cece78-a5ce-4c3e-9085-bb1516fa809c req-c4c50baf-5701-47bd-9d16-ef701d0a5831 service nova] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:45 user nova-compute[72782]: DEBUG nova.compute.manager [req-a9cece78-a5ce-4c3e-9085-bb1516fa809c req-c4c50baf-5701-47bd-9d16-ef701d0a5831 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] No waiting events found dispatching network-vif-plugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:56:45 user nova-compute[72782]: WARNING nova.compute.manager [req-a9cece78-a5ce-4c3e-9085-bb1516fa809c req-c4c50baf-5701-47bd-9d16-ef701d0a5831 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received unexpected event network-vif-plugged-06846aaf-2a0a-4e50-9b81-c4f15943cd28 for instance with vm_state active and task_state deleting.
Aug 14 19:56:45 user nova-compute[72782]: DEBUG nova.compute.manager [req-a9cece78-a5ce-4c3e-9085-bb1516fa809c req-c4c50baf-5701-47bd-9d16-ef701d0a5831 service nova] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Received event network-vif-deleted-06846aaf-2a0a-4e50-9b81-c4f15943cd28 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:56:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:56:45 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 14 19:56:45 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043005.1603842, c748103b-a37c-47c5-8394-ea54749f27eb => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:56:45 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] VM Started (Lifecycle Event)
Aug 14 19:56:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:56:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:56:45 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 14 19:56:45 user nova-compute[72782]: INFO nova.compute.manager [None req-ce867652-b62a-416e-b5e8-db94e8435953 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Updating instance to original state: 'active'
Aug 14 19:56:45 user nova-compute[72782]: INFO nova.compute.manager [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Took 0.76 seconds to detach 1 volumes for instance.
Aug 14 19:56:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Deleting volume: b3f8e876-2e28-4709-b96b-c5f20ee56ab6 {{(pid=72782) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 19:56:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:46 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:56:46 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:56:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:46 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Deleted allocations for instance 4702362b-72ca-43b7-aed2-3545a5f13a98
Aug 14 19:56:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9bbc96ea-8c7f-4ba2-bd9b-bbb7b65bf8fd tempest-ServerActionsV293TestJSON-2138678264 tempest-ServerActionsV293TestJSON-2138678264-project-member] Lock "4702362b-72ca-43b7-aed2-3545a5f13a98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.650s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:56:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:56:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:56:55 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:56:55 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:56:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:56:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:56:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:56:55 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:56:55 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Updating instance_info_cache with network_info: [{"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:56:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-792f31f1-4079-4443-81f2-b1e364a9ee14" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:56:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:56:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:56:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:56:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:58 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692043003.582647, 4702362b-72ca-43b7-aed2-3545a5f13a98 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:56:58 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] VM Stopped (Lifecycle Event)
Aug 14 19:56:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b0b5197c-57e2-45ac-ae04-595971602c6e None None] [instance: 4702362b-72ca-43b7-aed2-3545a5f13a98] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:56:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:56:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:56:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:56:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:56:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:56:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:56:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:56:59 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:56:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:56:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:56:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:56:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:57:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:02 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:57:02 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:57:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7423MB free_disk=25.42892074584961GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:57:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:57:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 792f31f1-4079-4443-81f2-b1e364a9ee14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:57:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance d0ffe207-a89e-41ef-85af-7927ce06627e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:57:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance e1052af2-5cc1-4d38-9467-032128545267 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:57:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:57:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance a4ae2e60-c4d4-4a7e-826e-fb315fa98138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:57:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance c748103b-a37c-47c5-8394-ea54749f27eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:57:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance f057c9c2-9c75-4c4b-8f95-444f135e4056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:57:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ad4011a9-ab9f-4647-b677-a1c6337d2c2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:57:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:57:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:57:03 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:57:03 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:57:03 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:57:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:04 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:57:04 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:57:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "e1052af2-5cc1-4d38-9467-032128545267" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "e1052af2-5cc1-4d38-9467-032128545267" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "e1052af2-5cc1-4d38-9467-032128545267-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "e1052af2-5cc1-4d38-9467-032128545267-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "e1052af2-5cc1-4d38-9467-032128545267-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:04 user nova-compute[72782]: INFO nova.compute.manager [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Terminating instance
Aug 14 19:57:04 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:57:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-2e5a1426-5e61-47d0-9a4b-a79495b76abf req-1d959277-6ae1-4fd1-9f4b-68c9248c4ff8 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received event network-vif-unplugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:57:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2e5a1426-5e61-47d0-9a4b-a79495b76abf req-1d959277-6ae1-4fd1-9f4b-68c9248c4ff8 service nova] Acquiring lock "e1052af2-5cc1-4d38-9467-032128545267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2e5a1426-5e61-47d0-9a4b-a79495b76abf req-1d959277-6ae1-4fd1-9f4b-68c9248c4ff8 service nova] Lock "e1052af2-5cc1-4d38-9467-032128545267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2e5a1426-5e61-47d0-9a4b-a79495b76abf req-1d959277-6ae1-4fd1-9f4b-68c9248c4ff8 service nova] Lock "e1052af2-5cc1-4d38-9467-032128545267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-2e5a1426-5e61-47d0-9a4b-a79495b76abf req-1d959277-6ae1-4fd1-9f4b-68c9248c4ff8 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] No waiting events found dispatching network-vif-unplugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:57:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-2e5a1426-5e61-47d0-9a4b-a79495b76abf req-1d959277-6ae1-4fd1-9f4b-68c9248c4ff8 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received event network-vif-unplugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:57:05 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: e1052af2-5cc1-4d38-9467-032128545267] Instance destroyed successfully.
Aug 14 19:57:05 user nova-compute[72782]: DEBUG nova.objects.instance [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'resources' on Instance uuid e1052af2-5cc1-4d38-9467-032128545267 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:57:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T19:51:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-490147315',display_name='tempest-ServerActionsTestOtherA-server-1887421973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-490147315',id=19,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV5fiZmeiHTnYtIHzitMZse2ribzsRQ2484EQ9im6HhPR/lFEGGu+BQkl8yoXRtLPpzrj+N0//a8a7yN4uMfP50FthqJ6WC/rfTifEYmo41fdCr/FNWJ/A2uqubY97gOQ==',key_name='tempest-keypair-967502446',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:53:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6c0483a97574e7794c73fe43e51795e',ramdisk_id='',reservation_id='r-c2v7tgso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-956209876',owner_user_name='tempest-ServerActionsTestOtherA-956209876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:53:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a38fa907d804b81903eb97ab88ae181',uuid=e1052af2-5cc1-4d38-9467-032128545267,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "address": "fa:16:3e:e2:66:90", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e90c-96", "ovs_interfaceid": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:57:05 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converting VIF {"id": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "address": "fa:16:3e:e2:66:90", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74e90c-96", "ovs_interfaceid": "aa74e90c-967b-4500-b0a1-9cd530b0e42f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:57:05 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:66:90,bridge_name='br-int',has_traffic_filtering=True,id=aa74e90c-967b-4500-b0a1-9cd530b0e42f,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e90c-96') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:57:05 user nova-compute[72782]: DEBUG os_vif [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:66:90,bridge_name='br-int',has_traffic_filtering=True,id=aa74e90c-967b-4500-b0a1-9cd530b0e42f,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e90c-96') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:57:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa74e90c-96, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:57:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:57:05 user nova-compute[72782]: INFO os_vif [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:66:90,bridge_name='br-int',has_traffic_filtering=True,id=aa74e90c-967b-4500-b0a1-9cd530b0e42f,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74e90c-96')
Aug 14 19:57:05 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Deleting instance files /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267_del
Aug 14 19:57:05 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Deletion of /opt/stack/data/nova/instances/e1052af2-5cc1-4d38-9467-032128545267_del complete
Aug 14 19:57:05 user nova-compute[72782]: INFO nova.compute.manager [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: e1052af2-5cc1-4d38-9467-032128545267] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 14 19:57:05 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:57:05 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: e1052af2-5cc1-4d38-9467-032128545267] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:57:05 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: e1052af2-5cc1-4d38-9467-032128545267] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:57:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:57:05 user nova-compute[72782]: INFO nova.compute.manager [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] instance snapshotting
Aug 14 19:57:05 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Beginning live snapshot process
Aug 14 19:57:06 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: e1052af2-5cc1-4d38-9467-032128545267] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:57:06 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: e1052af2-5cc1-4d38-9467-032128545267] Took 0.91 seconds to deallocate network for instance.
Aug 14 19:57:06 user nova-compute[72782]: DEBUG nova.compute.manager [req-b2c44302-79d1-4913-a30a-e99d2672182e req-5e2a6227-5640-4b8f-ae47-e9d3ced5e6a1 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received event network-vif-deleted-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:57:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json -f qcow2 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json -f qcow2 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:06 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:57:06 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:57:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:06 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Deleted allocations for instance e1052af2-5cc1-4d38-9467-032128545267
Aug 14 19:57:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8f0fc28b-af96-4117-9666-ed086ca9c3b5 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "e1052af2-5cc1-4d38-9467-032128545267" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.395s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.205s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8cte57up/37e217372c0642f7b305ad169fbd1997.delta 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8cte57up/37e217372c0642f7b305ad169fbd1997.delta 1073741824" returned: 0 in 0.069s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:06 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 19:57:07 user nova-compute[72782]: DEBUG nova.compute.manager [req-3889abf1-3ff2-49e2-82f3-b1123e7da2cf req-54e678ba-49c4-42ae-9978-8400c2c42395 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received event network-vif-plugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:57:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3889abf1-3ff2-49e2-82f3-b1123e7da2cf req-54e678ba-49c4-42ae-9978-8400c2c42395 service nova] Acquiring lock "e1052af2-5cc1-4d38-9467-032128545267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3889abf1-3ff2-49e2-82f3-b1123e7da2cf req-54e678ba-49c4-42ae-9978-8400c2c42395 service nova] Lock "e1052af2-5cc1-4d38-9467-032128545267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3889abf1-3ff2-49e2-82f3-b1123e7da2cf req-54e678ba-49c4-42ae-9978-8400c2c42395 service nova] Lock "e1052af2-5cc1-4d38-9467-032128545267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:07 user nova-compute[72782]: DEBUG nova.compute.manager [req-3889abf1-3ff2-49e2-82f3-b1123e7da2cf req-54e678ba-49c4-42ae-9978-8400c2c42395 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] No waiting events found dispatching network-vif-plugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:57:07 user nova-compute[72782]: WARNING nova.compute.manager [req-3889abf1-3ff2-49e2-82f3-b1123e7da2cf req-54e678ba-49c4-42ae-9978-8400c2c42395 service nova] [instance: e1052af2-5cc1-4d38-9467-032128545267] Received unexpected event network-vif-plugged-aa74e90c-967b-4500-b0a1-9cd530b0e42f for instance with vm_state deleted and task_state None.
Aug 14 19:57:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:57:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] COPY block job progress, current cursor: 15859712 final cursor: 75563008 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:57:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 19:57:08 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 19:57:08 user nova-compute[72782]: DEBUG nova.privsep.utils [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72782) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 19:57:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8cte57up/37e217372c0642f7b305ad169fbd1997.delta /opt/stack/data/nova/instances/snapshots/tmp8cte57up/37e217372c0642f7b305ad169fbd1997 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8cte57up/37e217372c0642f7b305ad169fbd1997.delta /opt/stack/data/nova/instances/snapshots/tmp8cte57up/37e217372c0642f7b305ad169fbd1997" returned: 0 in 0.648s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:09 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Snapshot extracted, beginning image upload
Aug 14 19:57:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:11 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Snapshot image upload complete
Aug 14 19:57:11 user nova-compute[72782]: INFO nova.compute.manager [None req-58775e57-c10c-4fee-b05a-5e78fb091437 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Took 5.64 seconds to snapshot the instance on the hypervisor.
Aug 14 19:57:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:57:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:13 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:57:13 user nova-compute[72782]: INFO nova.compute.claims [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Claim successful on node user
Aug 14 19:57:14 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:57:14 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:57:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:57:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:57:14 user nova-compute[72782]: DEBUG nova.network.neutron [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:57:14 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:57:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:57:14 user nova-compute[72782]: DEBUG nova.policy [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d0b98a72a4843beafc4bda85ae07f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23edaa22c50450b9b35fc42fcd4f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:57:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:57:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:57:14 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Creating image(s)
Aug 14 19:57:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "/opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "/opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "/opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "e68f4278b71f57223a2d19d5d6452607d94b2e65" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "e68f4278b71f57223a2d19d5d6452607d94b2e65" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65.part --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:15 user nova-compute[72782]: DEBUG nova.network.neutron [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Successfully created port: 4e700e02-4ab0-47e7-98c5-fab5d76d37a6 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:57:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65.part --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:15 user nova-compute[72782]: DEBUG nova.virt.images [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] 9ba367a2-e9e3-4055-85bc-587369c3d583 was qcow2, converting to raw {{(pid=72782) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 19:57:15 user nova-compute[72782]: DEBUG nova.privsep.utils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72782) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 19:57:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65.part /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65.converted {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65.part /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65.converted" returned: 0 in 0.199s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65.converted --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "e68f4278b71f57223a2d19d5d6452607d94b2e65" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.361s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65 --force-share --output=json" returned: 0 in 0.204s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "e68f4278b71f57223a2d19d5d6452607d94b2e65" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "e68f4278b71f57223a2d19d5d6452607d94b2e65" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65 --force-share --output=json" returned: 0 in 0.168s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65,backing_fmt=raw /opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65,backing_fmt=raw /opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/disk 1073741824" returned: 0 in 0.046s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "e68f4278b71f57223a2d19d5d6452607d94b2e65" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG nova.network.neutron [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Successfully updated port: 4e700e02-4ab0-47e7-98c5-fab5d76d37a6 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG nova.compute.manager [req-25de33ca-278c-4b6a-80e5-ac35e843484e req-8bf0953c-c687-446d-82d4-715cfbdfecab service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Received event network-changed-4e700e02-4ab0-47e7-98c5-fab5d76d37a6 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG nova.compute.manager [req-25de33ca-278c-4b6a-80e5-ac35e843484e req-8bf0953c-c687-446d-82d4-715cfbdfecab service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Refreshing instance network info cache due to event network-changed-4e700e02-4ab0-47e7-98c5-fab5d76d37a6. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-25de33ca-278c-4b6a-80e5-ac35e843484e req-8bf0953c-c687-446d-82d4-715cfbdfecab service nova] Acquiring lock "refresh_cache-64face75-3aba-4cb8-8ff2-a1bbdf9835e1" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-25de33ca-278c-4b6a-80e5-ac35e843484e req-8bf0953c-c687-446d-82d4-715cfbdfecab service nova] Acquired lock "refresh_cache-64face75-3aba-4cb8-8ff2-a1bbdf9835e1" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG nova.network.neutron [req-25de33ca-278c-4b6a-80e5-ac35e843484e req-8bf0953c-c687-446d-82d4-715cfbdfecab service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Refreshing network info cache for port 4e700e02-4ab0-47e7-98c5-fab5d76d37a6 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "refresh_cache-64face75-3aba-4cb8-8ff2-a1bbdf9835e1" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG nova.network.neutron [req-25de33ca-278c-4b6a-80e5-ac35e843484e req-8bf0953c-c687-446d-82d4-715cfbdfecab service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65 --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG nova.objects.instance [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lazy-loading 'migration_context' on Instance uuid 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Ensure instance console log exists: /opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG nova.network.neutron [req-25de33ca-278c-4b6a-80e5-ac35e843484e req-8bf0953c-c687-446d-82d4-715cfbdfecab service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-25de33ca-278c-4b6a-80e5-ac35e843484e req-8bf0953c-c687-446d-82d4-715cfbdfecab service nova] Releasing lock "refresh_cache-64face75-3aba-4cb8-8ff2-a1bbdf9835e1" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquired lock "refresh_cache-64face75-3aba-4cb8-8ff2-a1bbdf9835e1" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG nova.network.neutron [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:57:16 user nova-compute[72782]: DEBUG nova.network.neutron [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.network.neutron [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Updating instance_info_cache with network_info: [{"id": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "address": "fa:16:3e:6f:8e:bd", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e700e02-4a", "ovs_interfaceid": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Releasing lock "refresh_cache-64face75-3aba-4cb8-8ff2-a1bbdf9835e1" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Instance network_info: |[{"id": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "address": "fa:16:3e:6f:8e:bd", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e700e02-4a", "ovs_interfaceid": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Start _get_guest_xml network_info=[{"id": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "address": "fa:16:3e:6f:8e:bd", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e700e02-4a", "ovs_interfaceid": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ed0bff1dbf1d97fa31680a98fb8aba3d',container_format='bare',created_at=2023-08-14T19:57:06Z,direct_url=<?>,disk_format='qcow2',id=9ba367a2-e9e3-4055-85bc-587369c3d583,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2112283971',owner='b23edaa22c50450b9b35fc42fcd4f59f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T19:57:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '9ba367a2-e9e3-4055-85bc-587369c3d583'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:57:17 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:57:17 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ed0bff1dbf1d97fa31680a98fb8aba3d',container_format='bare',created_at=2023-08-14T19:57:06Z,direct_url=<?>,disk_format='qcow2',id=9ba367a2-e9e3-4055-85bc-587369c3d583,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2112283971',owner='b23edaa22c50450b9b35fc42fcd4f59f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T19:57:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1908923615',display_name='tempest-TestStampPattern-server-1908923615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1908923615',id=27,image_ref='9ba367a2-e9e3-4055-85bc-587369c3d583',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM83rJpi+PWJVg1bcMN9+UzFWK7I+4X1gYs6cuilTIZnJOuWki/JRMmqnsb5/j9U7gZMW4Fb1jbj8E3oTngmEYniu5bxs0zhFngi/h3GEmcDqt3L25ZYVeHugUHVbYP8eA==',key_name='tempest-TestStampPattern-666114121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b23edaa22c50450b9b35fc42fcd4f59f',ramdisk_id='',reservation_id='r-qabfshzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a4ae2e60-c4d4-4a7e-826e-fb315fa98138',image_min_disk='1',image_min_ram='0',image_owner_id='b23edaa22c50450b9b35fc42fcd4f59f',image_owner_project_name='tempest-TestStampPattern-890299113',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-890299113-project-member',image_user_id='9d0b98a72a4843beafc4bda85ae07f61',network_allocated='True',owner_project_name='tempest-TestStampPattern-890299113',owner_user_name='tempest-TestStampPattern-890299113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:57:14Z,user_data=None,user_id='9d0b98a72a4843beafc4bda85ae07f61',uuid=64face75-3aba-4cb8-8ff2-a1bbdf9835e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "address": "fa:16:3e:6f:8e:bd", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e700e02-4a", "ovs_interfaceid": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Converting VIF {"id": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "address": "fa:16:3e:6f:8e:bd", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e700e02-4a", "ovs_interfaceid": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:8e:bd,bridge_name='br-int',has_traffic_filtering=True,id=4e700e02-4ab0-47e7-98c5-fab5d76d37a6,network=Network(6cd1aff4-7785-41f1-8881-49783a46d7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e700e02-4a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.objects.instance [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lazy-loading 'pci_devices' on Instance uuid 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:57:17 user nova-compute[72782]:   <uuid>64face75-3aba-4cb8-8ff2-a1bbdf9835e1</uuid>
Aug 14 19:57:17 user nova-compute[72782]:   <name>instance-0000001b</name>
Aug 14 19:57:17 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:57:17 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:57:17 user nova-compute[72782]:   <metadata>
Aug 14 19:57:17 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:57:17 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:57:17 user nova-compute[72782]:       <nova:name>tempest-TestStampPattern-server-1908923615</nova:name>
Aug 14 19:57:17 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:57:17</nova:creationTime>
Aug 14 19:57:17 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:57:17 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:57:17 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:57:17 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:57:17 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:57:17 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:57:17 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:57:17 user nova-compute[72782]:       <nova:owner>
Aug 14 19:57:17 user nova-compute[72782]:         <nova:user uuid="9d0b98a72a4843beafc4bda85ae07f61">tempest-TestStampPattern-890299113-project-member</nova:user>
Aug 14 19:57:17 user nova-compute[72782]:         <nova:project uuid="b23edaa22c50450b9b35fc42fcd4f59f">tempest-TestStampPattern-890299113</nova:project>
Aug 14 19:57:17 user nova-compute[72782]:       </nova:owner>
Aug 14 19:57:17 user nova-compute[72782]:       <nova:root type="image" uuid="9ba367a2-e9e3-4055-85bc-587369c3d583"/>
Aug 14 19:57:17 user nova-compute[72782]:       <nova:ports>
Aug 14 19:57:17 user nova-compute[72782]:         <nova:port uuid="4e700e02-4ab0-47e7-98c5-fab5d76d37a6">
Aug 14 19:57:17 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 19:57:17 user nova-compute[72782]:         </nova:port>
Aug 14 19:57:17 user nova-compute[72782]:       </nova:ports>
Aug 14 19:57:17 user nova-compute[72782]:     </nova:instance>
Aug 14 19:57:17 user nova-compute[72782]:   </metadata>
Aug 14 19:57:17 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:57:17 user nova-compute[72782]:     <system>
Aug 14 19:57:17 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:57:17 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:57:17 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:57:17 user nova-compute[72782]:       <entry name="serial">64face75-3aba-4cb8-8ff2-a1bbdf9835e1</entry>
Aug 14 19:57:17 user nova-compute[72782]:       <entry name="uuid">64face75-3aba-4cb8-8ff2-a1bbdf9835e1</entry>
Aug 14 19:57:17 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:57:17 user nova-compute[72782]:     </system>
Aug 14 19:57:17 user nova-compute[72782]:   </sysinfo>
Aug 14 19:57:17 user nova-compute[72782]:   <os>
Aug 14 19:57:17 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:57:17 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:57:17 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:57:17 user nova-compute[72782]:   </os>
Aug 14 19:57:17 user nova-compute[72782]:   <features>
Aug 14 19:57:17 user nova-compute[72782]:     <acpi/>
Aug 14 19:57:17 user nova-compute[72782]:     <apic/>
Aug 14 19:57:17 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:57:17 user nova-compute[72782]:   </features>
Aug 14 19:57:17 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:57:17 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:57:17 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:57:17 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:57:17 user nova-compute[72782]:   </clock>
Aug 14 19:57:17 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:57:17 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:57:17 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:57:17 user nova-compute[72782]:   </cpu>
Aug 14 19:57:17 user nova-compute[72782]:   <devices>
Aug 14 19:57:17 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:57:17 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:57:17 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/disk"/>
Aug 14 19:57:17 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:57:17 user nova-compute[72782]:     </disk>
Aug 14 19:57:17 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:57:17 user nova-compute[72782]:       <mac address="fa:16:3e:6f:8e:bd"/>
Aug 14 19:57:17 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:57:17 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:57:17 user nova-compute[72782]:       <target dev="tap4e700e02-4a"/>
Aug 14 19:57:17 user nova-compute[72782]:     </interface>
Aug 14 19:57:17 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:57:17 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/console.log" append="off"/>
Aug 14 19:57:17 user nova-compute[72782]:     </serial>
Aug 14 19:57:17 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:57:17 user nova-compute[72782]:     <video>
Aug 14 19:57:17 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:57:17 user nova-compute[72782]:     </video>
Aug 14 19:57:17 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:57:17 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:57:17 user nova-compute[72782]:     </rng>
Aug 14 19:57:17 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:57:17 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:57:17 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:57:17 user nova-compute[72782]:     </memballoon>
Aug 14 19:57:17 user nova-compute[72782]:   </devices>
Aug 14 19:57:17 user nova-compute[72782]: </domain>
Aug 14 19:57:17 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1908923615',display_name='tempest-TestStampPattern-server-1908923615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1908923615',id=27,image_ref='9ba367a2-e9e3-4055-85bc-587369c3d583',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM83rJpi+PWJVg1bcMN9+UzFWK7I+4X1gYs6cuilTIZnJOuWki/JRMmqnsb5/j9U7gZMW4Fb1jbj8E3oTngmEYniu5bxs0zhFngi/h3GEmcDqt3L25ZYVeHugUHVbYP8eA==',key_name='tempest-TestStampPattern-666114121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b23edaa22c50450b9b35fc42fcd4f59f',ramdisk_id='',reservation_id='r-qabfshzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a4ae2e60-c4d4-4a7e-826e-fb315fa98138',image_min_disk='1',image_min_ram='0',image_owner_id='b23edaa22c50450b9b35fc42fcd4f59f',image_owner_project_name='tempest-TestStampPattern-890299113',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-890299113-project-member',image_user_id='9d0b98a72a4843beafc4bda85ae07f61',network_allocated='True',owner_project_name='tempest-TestStampPattern-890299113',owner_user_name='tempest-TestStampPattern-890299113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:57:14Z,user_data=None,user_id='9d0b98a72a4843beafc4bda85ae07f61',uuid=64face75-3aba-4cb8-8ff2-a1bbdf9835e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "address": "fa:16:3e:6f:8e:bd", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e700e02-4a", "ovs_interfaceid": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Converting VIF {"id": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "address": "fa:16:3e:6f:8e:bd", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e700e02-4a", "ovs_interfaceid": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:8e:bd,bridge_name='br-int',has_traffic_filtering=True,id=4e700e02-4ab0-47e7-98c5-fab5d76d37a6,network=Network(6cd1aff4-7785-41f1-8881-49783a46d7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e700e02-4a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG os_vif [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:8e:bd,bridge_name='br-int',has_traffic_filtering=True,id=4e700e02-4ab0-47e7-98c5-fab5d76d37a6,network=Network(6cd1aff4-7785-41f1-8881-49783a46d7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e700e02-4a') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e700e02-4a, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4e700e02-4a, col_values=(('external_ids', {'iface-id': '4e700e02-4ab0-47e7-98c5-fab5d76d37a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:8e:bd', 'vm-uuid': '64face75-3aba-4cb8-8ff2-a1bbdf9835e1'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:17 user nova-compute[72782]: INFO os_vif [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:8e:bd,bridge_name='br-int',has_traffic_filtering=True,id=4e700e02-4ab0-47e7-98c5-fab5d76d37a6,network=Network(6cd1aff4-7785-41f1-8881-49783a46d7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e700e02-4a')
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:57:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] No VIF found with MAC fa:16:3e:6f:8e:bd, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:57:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:18 user nova-compute[72782]: DEBUG nova.compute.manager [req-10391b6c-2529-4e89-a5a9-05d535c44dfa req-964bd14c-2b69-4f62-bc49-95c97ad7e1f9 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Received event network-vif-plugged-4e700e02-4ab0-47e7-98c5-fab5d76d37a6 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:57:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-10391b6c-2529-4e89-a5a9-05d535c44dfa req-964bd14c-2b69-4f62-bc49-95c97ad7e1f9 service nova] Acquiring lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-10391b6c-2529-4e89-a5a9-05d535c44dfa req-964bd14c-2b69-4f62-bc49-95c97ad7e1f9 service nova] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-10391b6c-2529-4e89-a5a9-05d535c44dfa req-964bd14c-2b69-4f62-bc49-95c97ad7e1f9 service nova] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:18 user nova-compute[72782]: DEBUG nova.compute.manager [req-10391b6c-2529-4e89-a5a9-05d535c44dfa req-964bd14c-2b69-4f62-bc49-95c97ad7e1f9 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] No waiting events found dispatching network-vif-plugged-4e700e02-4ab0-47e7-98c5-fab5d76d37a6 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:57:18 user nova-compute[72782]: WARNING nova.compute.manager [req-10391b6c-2529-4e89-a5a9-05d535c44dfa req-964bd14c-2b69-4f62-bc49-95c97ad7e1f9 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Received unexpected event network-vif-plugged-4e700e02-4ab0-47e7-98c5-fab5d76d37a6 for instance with vm_state building and task_state spawning.
Aug 14 19:57:20 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692043025.1556542, e1052af2-5cc1-4d38-9467-032128545267 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:57:20 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: e1052af2-5cc1-4d38-9467-032128545267] VM Stopped (Lifecycle Event)
Aug 14 19:57:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5ff88827-eb7e-43f4-b4c7-2a405052a4f7 None None] [instance: e1052af2-5cc1-4d38-9467-032128545267] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:20 user nova-compute[72782]: INFO nova.compute.manager [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Terminating instance
Aug 14 19:57:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043040.7557416, 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:57:20 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] VM Resumed (Lifecycle Event)
Aug 14 19:57:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:57:20 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Instance spawned successfully.
Aug 14 19:57:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:20 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:57:20 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043040.7573824, 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:57:20 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] VM Started (Lifecycle Event)
Aug 14 19:57:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:20 user nova-compute[72782]: INFO nova.compute.manager [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Took 6.21 seconds to spawn the instance on the hypervisor.
Aug 14 19:57:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:57:20 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:57:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-e245370f-8bb8-414e-a4d2-e9677c91074e req-19affb34-684f-45ca-a7b0-08de1234b49a service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Received event network-vif-plugged-4e700e02-4ab0-47e7-98c5-fab5d76d37a6 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e245370f-8bb8-414e-a4d2-e9677c91074e req-19affb34-684f-45ca-a7b0-08de1234b49a service nova] Acquiring lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e245370f-8bb8-414e-a4d2-e9677c91074e req-19affb34-684f-45ca-a7b0-08de1234b49a service nova] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e245370f-8bb8-414e-a4d2-e9677c91074e req-19affb34-684f-45ca-a7b0-08de1234b49a service nova] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-e245370f-8bb8-414e-a4d2-e9677c91074e req-19affb34-684f-45ca-a7b0-08de1234b49a service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] No waiting events found dispatching network-vif-plugged-4e700e02-4ab0-47e7-98c5-fab5d76d37a6 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:57:20 user nova-compute[72782]: WARNING nova.compute.manager [req-e245370f-8bb8-414e-a4d2-e9677c91074e req-19affb34-684f-45ca-a7b0-08de1234b49a service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Received unexpected event network-vif-plugged-4e700e02-4ab0-47e7-98c5-fab5d76d37a6 for instance with vm_state building and task_state spawning.
Aug 14 19:57:20 user nova-compute[72782]: INFO nova.compute.manager [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Took 7.05 seconds to build instance.
Aug 14 19:57:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9d168482-df89-401d-a402-3b7bd9756a61 tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.157s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-188d078d-cb58-4784-98a7-efa08fec79c9 req-d69343d8-eb9b-4f07-aa0e-ee5d14295fa3 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received event network-vif-unplugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:57:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-188d078d-cb58-4784-98a7-efa08fec79c9 req-d69343d8-eb9b-4f07-aa0e-ee5d14295fa3 service nova] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-188d078d-cb58-4784-98a7-efa08fec79c9 req-d69343d8-eb9b-4f07-aa0e-ee5d14295fa3 service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-188d078d-cb58-4784-98a7-efa08fec79c9 req-d69343d8-eb9b-4f07-aa0e-ee5d14295fa3 service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-188d078d-cb58-4784-98a7-efa08fec79c9 req-d69343d8-eb9b-4f07-aa0e-ee5d14295fa3 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] No waiting events found dispatching network-vif-unplugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:57:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-188d078d-cb58-4784-98a7-efa08fec79c9 req-d69343d8-eb9b-4f07-aa0e-ee5d14295fa3 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received event network-vif-unplugged-5fae61f6-03b8-4f93-8719-be8733d8590c for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:57:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Instance destroyed successfully.
Aug 14 19:57:21 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lazy-loading 'resources' on Instance uuid 792f31f1-4079-4443-81f2-b1e364a9ee14 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:57:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:50:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1266743551',display_name='tempest-ServerStableDeviceRescueTest-server-1266743551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1266743551',id=16,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSok8m3pECKylKQt4YbbZRBTqI/K6QdxgBYm6xS5vItg57TPvNxoDIiZG9IxLRCkXCktrW8ZYajxM3mSjn3o49kO+4ovNEETfwGQPkB2hcGmJRPHkPrqcDv4Htsp18h0Q==',key_name='tempest-keypair-18432526',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:54:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='298cebe33d4c4fc8bbe40ba77d058f64',ramdisk_id='',reservation_id='r-isa0e3fk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2103058258',owner_user_name='tempest-ServerStableDeviceRescueTest-2103058258-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:56:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa289079a7d841e98ee102cd64235e92',uuid=792f31f1-4079-4443-81f2-b1e364a9ee14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:57:21 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Converting VIF {"id": "5fae61f6-03b8-4f93-8719-be8733d8590c", "address": "fa:16:3e:5d:85:34", "network": {"id": "86853807-fa05-438d-9f70-cca7e9ed06bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341368521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "298cebe33d4c4fc8bbe40ba77d058f64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fae61f6-03", "ovs_interfaceid": "5fae61f6-03b8-4f93-8719-be8733d8590c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:57:21 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:85:34,bridge_name='br-int',has_traffic_filtering=True,id=5fae61f6-03b8-4f93-8719-be8733d8590c,network=Network(86853807-fa05-438d-9f70-cca7e9ed06bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fae61f6-03') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:57:21 user nova-compute[72782]: DEBUG os_vif [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:85:34,bridge_name='br-int',has_traffic_filtering=True,id=5fae61f6-03b8-4f93-8719-be8733d8590c,network=Network(86853807-fa05-438d-9f70-cca7e9ed06bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fae61f6-03') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:57:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fae61f6-03, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:57:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:21 user nova-compute[72782]: INFO os_vif [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:85:34,bridge_name='br-int',has_traffic_filtering=True,id=5fae61f6-03b8-4f93-8719-be8733d8590c,network=Network(86853807-fa05-438d-9f70-cca7e9ed06bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fae61f6-03')
Aug 14 19:57:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Deleting instance files /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14_del
Aug 14 19:57:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Deletion of /opt/stack/data/nova/instances/792f31f1-4079-4443-81f2-b1e364a9ee14_del complete
Aug 14 19:57:21 user nova-compute[72782]: INFO nova.compute.manager [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 14 19:57:21 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:57:21 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:57:21 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:57:22 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:57:22 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Took 0.76 seconds to deallocate network for instance.
Aug 14 19:57:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:22 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:57:22 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:57:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:22 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Deleted allocations for instance 792f31f1-4079-4443-81f2-b1e364a9ee14
Aug 14 19:57:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fa5e0c99-a6d8-4e07-8e01-6598da15d59c tempest-ServerStableDeviceRescueTest-2103058258 tempest-ServerStableDeviceRescueTest-2103058258-project-member] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.181s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-e6770cef-0e77-4aec-8a6c-43251f16e374 req-7f525794-4486-46ef-aec5-a4466c591288 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received event network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:57:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e6770cef-0e77-4aec-8a6c-43251f16e374 req-7f525794-4486-46ef-aec5-a4466c591288 service nova] Acquiring lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e6770cef-0e77-4aec-8a6c-43251f16e374 req-7f525794-4486-46ef-aec5-a4466c591288 service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e6770cef-0e77-4aec-8a6c-43251f16e374 req-7f525794-4486-46ef-aec5-a4466c591288 service nova] Lock "792f31f1-4079-4443-81f2-b1e364a9ee14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-e6770cef-0e77-4aec-8a6c-43251f16e374 req-7f525794-4486-46ef-aec5-a4466c591288 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] No waiting events found dispatching network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:57:23 user nova-compute[72782]: WARNING nova.compute.manager [req-e6770cef-0e77-4aec-8a6c-43251f16e374 req-7f525794-4486-46ef-aec5-a4466c591288 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received unexpected event network-vif-plugged-5fae61f6-03b8-4f93-8719-be8733d8590c for instance with vm_state deleted and task_state None.
Aug 14 19:57:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-e6770cef-0e77-4aec-8a6c-43251f16e374 req-7f525794-4486-46ef-aec5-a4466c591288 service nova] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Received event network-vif-deleted-5fae61f6-03b8-4f93-8719-be8733d8590c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:57:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:57:36 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692043041.4446523, 792f31f1-4079-4443-81f2-b1e364a9ee14 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:57:36 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] VM Stopped (Lifecycle Event)
Aug 14 19:57:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-29870e87-be0d-4568-ac88-4bf01d74d3fe None None] [instance: 792f31f1-4079-4443-81f2-b1e364a9ee14] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:57:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:57:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-fc5e274b-8e5a-42c6-9307-e300fc087e8e req-18f80b56-a691-452d-92ab-780dec6da4da service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Received event network-changed-4a2c9016-fb98-43d4-8d02-ccc26f4698bb {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:57:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-fc5e274b-8e5a-42c6-9307-e300fc087e8e req-18f80b56-a691-452d-92ab-780dec6da4da service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Refreshing instance network info cache due to event network-changed-4a2c9016-fb98-43d4-8d02-ccc26f4698bb. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:57:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fc5e274b-8e5a-42c6-9307-e300fc087e8e req-18f80b56-a691-452d-92ab-780dec6da4da service nova] Acquiring lock "refresh_cache-f057c9c2-9c75-4c4b-8f95-444f135e4056" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:57:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fc5e274b-8e5a-42c6-9307-e300fc087e8e req-18f80b56-a691-452d-92ab-780dec6da4da service nova] Acquired lock "refresh_cache-f057c9c2-9c75-4c4b-8f95-444f135e4056" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:57:52 user nova-compute[72782]: DEBUG nova.network.neutron [req-fc5e274b-8e5a-42c6-9307-e300fc087e8e req-18f80b56-a691-452d-92ab-780dec6da4da service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Refreshing network info cache for port 4a2c9016-fb98-43d4-8d02-ccc26f4698bb {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:57:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:57:53 user nova-compute[72782]: DEBUG nova.network.neutron [req-fc5e274b-8e5a-42c6-9307-e300fc087e8e req-18f80b56-a691-452d-92ab-780dec6da4da service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Updated VIF entry in instance network info cache for port 4a2c9016-fb98-43d4-8d02-ccc26f4698bb. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:57:53 user nova-compute[72782]: DEBUG nova.network.neutron [req-fc5e274b-8e5a-42c6-9307-e300fc087e8e req-18f80b56-a691-452d-92ab-780dec6da4da service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Updating instance_info_cache with network_info: [{"id": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "address": "fa:16:3e:43:c6:df", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c9016-fb", "ovs_interfaceid": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:57:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fc5e274b-8e5a-42c6-9307-e300fc087e8e req-18f80b56-a691-452d-92ab-780dec6da4da service nova] Releasing lock "refresh_cache-f057c9c2-9c75-4c4b-8f95-444f135e4056" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "f057c9c2-9c75-4c4b-8f95-444f135e4056" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG nova.objects.instance [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'flavor' on Instance uuid f057c9c2-9c75-4c4b-8f95-444f135e4056 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "f057c9c2-9c75-4c4b-8f95-444f135e4056" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:56 user nova-compute[72782]: INFO nova.compute.manager [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Attaching volume 4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f to /dev/vdb
Aug 14 19:57:56 user nova-compute[72782]: DEBUG os_brick.utils [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[936e7b23-0bbb-4829-8909-6412a1be8d44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb38cde5-f26a-4bfe-b1aa-af6954f70044]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[86244054-5230-44d9-acb7-954030d66266]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d03d41-afa3-4778-9872-09158bfe0d65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:57:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:57:57 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:57:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65951f2-c78d-4d8e-a592-342fc341869f]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG os_brick.utils [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Updating existing volume attachment record: 7c2da7dc-ff8b-40f6-8f0f-610803c24837 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:57:57 user nova-compute[72782]: INFO nova.compute.manager [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Rescuing
Aug 14 19:57:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "refresh_cache-ad4011a9-ab9f-4647-b677-a1c6337d2c2c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquired lock "refresh_cache-ad4011a9-ab9f-4647-b677-a1c6337d2c2c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG nova.network.neutron [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG nova.network.neutron [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Updating instance_info_cache with network_info: [{"id": "2858462d-1715-4c67-aee3-a0c15eac235b", "address": "fa:16:3e:f1:85:57", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2858462d-17", "ovs_interfaceid": "2858462d-1715-4c67-aee3-a0c15eac235b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Releasing lock "refresh_cache-ad4011a9-ab9f-4647-b677-a1c6337d2c2c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Updating instance_info_cache with network_info: [{"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-c748103b-a37c-47c5-8394-ea54749f27eb" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:57:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:57:58 user nova-compute[72782]: DEBUG nova.compute.manager [req-70607eb6-1066-4c49-b96c-5c66f123dc52 req-c79d9755-6e0e-4af4-82bd-ca0caa98e0d4 service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received event network-vif-unplugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:57:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-70607eb6-1066-4c49-b96c-5c66f123dc52 req-c79d9755-6e0e-4af4-82bd-ca0caa98e0d4 service nova] Acquiring lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-70607eb6-1066-4c49-b96c-5c66f123dc52 req-c79d9755-6e0e-4af4-82bd-ca0caa98e0d4 service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-70607eb6-1066-4c49-b96c-5c66f123dc52 req-c79d9755-6e0e-4af4-82bd-ca0caa98e0d4 service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:58 user nova-compute[72782]: DEBUG nova.compute.manager [req-70607eb6-1066-4c49-b96c-5c66f123dc52 req-c79d9755-6e0e-4af4-82bd-ca0caa98e0d4 service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] No waiting events found dispatching network-vif-unplugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:57:58 user nova-compute[72782]: WARNING nova.compute.manager [req-70607eb6-1066-4c49-b96c-5c66f123dc52 req-c79d9755-6e0e-4af4-82bd-ca0caa98e0d4 service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received unexpected event network-vif-unplugged-2858462d-1715-4c67-aee3-a0c15eac235b for instance with vm_state active and task_state rescuing.
Aug 14 19:57:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:57:58 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Instance destroyed successfully.
Aug 14 19:57:58 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Attempting a stable device rescue
Aug 14 19:57:58 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72782) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 19:57:58 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Instance directory exists: not creating {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 19:57:58 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Creating image(s)
Aug 14 19:57:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "/opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "/opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:57:58 user nova-compute[72782]: DEBUG nova.objects.instance [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'trusted_certs' on Instance uuid ad4011a9-ab9f-4647-b677-a1c6337d2c2c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:57:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "1b064ad33aca857b6604904004add257f9390c7f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:57:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "1b064ad33aca857b6604904004add257f9390c7f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:57:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b064ad33aca857b6604904004add257f9390c7f.part --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:57:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b064ad33aca857b6604904004add257f9390c7f.part --force-share --output=json" returned: 0 in 0.185s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:57:59 user nova-compute[72782]: DEBUG nova.virt.images [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] d5ddda01-2d1f-40de-baca-cd7009f89773 was qcow2, converting to raw {{(pid=72782) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 19:57:59 user nova-compute[72782]: DEBUG nova.privsep.utils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72782) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 19:57:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1b064ad33aca857b6604904004add257f9390c7f.part /opt/stack/data/nova/instances/_base/1b064ad33aca857b6604904004add257f9390c7f.converted {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-d990662a-00b0-4c98-9f3a-a2dbe99f22f4 req-19292be0-f024-499d-b0fb-0966fbeef06b service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received event network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d990662a-00b0-4c98-9f3a-a2dbe99f22f4 req-19292be0-f024-499d-b0fb-0966fbeef06b service nova] Acquiring lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d990662a-00b0-4c98-9f3a-a2dbe99f22f4 req-19292be0-f024-499d-b0fb-0966fbeef06b service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d990662a-00b0-4c98-9f3a-a2dbe99f22f4 req-19292be0-f024-499d-b0fb-0966fbeef06b service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-d990662a-00b0-4c98-9f3a-a2dbe99f22f4 req-19292be0-f024-499d-b0fb-0966fbeef06b service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] No waiting events found dispatching network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:58:00 user nova-compute[72782]: WARNING nova.compute.manager [req-d990662a-00b0-4c98-9f3a-a2dbe99f22f4 req-19292be0-f024-499d-b0fb-0966fbeef06b service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received unexpected event network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b for instance with vm_state active and task_state rescuing.
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1b064ad33aca857b6604904004add257f9390c7f.part /opt/stack/data/nova/instances/_base/1b064ad33aca857b6604904004add257f9390c7f.converted" returned: 0 in 0.752s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b064ad33aca857b6604904004add257f9390c7f.converted --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b064ad33aca857b6604904004add257f9390c7f.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "1b064ad33aca857b6604904004add257f9390c7f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.205s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "1b064ad33aca857b6604904004add257f9390c7f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "1b064ad33aca857b6604904004add257f9390c7f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b064ad33aca857b6604904004add257f9390c7f --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b064ad33aca857b6604904004add257f9390c7f --force-share --output=json" returned: 0 in 0.189s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1b064ad33aca857b6604904004add257f9390c7f,backing_fmt=raw /opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c/disk.rescue {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1b064ad33aca857b6604904004add257f9390c7f,backing_fmt=raw /opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c/disk.rescue" returned: 0 in 0.053s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "1b064ad33aca857b6604904004add257f9390c7f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG nova.objects.instance [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'migration_context' on Instance uuid ad4011a9-ab9f-4647-b677-a1c6337d2c2c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Start _get_guest_xml network_info=[{"id": "2858462d-1715-4c67-aee3-a0c15eac235b", "address": "fa:16:3e:f1:85:57", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "vif_mac": "fa:16:3e:f1:85:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2858462d-17", "ovs_interfaceid": "2858462d-1715-4c67-aee3-a0c15eac235b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd5ddda01-2d1f-40de-baca-cd7009f89773', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '49180b9b-9125-42b2-9f9b-abd55c23f34c', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAyaHErp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'ad4011a9-ab9f-4647-b677-a1c6337d2c2c', 'attached_at': '', 'detached_at': '', 'volume_id': '29d8d5e8-35a6-4a5b-86f8-bb40c3282801', 'serial': '29d8d5e8-35a6-4a5b-86f8-bb40c3282801'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG nova.objects.instance [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'resources' on Instance uuid ad4011a9-ab9f-4647-b677-a1c6337d2c2c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.objects.instance [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'numa_topology' on Instance uuid ad4011a9-ab9f-4647-b677-a1c6337d2c2c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:58:01 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:58:01 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.objects.instance [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'vcpu_model' on Instance uuid ad4011a9-ab9f-4647-b677-a1c6337d2c2c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAyaHErp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:58:01 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:58:01 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:58:01 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84cb89d-ef83-4ada-98a8-6bf9d031a31e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = tAyaHErp\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 19:58:01 user nova-compute[72782]: node.name = iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801
Aug 14 19:58:01 user nova-compute[72782]: node.tpgt = -1
Aug 14 19:58:01 user nova-compute[72782]: node.startup = automatic
Aug 14 19:58:01 user nova-compute[72782]: node.leading_login = No
Aug 14 19:58:01 user nova-compute[72782]: iface.iscsi_ifacename = default
Aug 14 19:58:01 user nova-compute[72782]: iface.net_ifacename = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.ipaddress = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.prefix_len = 0
Aug 14 19:58:01 user nova-compute[72782]: iface.hwaddress = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.transport_name = tcp
Aug 14 19:58:01 user nova-compute[72782]: iface.initiatorname = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.state = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.vlan_id = 0
Aug 14 19:58:01 user nova-compute[72782]: iface.vlan_priority = 0
Aug 14 19:58:01 user nova-compute[72782]: iface.vlan_state = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.iface_num = 0
Aug 14 19:58:01 user nova-compute[72782]: iface.mtu = 0
Aug 14 19:58:01 user nova-compute[72782]: iface.port = 0
Aug 14 19:58:01 user nova-compute[72782]: iface.bootproto = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.subnet_mask = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.gateway = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.dhcp_alt_client_id = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.dhcp_dns = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.dhcp_learn_iqn = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.dhcp_vendor_id_state = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.dhcp_vendor_id = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.dhcp_slp_da = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.fragmentation = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.gratuitous_arp = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.incoming_forwarding = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.tos_state = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.tos = 0
Aug 14 19:58:01 user nova-compute[72782]: iface.ttl = 0
Aug 14 19:58:01 user nova-compute[72782]: iface.delayed_ack = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.tcp_nagle = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.tcp_wsf_state = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.tcp_wsf = 0
Aug 14 19:58:01 user nova-compute[72782]: iface.tcp_timer_scale = 0
Aug 14 19:58:01 user nova-compute[72782]: iface.tcp_timestamp = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.redirect = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.def_task_mgmt_timeout = 0
Aug 14 19:58:01 user nova-compute[72782]: iface.header_digest = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.data_digest = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.immediate_data = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.initial_r2t = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.data_seq_inorder = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.data_pdu_inorder = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.erl = 0
Aug 14 19:58:01 user nova-compute[72782]: iface.max_receive_data_len = 0
Aug 14 19:58:01 user nova-compute[72782]: iface.first_burst_len = 0
Aug 14 19:58:01 user nova-compute[72782]: iface.max_outstanding_r2t = 0
Aug 14 19:58:01 user nova-compute[72782]: iface.max_burst_len = 0
Aug 14 19:58:01 user nova-compute[72782]: iface.chap_auth = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.bidi_chap = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.strict_login_compliance = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.discovery_auth = <empty>
Aug 14 19:58:01 user nova-compute[72782]: iface.discovery_logout = <empty>
Aug 14 19:58:01 user nova-compute[72782]: node.discovery_address = <empty>
Aug 14 19:58:01 user nova-compute[72782]: node.discovery_port = 0
Aug 14 19:58:01 user nova-compute[72782]: node.discovery_type = static
Aug 14 19:58:01 user nova-compute[72782]: node.session.initial_cmdsn = 0
Aug 14 19:58:01 user nova-compute[72782]: node.session.initial_login_retry_max = 8
Aug 14 19:58:01 user nova-compute[72782]: node.session.xmit_thread_priority = -20
Aug 14 19:58:01 user nova-compute[72782]: node.session.cmds_max = 128
Aug 14 19:58:01 user nova-compute[72782]: node.session.queue_depth = 32
Aug 14 19:58:01 user nova-compute[72782]: node.session.nr_sessions = 1
Aug 14 19:58:01 user nova-compute[72782]: node.session.auth.authmethod = CHAP
Aug 14 19:58:01 user nova-compute[72782]: node.session.auth.username = tAyaHErp
Aug 14 19:58:01 user nova-compute[72782]: node.session.auth.password = ***
Aug 14 19:58:01 user nova-compute[72782]: node.session.auth.username_in = <empty>
Aug 14 19:58:01 user nova-compute[72782]: node.session.auth.password_in = <empty>
Aug 14 19:58:01 user nova-compute[72782]: node.session.auth.chap_algs = MD5
Aug 14 19:58:01 user nova-compute[72782]: node.session.timeo.replacement_timeout = 120
Aug 14 19:58:01 user nova-compute[72782]: node.session.err_timeo.abort_timeout = 15
Aug 14 19:58:01 user nova-compute[72782]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 19:58:01 user nova-compute[72782]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 19:58:01 user nova-compute[72782]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 19:58:01 user nova-compute[72782]: node.session.iscsi.FastAbort = Yes
Aug 14 19:58:01 user nova-compute[72782]: node.session.iscsi.InitialR2T = No
Aug 14 19:58:01 user nova-compute[72782]: node.session.iscsi.ImmediateData = Yes
Aug 14 19:58:01 user nova-compute[72782]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 19:58:01 user nova-compute[72782]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 19:58:01 user nova-compute[72782]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 19:58:01 user nova-compute[72782]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 19:58:01 user nova-compute[72782]: node.session.iscsi.MaxConnections = 1
Aug 14 19:58:01 user nova-compute[72782]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 19:58:01 user nova-compute[72782]: node.session.iscsi.ERL = 0
Aug 14 19:58:01 user nova-compute[72782]: node.session.scan = manual
Aug 14 19:58:01 user nova-compute[72782]: node.session.reopen_max = 0
Aug 14 19:58:01 user nova-compute[72782]: node.conn[0].address = 172.16.0.220
Aug 14 19:58:01 user nova-compute[72782]: node.conn[0].port = 3260
Aug 14 19:58:01 user nova-compute[72782]: node.conn[0].startup = manual
Aug 14 19:58:01 user nova-compute[72782]: node.conn[0].tcp.window_size = 524288
Aug 14 19:58:01 user nova-compute[72782]: node.conn[0].tcp.type_of_service = 0
Aug 14 19:58:01 user nova-compute[72782]: node.conn[0].timeo.logout_timeout = 15
Aug 14 19:58:01 user nova-compute[72782]: node.conn[0].timeo.login_timeout = 15
Aug 14 19:58:01 user nova-compute[72782]: node.conn[0].timeo.auth_timeout = 45
Aug 14 19:58:01 user nova-compute[72782]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 19:58:01 user nova-compute[72782]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 19:58:01 user nova-compute[72782]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 19:58:01 user nova-compute[72782]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 19:58:01 user nova-compute[72782]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 19:58:01 user nova-compute[72782]: node.conn[0].iscsi.DataDigest = None
Aug 14 19:58:01 user nova-compute[72782]: node.conn[0].iscsi.IFMarker = No
Aug 14 19:58:01 user nova-compute[72782]: node.conn[0].iscsi.OFMarker = No
Aug 14 19:58:01 user nova-compute[72782]: # END RECORD
Aug 14 19:58:01 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd95243-ba73-4c21-ac76-c375e6ea5a91]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8b628a-af97-4854-ad21-e244a1039541]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAyaHErp {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAyaHErp" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[19560ba9-17da-4757-aefe-ee143725effe]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tAyaHErp'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b056e2f-5fe0-483a-854c-9a7683b81638]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[640de934-36f6-4c4c-a8eb-16d9e9cfbeed]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:58:01 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:58:01 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:58:01 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:58:01 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.181s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] HCTL ('34', '0', '0', 0) found on session 36 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf09f50-1ddf-4319-8c27-6e08ca225646]: (4, ('0 0 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Searching for a device in session 36 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAyaHErp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.246s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] <== connect_volume: return (248ms) {'type': 'block', 'scsi_wwn': '23838306466386536', 'path': '/dev/sdc'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838306466386536', 'path': '/dev/sdc'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:56:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1616735295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1616735295',id=26,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:56:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f9f312ba4414905a8d6eb44933e430e',ramdisk_id='',reservation_id='r-tabsp0yl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:56:30Z,user_data=None,user_id='12fb8b10952b4c6b8dc6823610830241',uuid=ad4011a9-ab9f-4647-b677-a1c6337d2c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2858462d-1715-4c67-aee3-a0c15eac235b", "address": "fa:16:3e:f1:85:57", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "vif_mac": "fa:16:3e:f1:85:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2858462d-17", "ovs_interfaceid": "2858462d-1715-4c67-aee3-a0c15eac235b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converting VIF {"id": "2858462d-1715-4c67-aee3-a0c15eac235b", "address": "fa:16:3e:f1:85:57", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "vif_mac": "fa:16:3e:f1:85:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2858462d-17", "ovs_interfaceid": "2858462d-1715-4c67-aee3-a0c15eac235b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:85:57,bridge_name='br-int',has_traffic_filtering=True,id=2858462d-1715-4c67-aee3-a0c15eac235b,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2858462d-17') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.objects.instance [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'pci_devices' on Instance uuid ad4011a9-ab9f-4647-b677-a1c6337d2c2c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:58:01 user nova-compute[72782]:   <uuid>ad4011a9-ab9f-4647-b677-a1c6337d2c2c</uuid>
Aug 14 19:58:01 user nova-compute[72782]:   <name>instance-0000001a</name>
Aug 14 19:58:01 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:58:01 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:58:01 user nova-compute[72782]:   <metadata>
Aug 14 19:58:01 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:58:01 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:58:01 user nova-compute[72782]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1616735295</nova:name>
Aug 14 19:58:01 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:58:01</nova:creationTime>
Aug 14 19:58:01 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:58:01 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:58:01 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:58:01 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:58:01 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:58:01 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:58:01 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:58:01 user nova-compute[72782]:       <nova:owner>
Aug 14 19:58:01 user nova-compute[72782]:         <nova:user uuid="12fb8b10952b4c6b8dc6823610830241">tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member</nova:user>
Aug 14 19:58:01 user nova-compute[72782]:         <nova:project uuid="4f9f312ba4414905a8d6eb44933e430e">tempest-ServerBootFromVolumeStableRescueTest-1102073842</nova:project>
Aug 14 19:58:01 user nova-compute[72782]:       </nova:owner>
Aug 14 19:58:01 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:58:01 user nova-compute[72782]:       <nova:ports>
Aug 14 19:58:01 user nova-compute[72782]:         <nova:port uuid="2858462d-1715-4c67-aee3-a0c15eac235b">
Aug 14 19:58:01 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 19:58:01 user nova-compute[72782]:         </nova:port>
Aug 14 19:58:01 user nova-compute[72782]:       </nova:ports>
Aug 14 19:58:01 user nova-compute[72782]:     </nova:instance>
Aug 14 19:58:01 user nova-compute[72782]:   </metadata>
Aug 14 19:58:01 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:58:01 user nova-compute[72782]:     <system>
Aug 14 19:58:01 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:58:01 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:58:01 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:58:01 user nova-compute[72782]:       <entry name="serial">ad4011a9-ab9f-4647-b677-a1c6337d2c2c</entry>
Aug 14 19:58:01 user nova-compute[72782]:       <entry name="uuid">ad4011a9-ab9f-4647-b677-a1c6337d2c2c</entry>
Aug 14 19:58:01 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:58:01 user nova-compute[72782]:     </system>
Aug 14 19:58:01 user nova-compute[72782]:   </sysinfo>
Aug 14 19:58:01 user nova-compute[72782]:   <os>
Aug 14 19:58:01 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:58:01 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:58:01 user nova-compute[72782]:   </os>
Aug 14 19:58:01 user nova-compute[72782]:   <features>
Aug 14 19:58:01 user nova-compute[72782]:     <acpi/>
Aug 14 19:58:01 user nova-compute[72782]:     <apic/>
Aug 14 19:58:01 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:58:01 user nova-compute[72782]:   </features>
Aug 14 19:58:01 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:58:01 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:58:01 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:58:01 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:58:01 user nova-compute[72782]:   </clock>
Aug 14 19:58:01 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:58:01 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:58:01 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:58:01 user nova-compute[72782]:   </cpu>
Aug 14 19:58:01 user nova-compute[72782]:   <devices>
Aug 14 19:58:01 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 19:58:01 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:58:01 user nova-compute[72782]:       <source dev="/dev/sdc"/>
Aug 14 19:58:01 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:58:01 user nova-compute[72782]:       <serial>29d8d5e8-35a6-4a5b-86f8-bb40c3282801</serial>
Aug 14 19:58:01 user nova-compute[72782]:     </disk>
Aug 14 19:58:01 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:58:01 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:58:01 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c/disk.rescue"/>
Aug 14 19:58:01 user nova-compute[72782]:       <target dev="vdb" bus="virtio"/>
Aug 14 19:58:01 user nova-compute[72782]:       <boot order="1"/>
Aug 14 19:58:01 user nova-compute[72782]:     </disk>
Aug 14 19:58:01 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:58:01 user nova-compute[72782]:       <mac address="fa:16:3e:f1:85:57"/>
Aug 14 19:58:01 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:58:01 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:58:01 user nova-compute[72782]:       <target dev="tap2858462d-17"/>
Aug 14 19:58:01 user nova-compute[72782]:     </interface>
Aug 14 19:58:01 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:58:01 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c/console.log" append="off"/>
Aug 14 19:58:01 user nova-compute[72782]:     </serial>
Aug 14 19:58:01 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:58:01 user nova-compute[72782]:     <video>
Aug 14 19:58:01 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:58:01 user nova-compute[72782]:     </video>
Aug 14 19:58:01 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:58:01 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:58:01 user nova-compute[72782]:     </rng>
Aug 14 19:58:01 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:58:01 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:58:01 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:58:01 user nova-compute[72782]:     </memballoon>
Aug 14 19:58:01 user nova-compute[72782]:   </devices>
Aug 14 19:58:01 user nova-compute[72782]: </domain>
Aug 14 19:58:01 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:58:01 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Instance destroyed successfully.
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] No VIF found with MAC fa:16:3e:f1:85:57, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-4fbb289c-a869-4a3b-87e0-7fb71dc61f31 req-995bcf84-601a-4b44-8170-830922fee1fb service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received event network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:58:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4fbb289c-a869-4a3b-87e0-7fb71dc61f31 req-995bcf84-601a-4b44-8170-830922fee1fb service nova] Acquiring lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4fbb289c-a869-4a3b-87e0-7fb71dc61f31 req-995bcf84-601a-4b44-8170-830922fee1fb service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4fbb289c-a869-4a3b-87e0-7fb71dc61f31 req-995bcf84-601a-4b44-8170-830922fee1fb service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-4fbb289c-a869-4a3b-87e0-7fb71dc61f31 req-995bcf84-601a-4b44-8170-830922fee1fb service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] No waiting events found dispatching network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:58:02 user nova-compute[72782]: WARNING nova.compute.manager [req-4fbb289c-a869-4a3b-87e0-7fb71dc61f31 req-995bcf84-601a-4b44-8170-830922fee1fb service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received unexpected event network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b for instance with vm_state active and task_state rescuing.
Aug 14 19:58:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:58:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:04 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:58:04 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:58:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7709MB free_disk=25.311450958251953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance d0ffe207-a89e-41ef-85af-7927ce06627e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance a4ae2e60-c4d4-4a7e-826e-fb315fa98138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance c748103b-a37c-47c5-8394-ea54749f27eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance f057c9c2-9c75-4c4b-8f95-444f135e4056 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ad4011a9-ab9f-4647-b677-a1c6337d2c2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Removed pending event for ad4011a9-ab9f-4647-b677-a1c6337d2c2c due to event {{(pid=72782) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043084.952085, ad4011a9-ab9f-4647-b677-a1c6337d2c2c => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:58:04 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] VM Resumed (Lifecycle Event)
Aug 14 19:58:04 user nova-compute[72782]: DEBUG nova.compute.manager [None req-78394202-1351-4d83-bb4a-763399fd175c tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:58:04 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:58:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-78987135-6e52-4166-8713-9ce572fb7e89 req-296a0016-0122-4541-8f3f-199fd22f4adf service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received event network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:58:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-78987135-6e52-4166-8713-9ce572fb7e89 req-296a0016-0122-4541-8f3f-199fd22f4adf service nova] Acquiring lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-78987135-6e52-4166-8713-9ce572fb7e89 req-296a0016-0122-4541-8f3f-199fd22f4adf service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-78987135-6e52-4166-8713-9ce572fb7e89 req-296a0016-0122-4541-8f3f-199fd22f4adf service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-78987135-6e52-4166-8713-9ce572fb7e89 req-296a0016-0122-4541-8f3f-199fd22f4adf service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] No waiting events found dispatching network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:58:05 user nova-compute[72782]: WARNING nova.compute.manager [req-78987135-6e52-4166-8713-9ce572fb7e89 req-296a0016-0122-4541-8f3f-199fd22f4adf service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received unexpected event network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b for instance with vm_state active and task_state rescuing.
Aug 14 19:58:05 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 19:58:05 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043084.9545746, ad4011a9-ab9f-4647-b677-a1c6337d2c2c => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:58:05 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] VM Started (Lifecycle Event)
Aug 14 19:58:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:58:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:58:05 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:58:05 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:58:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:58:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bMvhAikC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:58:06 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:58:06 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:58:06 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[60aa4940-694e-4824-ac5f-60fba15c97db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:58:06 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f33f5d-7ba0-4dca-ae3f-c53a0e9b5e52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f] added
Aug 14 19:58:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffadec28-4d30-4530-a871-77b2d6d94db8]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d262a2c-d41f-4f30-8581-a23f5b729076]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bMvhAikC {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bMvhAikC" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c13b700-9a88-4b35-8d59-3cd8d3ec296a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bMvhAikC'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfc48da-3e54-4dd2-9326-7a2ddd684d3d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d1f1b6-3ea8-4169-a6b0-500e9ce733e9]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:58:06 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:58:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:58:06 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:58:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a2da61-56a7-490d-bf43-3eb27ea797f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f, portal: 172.16.0.220,3260]
Aug 14 19:58:06 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f, portal: 172.16.0.220,3260] successful.
Aug 14 19:58:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60f0b4e-2931-452e-87f0-1c4ab8766c9c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9768e6a3-7b1b-4191-b332-25b2b1ce360f]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:58:06 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:58:06 user nova-compute[72782]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f (non-flash)
Aug 14 19:58:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:58:06 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:58:06 user nova-compute[72782]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f (non-flash)
Aug 14 19:58:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa258ba-f5b8-443a-92cb-97d305ad3e96]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bMvhAikC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:58:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:58:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23031313131336133', 'path': '/dev/sdd'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:58:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031313131336133', 'path': '/dev/sdd'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:58:07 user nova-compute[72782]: DEBUG nova.objects.instance [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'flavor' on Instance uuid f057c9c2-9c75-4c4b-8f95-444f135e4056 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:58:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:58:07 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:58:07 user nova-compute[72782]:   <source dev="/dev/sdd"/>
Aug 14 19:58:07 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:58:07 user nova-compute[72782]:   <serial>4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f</serial>
Aug 14 19:58:07 user nova-compute[72782]: </disk>
Aug 14 19:58:07 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:58:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:58:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:58:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] No VIF found with MAC fa:16:3e:43:c6:df, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:58:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-979a2825-f434-48fb-b5ae-0915a97bd04b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.484s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "f057c9c2-9c75-4c4b-8f95-444f135e4056" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:08 user nova-compute[72782]: INFO nova.compute.manager [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Detaching volume 4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f
Aug 14 19:58:08 user nova-compute[72782]: INFO nova.virt.block_device [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Attempting to driver detach volume 4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f from mountpoint /dev/vdb
Aug 14 19:58:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Attempting to detach device vdb from instance f057c9c2-9c75-4c4b-8f95-444f135e4056 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:58:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:58:08 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:58:08 user nova-compute[72782]:   <source dev="/dev/sdd"/>
Aug 14 19:58:08 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:58:08 user nova-compute[72782]:   <serial>4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f</serial>
Aug 14 19:58:08 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:58:08 user nova-compute[72782]: </disk>
Aug 14 19:58:08 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:58:08 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Successfully detached device vdb from instance f057c9c2-9c75-4c4b-8f95-444f135e4056 from the persistent domain config.
Aug 14 19:58:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f057c9c2-9c75-4c4b-8f95-444f135e4056 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:58:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:58:08 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:58:08 user nova-compute[72782]:   <source dev="/dev/sdd"/>
Aug 14 19:58:08 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:58:08 user nova-compute[72782]:   <serial>4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f</serial>
Aug 14 19:58:08 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:58:08 user nova-compute[72782]: </disk>
Aug 14 19:58:08 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692043089.270204, f057c9c2-9c75-4c4b-8f95-444f135e4056 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f057c9c2-9c75-4c4b-8f95-444f135e4056 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:58:09 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Successfully detached device vdb from instance f057c9c2-9c75-4c4b-8f95-444f135e4056 from the live domain config.
Aug 14 19:58:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bMvhAikC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:58:09 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:58:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[397323f3-57ea-48f9-8e15-5e66b44c1a48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ae5987-5315-4eaa-887d-6df59380597e]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:58:09 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:58:09 user nova-compute[72782]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f (non-flash)
Aug 14 19:58:09 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:58:09 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:58:09 user nova-compute[72782]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f (non-flash)
Aug 14 19:58:09 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f64084948b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f'): ({'sdd'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Removing single pathed devices sdd {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc071cd-e46b-413d-8ddb-20c4b804ca7c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3da6999-0b37-42e9-8bfe-178a56b3bc5d]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Flushing IO for device /dev/sdd {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c1347c-7310-43ca-87f1-033463611bf9]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7691d4a0-dd96-4d20-9d8e-728725000dc4]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7ddb0c-cbcf-4bea-95fe-de9143eda7d1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[812d65ba-cd45-4216-8548-b3898cc79a1d]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f, portal: 172.16.0.220,3260]
Aug 14 19:58:09 user nova-compute[72782]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f, portal: 172.16.0.220,3260] successful.
Aug 14 19:58:09 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2eeaf2-608d-4c8e-9ec3-319e69d87f9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[44984299-2bc2-49d2-aa8f-a1627286f7d1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] <== disconnect_volume: return (272ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:58:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:58:10 user nova-compute[72782]: DEBUG nova.objects.instance [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'flavor' on Instance uuid f057c9c2-9c75-4c4b-8f95-444f135e4056 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:58:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-835ac55f-b146-459d-85b9-68c71471f599 tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.664s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:58:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:58:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:58:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:58:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Acquiring lock "ebed33f0-94c7-4094-a181-335784ab8819" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lock "ebed33f0-94c7-4094-a181-335784ab8819" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:58:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:29 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:58:29 user nova-compute[72782]: INFO nova.compute.claims [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Claim successful on node user
Aug 14 19:58:30 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG nova.compute.manager [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG nova.compute.manager [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG nova.network.neutron [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:58:30 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:58:30 user nova-compute[72782]: DEBUG nova.compute.manager [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG nova.compute.manager [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:58:30 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Creating image(s)
Aug 14 19:58:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lock "/opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lock "/opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG nova.policy [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93e0589a04ee4b1ca72c7c3d7555c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27657b177ec241148d5a41316528a4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.193s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/disk 1073741824" returned: 0 in 0.047s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.193s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:58:30 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Cannot resize image /opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG nova.objects.instance [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lazy-loading 'migration_context' on Instance uuid ebed33f0-94c7-4094-a181-335784ab8819 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Ensure instance console log exists: /opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG nova.network.neutron [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Successfully created port: f161b84e-9df3-4c23-9202-a814824405f7 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:58:31 user nova-compute[72782]: INFO nova.compute.claims [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Claim successful on node user
Aug 14 19:58:31 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "2c924d52-aa8a-47ed-857c-b863efe95258" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "2c924d52-aa8a-47ed-857c-b863efe95258" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG nova.network.neutron [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:58:31 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:58:31 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:58:31 user nova-compute[72782]: INFO nova.compute.claims [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Claim successful on node user
Aug 14 19:58:31 user nova-compute[72782]: DEBUG nova.policy [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2d39528bc994a25b9e6fea9f6b8b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14952037d1dc44e7b64d0663c7a033c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:58:31 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Creating image(s)
Aug 14 19:58:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "/opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "/opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.network.neutron [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Successfully updated port: f161b84e-9df3-4c23-9202-a814824405f7 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Acquiring lock "refresh_cache-ebed33f0-94c7-4094-a181-335784ab8819" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Acquired lock "refresh_cache-ebed33f0-94c7-4094-a181-335784ab8819" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.network.neutron [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.compute.manager [req-4e033d2b-8afa-480b-bf31-232cc18174c3 req-073dbaea-880c-4baa-979a-c7e53c2e6b7d service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Received event network-changed-f161b84e-9df3-4c23-9202-a814824405f7 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.compute.manager [req-4e033d2b-8afa-480b-bf31-232cc18174c3 req-073dbaea-880c-4baa-979a-c7e53c2e6b7d service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Refreshing instance network info cache due to event network-changed-f161b84e-9df3-4c23-9202-a814824405f7. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4e033d2b-8afa-480b-bf31-232cc18174c3 req-073dbaea-880c-4baa-979a-c7e53c2e6b7d service nova] Acquiring lock "refresh_cache-ebed33f0-94c7-4094-a181-335784ab8819" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.network.neutron [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.194s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.185s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk 1073741824" returned: 0 in 0.050s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.network.neutron [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Successfully created port: 325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.network.neutron [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Updating instance_info_cache with network_info: [{"id": "f161b84e-9df3-4c23-9202-a814824405f7", "address": "fa:16:3e:7e:e2:ef", "network": {"id": "f092445f-c653-4c63-b2f8-6f5868c04fa6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3d33562bad004467893841e90a8b6160", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf161b84e-9d", "ovs_interfaceid": "f161b84e-9df3-4c23-9202-a814824405f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Releasing lock "refresh_cache-ebed33f0-94c7-4094-a181-335784ab8819" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Instance network_info: |[{"id": "f161b84e-9df3-4c23-9202-a814824405f7", "address": "fa:16:3e:7e:e2:ef", "network": {"id": "f092445f-c653-4c63-b2f8-6f5868c04fa6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3d33562bad004467893841e90a8b6160", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf161b84e-9d", "ovs_interfaceid": "f161b84e-9df3-4c23-9202-a814824405f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4e033d2b-8afa-480b-bf31-232cc18174c3 req-073dbaea-880c-4baa-979a-c7e53c2e6b7d service nova] Acquired lock "refresh_cache-ebed33f0-94c7-4094-a181-335784ab8819" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.network.neutron [req-4e033d2b-8afa-480b-bf31-232cc18174c3 req-073dbaea-880c-4baa-979a-c7e53c2e6b7d service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Refreshing network info cache for port f161b84e-9df3-4c23-9202-a814824405f7 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Start _get_guest_xml network_info=[{"id": "f161b84e-9df3-4c23-9202-a814824405f7", "address": "fa:16:3e:7e:e2:ef", "network": {"id": "f092445f-c653-4c63-b2f8-6f5868c04fa6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3d33562bad004467893841e90a8b6160", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf161b84e-9d", "ovs_interfaceid": "f161b84e-9df3-4c23-9202-a814824405f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:58:32 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:58:32 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.network.neutron [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-323991577',display_name='tempest-VolumesNegativeTest-instance-323991577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-323991577',id=28,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27657b177ec241148d5a41316528a4cb',ramdisk_id='',reservation_id='r-c1yry7c1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1700451336',owner_user_name='tempest-VolumesNegativeTest-1700451336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:58:30Z,user_data=None,user_id='93e0589a04ee4b1ca72c7c3d7555c1f0',uuid=ebed33f0-94c7-4094-a181-335784ab8819,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f161b84e-9df3-4c23-9202-a814824405f7", "address": "fa:16:3e:7e:e2:ef", "network": {"id": "f092445f-c653-4c63-b2f8-6f5868c04fa6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3d33562bad004467893841e90a8b6160", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf161b84e-9d", "ovs_interfaceid": "f161b84e-9df3-4c23-9202-a814824405f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Converting VIF {"id": "f161b84e-9df3-4c23-9202-a814824405f7", "address": "fa:16:3e:7e:e2:ef", "network": {"id": "f092445f-c653-4c63-b2f8-6f5868c04fa6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3d33562bad004467893841e90a8b6160", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf161b84e-9d", "ovs_interfaceid": "f161b84e-9df3-4c23-9202-a814824405f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e2:ef,bridge_name='br-int',has_traffic_filtering=True,id=f161b84e-9df3-4c23-9202-a814824405f7,network=Network(f092445f-c653-4c63-b2f8-6f5868c04fa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf161b84e-9d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.objects.instance [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lazy-loading 'pci_devices' on Instance uuid ebed33f0-94c7-4094-a181-335784ab8819 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:58:32 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.234s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:58:32 user nova-compute[72782]:   <uuid>ebed33f0-94c7-4094-a181-335784ab8819</uuid>
Aug 14 19:58:32 user nova-compute[72782]:   <name>instance-0000001c</name>
Aug 14 19:58:32 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:58:32 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:58:32 user nova-compute[72782]:   <metadata>
Aug 14 19:58:32 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:58:32 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:58:32 user nova-compute[72782]:       <nova:name>tempest-VolumesNegativeTest-instance-323991577</nova:name>
Aug 14 19:58:32 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:58:32</nova:creationTime>
Aug 14 19:58:32 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:58:32 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:58:32 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:58:32 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:58:32 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:58:32 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:58:32 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:58:32 user nova-compute[72782]:       <nova:owner>
Aug 14 19:58:32 user nova-compute[72782]:         <nova:user uuid="93e0589a04ee4b1ca72c7c3d7555c1f0">tempest-VolumesNegativeTest-1700451336-project-member</nova:user>
Aug 14 19:58:32 user nova-compute[72782]:         <nova:project uuid="27657b177ec241148d5a41316528a4cb">tempest-VolumesNegativeTest-1700451336</nova:project>
Aug 14 19:58:32 user nova-compute[72782]:       </nova:owner>
Aug 14 19:58:32 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:58:32 user nova-compute[72782]:       <nova:ports>
Aug 14 19:58:32 user nova-compute[72782]:         <nova:port uuid="f161b84e-9df3-4c23-9202-a814824405f7">
Aug 14 19:58:32 user nova-compute[72782]:           <nova:ip type="fixed" address="192.168.233.120" ipVersion="4"/>
Aug 14 19:58:32 user nova-compute[72782]:         </nova:port>
Aug 14 19:58:32 user nova-compute[72782]:       </nova:ports>
Aug 14 19:58:32 user nova-compute[72782]:     </nova:instance>
Aug 14 19:58:32 user nova-compute[72782]:   </metadata>
Aug 14 19:58:32 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:58:32 user nova-compute[72782]:     <system>
Aug 14 19:58:32 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:58:32 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:58:32 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:58:32 user nova-compute[72782]:       <entry name="serial">ebed33f0-94c7-4094-a181-335784ab8819</entry>
Aug 14 19:58:32 user nova-compute[72782]:       <entry name="uuid">ebed33f0-94c7-4094-a181-335784ab8819</entry>
Aug 14 19:58:32 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:58:32 user nova-compute[72782]:     </system>
Aug 14 19:58:32 user nova-compute[72782]:   </sysinfo>
Aug 14 19:58:32 user nova-compute[72782]:   <os>
Aug 14 19:58:32 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:58:32 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:58:32 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:58:32 user nova-compute[72782]:   </os>
Aug 14 19:58:32 user nova-compute[72782]:   <features>
Aug 14 19:58:32 user nova-compute[72782]:     <acpi/>
Aug 14 19:58:32 user nova-compute[72782]:     <apic/>
Aug 14 19:58:32 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:58:32 user nova-compute[72782]:   </features>
Aug 14 19:58:32 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:58:32 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:58:32 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:58:32 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:58:32 user nova-compute[72782]:   </clock>
Aug 14 19:58:32 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:58:32 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:58:32 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:58:32 user nova-compute[72782]:   </cpu>
Aug 14 19:58:32 user nova-compute[72782]:   <devices>
Aug 14 19:58:32 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:58:32 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:58:32 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/disk"/>
Aug 14 19:58:32 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:58:32 user nova-compute[72782]:     </disk>
Aug 14 19:58:32 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:58:32 user nova-compute[72782]:       <mac address="fa:16:3e:7e:e2:ef"/>
Aug 14 19:58:32 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:58:32 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:58:32 user nova-compute[72782]:       <target dev="tapf161b84e-9d"/>
Aug 14 19:58:32 user nova-compute[72782]:     </interface>
Aug 14 19:58:32 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:58:32 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/console.log" append="off"/>
Aug 14 19:58:32 user nova-compute[72782]:     </serial>
Aug 14 19:58:32 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:58:32 user nova-compute[72782]:     <video>
Aug 14 19:58:32 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:58:32 user nova-compute[72782]:     </video>
Aug 14 19:58:32 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:58:32 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:58:32 user nova-compute[72782]:     </rng>
Aug 14 19:58:32 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:58:32 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:58:32 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:58:32 user nova-compute[72782]:     </memballoon>
Aug 14 19:58:32 user nova-compute[72782]:   </devices>
Aug 14 19:58:32 user nova-compute[72782]: </domain>
Aug 14 19:58:32 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-323991577',display_name='tempest-VolumesNegativeTest-instance-323991577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-323991577',id=28,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27657b177ec241148d5a41316528a4cb',ramdisk_id='',reservation_id='r-c1yry7c1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1700451336',owner_user_name='tempest-VolumesNegativeTest-1700451336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:58:30Z,user_data=None,user_id='93e0589a04ee4b1ca72c7c3d7555c1f0',uuid=ebed33f0-94c7-4094-a181-335784ab8819,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f161b84e-9df3-4c23-9202-a814824405f7", "address": "fa:16:3e:7e:e2:ef", "network": {"id": "f092445f-c653-4c63-b2f8-6f5868c04fa6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3d33562bad004467893841e90a8b6160", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf161b84e-9d", "ovs_interfaceid": "f161b84e-9df3-4c23-9202-a814824405f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Converting VIF {"id": "f161b84e-9df3-4c23-9202-a814824405f7", "address": "fa:16:3e:7e:e2:ef", "network": {"id": "f092445f-c653-4c63-b2f8-6f5868c04fa6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3d33562bad004467893841e90a8b6160", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf161b84e-9d", "ovs_interfaceid": "f161b84e-9df3-4c23-9202-a814824405f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e2:ef,bridge_name='br-int',has_traffic_filtering=True,id=f161b84e-9df3-4c23-9202-a814824405f7,network=Network(f092445f-c653-4c63-b2f8-6f5868c04fa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf161b84e-9d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG os_vif [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e2:ef,bridge_name='br-int',has_traffic_filtering=True,id=f161b84e-9df3-4c23-9202-a814824405f7,network=Network(f092445f-c653-4c63-b2f8-6f5868c04fa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf161b84e-9d') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf161b84e-9d, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf161b84e-9d, col_values=(('external_ids', {'iface-id': 'f161b84e-9df3-4c23-9202-a814824405f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:e2:ef', 'vm-uuid': 'ebed33f0-94c7-4094-a181-335784ab8819'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:58:32 user nova-compute[72782]: INFO os_vif [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e2:ef,bridge_name='br-int',has_traffic_filtering=True,id=f161b84e-9df3-4c23-9202-a814824405f7,network=Network(f092445f-c653-4c63-b2f8-6f5868c04fa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf161b84e-9d')
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.policy [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2d39528bc994a25b9e6fea9f6b8b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14952037d1dc44e7b64d0663c7a033c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] No VIF found with MAC fa:16:3e:7e:e2:ef, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:58:32 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Creating image(s)
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "/opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "/opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Cannot resize image /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.objects.instance [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'migration_context' on Instance uuid 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Ensure instance console log exists: /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG nova.network.neutron [req-4e033d2b-8afa-480b-bf31-232cc18174c3 req-073dbaea-880c-4baa-979a-c7e53c2e6b7d service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Updated VIF entry in instance network info cache for port f161b84e-9df3-4c23-9202-a814824405f7. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG nova.network.neutron [req-4e033d2b-8afa-480b-bf31-232cc18174c3 req-073dbaea-880c-4baa-979a-c7e53c2e6b7d service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Updating instance_info_cache with network_info: [{"id": "f161b84e-9df3-4c23-9202-a814824405f7", "address": "fa:16:3e:7e:e2:ef", "network": {"id": "f092445f-c653-4c63-b2f8-6f5868c04fa6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3d33562bad004467893841e90a8b6160", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf161b84e-9d", "ovs_interfaceid": "f161b84e-9df3-4c23-9202-a814824405f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4e033d2b-8afa-480b-bf31-232cc18174c3 req-073dbaea-880c-4baa-979a-c7e53c2e6b7d service nova] Releasing lock "refresh_cache-ebed33f0-94c7-4094-a181-335784ab8819" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk 1073741824" returned: 0 in 0.050s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.169s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Cannot resize image /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG nova.objects.instance [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'migration_context' on Instance uuid 2c924d52-aa8a-47ed-857c-b863efe95258 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Ensure instance console log exists: /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.network.neutron [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Successfully updated port: 325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquired lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.network.neutron [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.compute.manager [req-4dccbe87-4ea0-44bd-a814-a28c990e763c req-4bf3761b-a66d-4e18-92df-468c1349ea55 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-changed-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.compute.manager [req-4dccbe87-4ea0-44bd-a814-a28c990e763c req-4bf3761b-a66d-4e18-92df-468c1349ea55 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Refreshing instance network info cache due to event network-changed-325817ed-4de8-4d31-afb7-d338d9391c55. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4dccbe87-4ea0-44bd-a814-a28c990e763c req-4bf3761b-a66d-4e18-92df-468c1349ea55 service nova] Acquiring lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.network.neutron [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Successfully created port: 8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.network.neutron [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.compute.manager [req-7cad34be-5eba-4d31-87f2-c5253f74647c req-d2aeb588-5617-4502-94b8-61103240b3a6 service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Received event network-vif-plugged-f161b84e-9df3-4c23-9202-a814824405f7 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7cad34be-5eba-4d31-87f2-c5253f74647c req-d2aeb588-5617-4502-94b8-61103240b3a6 service nova] Acquiring lock "ebed33f0-94c7-4094-a181-335784ab8819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7cad34be-5eba-4d31-87f2-c5253f74647c req-d2aeb588-5617-4502-94b8-61103240b3a6 service nova] Lock "ebed33f0-94c7-4094-a181-335784ab8819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7cad34be-5eba-4d31-87f2-c5253f74647c req-d2aeb588-5617-4502-94b8-61103240b3a6 service nova] Lock "ebed33f0-94c7-4094-a181-335784ab8819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.compute.manager [req-7cad34be-5eba-4d31-87f2-c5253f74647c req-d2aeb588-5617-4502-94b8-61103240b3a6 service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] No waiting events found dispatching network-vif-plugged-f161b84e-9df3-4c23-9202-a814824405f7 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:58:34 user nova-compute[72782]: WARNING nova.compute.manager [req-7cad34be-5eba-4d31-87f2-c5253f74647c req-d2aeb588-5617-4502-94b8-61103240b3a6 service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Received unexpected event network-vif-plugged-f161b84e-9df3-4c23-9202-a814824405f7 for instance with vm_state building and task_state spawning.
Aug 14 19:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.network.neutron [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Updating instance_info_cache with network_info: [{"id": "325817ed-4de8-4d31-afb7-d338d9391c55", "address": "fa:16:3e:83:cb:20", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325817ed-4d", "ovs_interfaceid": "325817ed-4de8-4d31-afb7-d338d9391c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Releasing lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Instance network_info: |[{"id": "325817ed-4de8-4d31-afb7-d338d9391c55", "address": "fa:16:3e:83:cb:20", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325817ed-4d", "ovs_interfaceid": "325817ed-4de8-4d31-afb7-d338d9391c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4dccbe87-4ea0-44bd-a814-a28c990e763c req-4bf3761b-a66d-4e18-92df-468c1349ea55 service nova] Acquired lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.network.neutron [req-4dccbe87-4ea0-44bd-a814-a28c990e763c req-4bf3761b-a66d-4e18-92df-468c1349ea55 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Refreshing network info cache for port 325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Start _get_guest_xml network_info=[{"id": "325817ed-4de8-4d31-afb7-d338d9391c55", "address": "fa:16:3e:83:cb:20", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325817ed-4d", "ovs_interfaceid": "325817ed-4de8-4d31-afb7-d338d9391c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:58:34 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:58:34 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:58:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-352284208',display_name='tempest-ServerRescueNegativeTestJSON-server-352284208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-352284208',id=29,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14952037d1dc44e7b64d0663c7a033c8',ramdisk_id='',reservation_id='r-j9s00kwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1321611883',owner_user_name='tempest-ServerRescueNegativeTestJSON-1321611883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:58:32Z,user_data=None,user_id='d2d39528bc994a25b9e6fea9f6b8b34c',uuid=0fa5392c-ea30-4007-bcdc-2802a46ed7a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "325817ed-4de8-4d31-afb7-d338d9391c55", "address": "fa:16:3e:83:cb:20", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325817ed-4d", "ovs_interfaceid": "325817ed-4de8-4d31-afb7-d338d9391c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converting VIF {"id": "325817ed-4de8-4d31-afb7-d338d9391c55", "address": "fa:16:3e:83:cb:20", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325817ed-4d", "ovs_interfaceid": "325817ed-4de8-4d31-afb7-d338d9391c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:cb:20,bridge_name='br-int',has_traffic_filtering=True,id=325817ed-4de8-4d31-afb7-d338d9391c55,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325817ed-4d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.objects.instance [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:58:34 user nova-compute[72782]:   <uuid>0fa5392c-ea30-4007-bcdc-2802a46ed7a2</uuid>
Aug 14 19:58:34 user nova-compute[72782]:   <name>instance-0000001d</name>
Aug 14 19:58:34 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:58:34 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:58:34 user nova-compute[72782]:   <metadata>
Aug 14 19:58:34 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:58:34 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:58:34 user nova-compute[72782]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-352284208</nova:name>
Aug 14 19:58:34 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:58:34</nova:creationTime>
Aug 14 19:58:34 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:58:34 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:58:34 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:58:34 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:58:34 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:58:34 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:58:34 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:58:34 user nova-compute[72782]:       <nova:owner>
Aug 14 19:58:34 user nova-compute[72782]:         <nova:user uuid="d2d39528bc994a25b9e6fea9f6b8b34c">tempest-ServerRescueNegativeTestJSON-1321611883-project-member</nova:user>
Aug 14 19:58:34 user nova-compute[72782]:         <nova:project uuid="14952037d1dc44e7b64d0663c7a033c8">tempest-ServerRescueNegativeTestJSON-1321611883</nova:project>
Aug 14 19:58:34 user nova-compute[72782]:       </nova:owner>
Aug 14 19:58:34 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:58:34 user nova-compute[72782]:       <nova:ports>
Aug 14 19:58:34 user nova-compute[72782]:         <nova:port uuid="325817ed-4de8-4d31-afb7-d338d9391c55">
Aug 14 19:58:34 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 19:58:34 user nova-compute[72782]:         </nova:port>
Aug 14 19:58:34 user nova-compute[72782]:       </nova:ports>
Aug 14 19:58:34 user nova-compute[72782]:     </nova:instance>
Aug 14 19:58:34 user nova-compute[72782]:   </metadata>
Aug 14 19:58:34 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:58:34 user nova-compute[72782]:     <system>
Aug 14 19:58:34 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:58:34 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:58:34 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:58:34 user nova-compute[72782]:       <entry name="serial">0fa5392c-ea30-4007-bcdc-2802a46ed7a2</entry>
Aug 14 19:58:34 user nova-compute[72782]:       <entry name="uuid">0fa5392c-ea30-4007-bcdc-2802a46ed7a2</entry>
Aug 14 19:58:34 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:58:34 user nova-compute[72782]:     </system>
Aug 14 19:58:34 user nova-compute[72782]:   </sysinfo>
Aug 14 19:58:34 user nova-compute[72782]:   <os>
Aug 14 19:58:34 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:58:34 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:58:34 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:58:34 user nova-compute[72782]:   </os>
Aug 14 19:58:34 user nova-compute[72782]:   <features>
Aug 14 19:58:34 user nova-compute[72782]:     <acpi/>
Aug 14 19:58:34 user nova-compute[72782]:     <apic/>
Aug 14 19:58:34 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:58:34 user nova-compute[72782]:   </features>
Aug 14 19:58:34 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:58:34 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:58:34 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:58:34 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:58:34 user nova-compute[72782]:   </clock>
Aug 14 19:58:34 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:58:34 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:58:34 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:58:34 user nova-compute[72782]:   </cpu>
Aug 14 19:58:34 user nova-compute[72782]:   <devices>
Aug 14 19:58:34 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:58:34 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:58:34 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk"/>
Aug 14 19:58:34 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:58:34 user nova-compute[72782]:     </disk>
Aug 14 19:58:34 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:58:34 user nova-compute[72782]:       <mac address="fa:16:3e:83:cb:20"/>
Aug 14 19:58:34 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:58:34 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:58:34 user nova-compute[72782]:       <target dev="tap325817ed-4d"/>
Aug 14 19:58:34 user nova-compute[72782]:     </interface>
Aug 14 19:58:34 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:58:34 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/console.log" append="off"/>
Aug 14 19:58:34 user nova-compute[72782]:     </serial>
Aug 14 19:58:34 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:58:34 user nova-compute[72782]:     <video>
Aug 14 19:58:34 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:58:34 user nova-compute[72782]:     </video>
Aug 14 19:58:34 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:58:34 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:58:34 user nova-compute[72782]:     </rng>
Aug 14 19:58:34 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:58:34 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:58:34 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:58:34 user nova-compute[72782]:     </memballoon>
Aug 14 19:58:34 user nova-compute[72782]:   </devices>
Aug 14 19:58:34 user nova-compute[72782]: </domain>
Aug 14 19:58:34 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:58:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-352284208',display_name='tempest-ServerRescueNegativeTestJSON-server-352284208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-352284208',id=29,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14952037d1dc44e7b64d0663c7a033c8',ramdisk_id='',reservation_id='r-j9s00kwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1321611883',owner_user_name='tempest-ServerRescueNegativeTestJSON-1321611883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:58:32Z,user_data=None,user_id='d2d39528bc994a25b9e6fea9f6b8b34c',uuid=0fa5392c-ea30-4007-bcdc-2802a46ed7a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "325817ed-4de8-4d31-afb7-d338d9391c55", "address": "fa:16:3e:83:cb:20", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325817ed-4d", "ovs_interfaceid": "325817ed-4de8-4d31-afb7-d338d9391c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converting VIF {"id": "325817ed-4de8-4d31-afb7-d338d9391c55", "address": "fa:16:3e:83:cb:20", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325817ed-4d", "ovs_interfaceid": "325817ed-4de8-4d31-afb7-d338d9391c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:cb:20,bridge_name='br-int',has_traffic_filtering=True,id=325817ed-4de8-4d31-afb7-d338d9391c55,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325817ed-4d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG os_vif [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:cb:20,bridge_name='br-int',has_traffic_filtering=True,id=325817ed-4de8-4d31-afb7-d338d9391c55,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325817ed-4d') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap325817ed-4d, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap325817ed-4d, col_values=(('external_ids', {'iface-id': '325817ed-4de8-4d31-afb7-d338d9391c55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:cb:20', 'vm-uuid': '0fa5392c-ea30-4007-bcdc-2802a46ed7a2'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:34 user nova-compute[72782]: INFO os_vif [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:cb:20,bridge_name='br-int',has_traffic_filtering=True,id=325817ed-4de8-4d31-afb7-d338d9391c55,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325817ed-4d')
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:58:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] No VIF found with MAC fa:16:3e:83:cb:20, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.network.neutron [req-4dccbe87-4ea0-44bd-a814-a28c990e763c req-4bf3761b-a66d-4e18-92df-468c1349ea55 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Updated VIF entry in instance network info cache for port 325817ed-4de8-4d31-afb7-d338d9391c55. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.network.neutron [req-4dccbe87-4ea0-44bd-a814-a28c990e763c req-4bf3761b-a66d-4e18-92df-468c1349ea55 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Updating instance_info_cache with network_info: [{"id": "325817ed-4de8-4d31-afb7-d338d9391c55", "address": "fa:16:3e:83:cb:20", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325817ed-4d", "ovs_interfaceid": "325817ed-4de8-4d31-afb7-d338d9391c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4dccbe87-4ea0-44bd-a814-a28c990e763c req-4bf3761b-a66d-4e18-92df-468c1349ea55 service nova] Releasing lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.network.neutron [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Successfully updated port: 8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "refresh_cache-2c924d52-aa8a-47ed-857c-b863efe95258" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquired lock "refresh_cache-2c924d52-aa8a-47ed-857c-b863efe95258" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.network.neutron [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.network.neutron [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.network.neutron [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Updating instance_info_cache with network_info: [{"id": "8b971464-be37-4d45-a3c6-05d413e65cb2", "address": "fa:16:3e:a0:14:ff", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b971464-be", "ovs_interfaceid": "8b971464-be37-4d45-a3c6-05d413e65cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Releasing lock "refresh_cache-2c924d52-aa8a-47ed-857c-b863efe95258" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Instance network_info: |[{"id": "8b971464-be37-4d45-a3c6-05d413e65cb2", "address": "fa:16:3e:a0:14:ff", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b971464-be", "ovs_interfaceid": "8b971464-be37-4d45-a3c6-05d413e65cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Start _get_guest_xml network_info=[{"id": "8b971464-be37-4d45-a3c6-05d413e65cb2", "address": "fa:16:3e:a0:14:ff", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b971464-be", "ovs_interfaceid": "8b971464-be37-4d45-a3c6-05d413e65cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:58:35 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:58:35 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-351871757',display_name='tempest-ServerRescueNegativeTestJSON-server-351871757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-351871757',id=30,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14952037d1dc44e7b64d0663c7a033c8',ramdisk_id='',reservation_id='r-og2q6lkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1321611883',owner_user_name='tempest-ServerRescueNegativeTestJSON-1321611883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:58:33Z,user_data=None,user_id='d2d39528bc994a25b9e6fea9f6b8b34c',uuid=2c924d52-aa8a-47ed-857c-b863efe95258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b971464-be37-4d45-a3c6-05d413e65cb2", "address": "fa:16:3e:a0:14:ff", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b971464-be", "ovs_interfaceid": "8b971464-be37-4d45-a3c6-05d413e65cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converting VIF {"id": "8b971464-be37-4d45-a3c6-05d413e65cb2", "address": "fa:16:3e:a0:14:ff", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b971464-be", "ovs_interfaceid": "8b971464-be37-4d45-a3c6-05d413e65cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:14:ff,bridge_name='br-int',has_traffic_filtering=True,id=8b971464-be37-4d45-a3c6-05d413e65cb2,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b971464-be') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.objects.instance [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c924d52-aa8a-47ed-857c-b863efe95258 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:58:35 user nova-compute[72782]:   <uuid>2c924d52-aa8a-47ed-857c-b863efe95258</uuid>
Aug 14 19:58:35 user nova-compute[72782]:   <name>instance-0000001e</name>
Aug 14 19:58:35 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:58:35 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:58:35 user nova-compute[72782]:   <metadata>
Aug 14 19:58:35 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:58:35 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:58:35 user nova-compute[72782]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-351871757</nova:name>
Aug 14 19:58:35 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:58:35</nova:creationTime>
Aug 14 19:58:35 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:58:35 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:58:35 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:58:35 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:58:35 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:58:35 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:58:35 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:58:35 user nova-compute[72782]:       <nova:owner>
Aug 14 19:58:35 user nova-compute[72782]:         <nova:user uuid="d2d39528bc994a25b9e6fea9f6b8b34c">tempest-ServerRescueNegativeTestJSON-1321611883-project-member</nova:user>
Aug 14 19:58:35 user nova-compute[72782]:         <nova:project uuid="14952037d1dc44e7b64d0663c7a033c8">tempest-ServerRescueNegativeTestJSON-1321611883</nova:project>
Aug 14 19:58:35 user nova-compute[72782]:       </nova:owner>
Aug 14 19:58:35 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 19:58:35 user nova-compute[72782]:       <nova:ports>
Aug 14 19:58:35 user nova-compute[72782]:         <nova:port uuid="8b971464-be37-4d45-a3c6-05d413e65cb2">
Aug 14 19:58:35 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 19:58:35 user nova-compute[72782]:         </nova:port>
Aug 14 19:58:35 user nova-compute[72782]:       </nova:ports>
Aug 14 19:58:35 user nova-compute[72782]:     </nova:instance>
Aug 14 19:58:35 user nova-compute[72782]:   </metadata>
Aug 14 19:58:35 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:58:35 user nova-compute[72782]:     <system>
Aug 14 19:58:35 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:58:35 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:58:35 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:58:35 user nova-compute[72782]:       <entry name="serial">2c924d52-aa8a-47ed-857c-b863efe95258</entry>
Aug 14 19:58:35 user nova-compute[72782]:       <entry name="uuid">2c924d52-aa8a-47ed-857c-b863efe95258</entry>
Aug 14 19:58:35 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:58:35 user nova-compute[72782]:     </system>
Aug 14 19:58:35 user nova-compute[72782]:   </sysinfo>
Aug 14 19:58:35 user nova-compute[72782]:   <os>
Aug 14 19:58:35 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:58:35 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:58:35 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:58:35 user nova-compute[72782]:   </os>
Aug 14 19:58:35 user nova-compute[72782]:   <features>
Aug 14 19:58:35 user nova-compute[72782]:     <acpi/>
Aug 14 19:58:35 user nova-compute[72782]:     <apic/>
Aug 14 19:58:35 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:58:35 user nova-compute[72782]:   </features>
Aug 14 19:58:35 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:58:35 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:58:35 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:58:35 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:58:35 user nova-compute[72782]:   </clock>
Aug 14 19:58:35 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:58:35 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:58:35 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:58:35 user nova-compute[72782]:   </cpu>
Aug 14 19:58:35 user nova-compute[72782]:   <devices>
Aug 14 19:58:35 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 19:58:35 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:58:35 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk"/>
Aug 14 19:58:35 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:58:35 user nova-compute[72782]:     </disk>
Aug 14 19:58:35 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:58:35 user nova-compute[72782]:       <mac address="fa:16:3e:a0:14:ff"/>
Aug 14 19:58:35 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:58:35 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:58:35 user nova-compute[72782]:       <target dev="tap8b971464-be"/>
Aug 14 19:58:35 user nova-compute[72782]:     </interface>
Aug 14 19:58:35 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:58:35 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/console.log" append="off"/>
Aug 14 19:58:35 user nova-compute[72782]:     </serial>
Aug 14 19:58:35 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:58:35 user nova-compute[72782]:     <video>
Aug 14 19:58:35 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:58:35 user nova-compute[72782]:     </video>
Aug 14 19:58:35 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:58:35 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:58:35 user nova-compute[72782]:     </rng>
Aug 14 19:58:35 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:58:35 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:58:35 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:58:35 user nova-compute[72782]:     </memballoon>
Aug 14 19:58:35 user nova-compute[72782]:   </devices>
Aug 14 19:58:35 user nova-compute[72782]: </domain>
Aug 14 19:58:35 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-351871757',display_name='tempest-ServerRescueNegativeTestJSON-server-351871757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-351871757',id=30,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14952037d1dc44e7b64d0663c7a033c8',ramdisk_id='',reservation_id='r-og2q6lkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1321611883',owner_user_name='tempest-ServerRescueNegativeTestJSON-1321611883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:58:33Z,user_data=None,user_id='d2d39528bc994a25b9e6fea9f6b8b34c',uuid=2c924d52-aa8a-47ed-857c-b863efe95258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b971464-be37-4d45-a3c6-05d413e65cb2", "address": "fa:16:3e:a0:14:ff", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b971464-be", "ovs_interfaceid": "8b971464-be37-4d45-a3c6-05d413e65cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converting VIF {"id": "8b971464-be37-4d45-a3c6-05d413e65cb2", "address": "fa:16:3e:a0:14:ff", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b971464-be", "ovs_interfaceid": "8b971464-be37-4d45-a3c6-05d413e65cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:14:ff,bridge_name='br-int',has_traffic_filtering=True,id=8b971464-be37-4d45-a3c6-05d413e65cb2,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b971464-be') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG os_vif [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:14:ff,bridge_name='br-int',has_traffic_filtering=True,id=8b971464-be37-4d45-a3c6-05d413e65cb2,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b971464-be') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b971464-be, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b971464-be, col_values=(('external_ids', {'iface-id': '8b971464-be37-4d45-a3c6-05d413e65cb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:14:ff', 'vm-uuid': '2c924d52-aa8a-47ed-857c-b863efe95258'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:35 user nova-compute[72782]: INFO os_vif [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:14:ff,bridge_name='br-int',has_traffic_filtering=True,id=8b971464-be37-4d45-a3c6-05d413e65cb2,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b971464-be')
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:58:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] No VIF found with MAC fa:16:3e:a0:14:ff, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-38564dc0-ab37-463a-b8fe-16730c0cf7b8 req-963c9a34-875f-4dd3-b7d3-48647f41f743 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received event network-changed-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-38564dc0-ab37-463a-b8fe-16730c0cf7b8 req-963c9a34-875f-4dd3-b7d3-48647f41f743 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Refreshing instance network info cache due to event network-changed-8b971464-be37-4d45-a3c6-05d413e65cb2. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-38564dc0-ab37-463a-b8fe-16730c0cf7b8 req-963c9a34-875f-4dd3-b7d3-48647f41f743 service nova] Acquiring lock "refresh_cache-2c924d52-aa8a-47ed-857c-b863efe95258" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-38564dc0-ab37-463a-b8fe-16730c0cf7b8 req-963c9a34-875f-4dd3-b7d3-48647f41f743 service nova] Acquired lock "refresh_cache-2c924d52-aa8a-47ed-857c-b863efe95258" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.network.neutron [req-38564dc0-ab37-463a-b8fe-16730c0cf7b8 req-963c9a34-875f-4dd3-b7d3-48647f41f743 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Refreshing network info cache for port 8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043116.2771657, ebed33f0-94c7-4094-a181-335784ab8819 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:58:36 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ebed33f0-94c7-4094-a181-335784ab8819] VM Resumed (Lifecycle Event)
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:58:36 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Instance spawned successfully.
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:58:36 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ebed33f0-94c7-4094-a181-335784ab8819] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043116.2821689, ebed33f0-94c7-4094-a181-335784ab8819 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:58:36 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ebed33f0-94c7-4094-a181-335784ab8819] VM Started (Lifecycle Event)
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:58:36 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ebed33f0-94c7-4094-a181-335784ab8819] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:58:36 user nova-compute[72782]: INFO nova.compute.manager [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Took 6.03 seconds to spawn the instance on the hypervisor.
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-9bd3ea94-e693-443c-99b5-18da8f26e562 req-e9fa3e58-6391-44ed-93c7-b61b9f92f65d service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Received event network-vif-plugged-f161b84e-9df3-4c23-9202-a814824405f7 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9bd3ea94-e693-443c-99b5-18da8f26e562 req-e9fa3e58-6391-44ed-93c7-b61b9f92f65d service nova] Acquiring lock "ebed33f0-94c7-4094-a181-335784ab8819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9bd3ea94-e693-443c-99b5-18da8f26e562 req-e9fa3e58-6391-44ed-93c7-b61b9f92f65d service nova] Lock "ebed33f0-94c7-4094-a181-335784ab8819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9bd3ea94-e693-443c-99b5-18da8f26e562 req-e9fa3e58-6391-44ed-93c7-b61b9f92f65d service nova] Lock "ebed33f0-94c7-4094-a181-335784ab8819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-9bd3ea94-e693-443c-99b5-18da8f26e562 req-e9fa3e58-6391-44ed-93c7-b61b9f92f65d service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] No waiting events found dispatching network-vif-plugged-f161b84e-9df3-4c23-9202-a814824405f7 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:58:36 user nova-compute[72782]: WARNING nova.compute.manager [req-9bd3ea94-e693-443c-99b5-18da8f26e562 req-e9fa3e58-6391-44ed-93c7-b61b9f92f65d service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Received unexpected event network-vif-plugged-f161b84e-9df3-4c23-9202-a814824405f7 for instance with vm_state building and task_state spawning.
Aug 14 19:58:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:36 user nova-compute[72782]: INFO nova.compute.manager [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Took 6.74 seconds to build instance.
Aug 14 19:58:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-56c73f3c-101a-43b4-a4ba-4a2ab4e0058c tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lock "ebed33f0-94c7-4094-a181-335784ab8819" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.909s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.network.neutron [req-38564dc0-ab37-463a-b8fe-16730c0cf7b8 req-963c9a34-875f-4dd3-b7d3-48647f41f743 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Updated VIF entry in instance network info cache for port 8b971464-be37-4d45-a3c6-05d413e65cb2. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG nova.network.neutron [req-38564dc0-ab37-463a-b8fe-16730c0cf7b8 req-963c9a34-875f-4dd3-b7d3-48647f41f743 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Updating instance_info_cache with network_info: [{"id": "8b971464-be37-4d45-a3c6-05d413e65cb2", "address": "fa:16:3e:a0:14:ff", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b971464-be", "ovs_interfaceid": "8b971464-be37-4d45-a3c6-05d413e65cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:58:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-38564dc0-ab37-463a-b8fe-16730c0cf7b8 req-963c9a34-875f-4dd3-b7d3-48647f41f743 service nova] Releasing lock "refresh_cache-2c924d52-aa8a-47ed-857c-b863efe95258" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:58:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] No waiting events found dispatching network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:58:38 user nova-compute[72782]: WARNING nova.compute.manager [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received unexpected event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 for instance with vm_state building and task_state spawning.
Aug 14 19:58:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] No waiting events found dispatching network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:58:38 user nova-compute[72782]: WARNING nova.compute.manager [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received unexpected event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 for instance with vm_state building and task_state spawning.
Aug 14 19:58:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received event network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] Acquiring lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] No waiting events found dispatching network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:58:38 user nova-compute[72782]: WARNING nova.compute.manager [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received unexpected event network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 for instance with vm_state building and task_state spawning.
Aug 14 19:58:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received event network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] Acquiring lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] No waiting events found dispatching network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:58:38 user nova-compute[72782]: WARNING nova.compute.manager [req-eebe134a-bb55-4514-b4b5-f2a8ef7c1580 req-a5e95fe0-da31-458f-975c-222c0839fcd9 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received unexpected event network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 for instance with vm_state building and task_state spawning.
Aug 14 19:58:39 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043119.9704463, 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:58:39 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] VM Resumed (Lifecycle Event)
Aug 14 19:58:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:58:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:58:39 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Instance spawned successfully.
Aug 14 19:58:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:58:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:58:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:58:40 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043119.9744701, 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:58:40 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] VM Started (Lifecycle Event)
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:58:40 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043120.092732, 2c924d52-aa8a-47ed-857c-b863efe95258 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:58:40 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] VM Resumed (Lifecycle Event)
Aug 14 19:58:40 user nova-compute[72782]: INFO nova.compute.manager [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Took 8.17 seconds to spawn the instance on the hypervisor.
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:58:40 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Instance spawned successfully.
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:58:40 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043120.1074927, 2c924d52-aa8a-47ed-857c-b863efe95258 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:58:40 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] VM Started (Lifecycle Event)
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:58:40 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:58:40 user nova-compute[72782]: INFO nova.compute.manager [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Took 7.43 seconds to spawn the instance on the hypervisor.
Aug 14 19:58:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:58:40 user nova-compute[72782]: INFO nova.compute.manager [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Took 9.03 seconds to build instance.
Aug 14 19:58:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c602bd04-4ba0-49bb-9467-11d8135c3549 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.134s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:40 user nova-compute[72782]: INFO nova.compute.manager [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Took 8.47 seconds to build instance.
Aug 14 19:58:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8bb4c580-c041-492f-9871-e9d1d4d1d03c tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "2c924d52-aa8a-47ed-857c-b863efe95258" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.569s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:58:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:58:55 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:58:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:58:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:58:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-d0ffe207-a89e-41ef-85af-7927ce06627e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:58:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-d0ffe207-a89e-41ef-85af-7927ce06627e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:58:58 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:58:58 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Updating instance_info_cache with network_info: [{"id": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "address": "fa:16:3e:fa:0f:ec", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5a9b82-2e", "ovs_interfaceid": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:58:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-d0ffe207-a89e-41ef-85af-7927ce06627e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:58:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "f057c9c2-9c75-4c4b-8f95-444f135e4056" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "f057c9c2-9c75-4c4b-8f95-444f135e4056-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:59 user nova-compute[72782]: INFO nova.compute.manager [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Terminating instance
Aug 14 19:58:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG nova.compute.manager [req-f81b6926-633d-4b8f-a6ef-6e8260ddf135 req-5f63f131-9aa8-4112-a154-a196fd63354c service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Received event network-vif-unplugged-4a2c9016-fb98-43d4-8d02-ccc26f4698bb {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f81b6926-633d-4b8f-a6ef-6e8260ddf135 req-5f63f131-9aa8-4112-a154-a196fd63354c service nova] Acquiring lock "f057c9c2-9c75-4c4b-8f95-444f135e4056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f81b6926-633d-4b8f-a6ef-6e8260ddf135 req-5f63f131-9aa8-4112-a154-a196fd63354c service nova] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f81b6926-633d-4b8f-a6ef-6e8260ddf135 req-5f63f131-9aa8-4112-a154-a196fd63354c service nova] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG nova.compute.manager [req-f81b6926-633d-4b8f-a6ef-6e8260ddf135 req-5f63f131-9aa8-4112-a154-a196fd63354c service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] No waiting events found dispatching network-vif-unplugged-4a2c9016-fb98-43d4-8d02-ccc26f4698bb {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG nova.compute.manager [req-f81b6926-633d-4b8f-a6ef-6e8260ddf135 req-5f63f131-9aa8-4112-a154-a196fd63354c service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Received event network-vif-unplugged-4a2c9016-fb98-43d4-8d02-ccc26f4698bb for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:58:59 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Instance destroyed successfully.
Aug 14 19:58:59 user nova-compute[72782]: DEBUG nova.objects.instance [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lazy-loading 'resources' on Instance uuid f057c9c2-9c75-4c4b-8f95-444f135e4056 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-516756219',display_name='tempest-AttachVolumeNegativeTest-server-516756219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-516756219',id=25,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPL93JDJNiwO4gbzcF47ql19bRsBAdBx6MvY/SUJw3D7FAqil4AexoHt74dlw+j7BCQeEDhJCtbE7GB/Ntaa2Gq8osw6GzLVJHiKhTJTpw7ir0XfejLXL48P9ELNukAtQ==',key_name='tempest-keypair-41767071',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:56:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2c26e0199de48ee8c48dde8177bc519',ramdisk_id='',reservation_id='r-umfo4qep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1229463629',owner_user_name='tempest-AttachVolumeNegativeTest-1229463629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:56:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0cada11ffdb4ebc8d9e80218818ec3b',uuid=f057c9c2-9c75-4c4b-8f95-444f135e4056,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "address": "fa:16:3e:43:c6:df", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c9016-fb", "ovs_interfaceid": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converting VIF {"id": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "address": "fa:16:3e:43:c6:df", "network": {"id": "10eb6fd6-aa4e-45fc-abce-163d6c1e4721", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902671691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2c26e0199de48ee8c48dde8177bc519", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2c9016-fb", "ovs_interfaceid": "4a2c9016-fb98-43d4-8d02-ccc26f4698bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:c6:df,bridge_name='br-int',has_traffic_filtering=True,id=4a2c9016-fb98-43d4-8d02-ccc26f4698bb,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2c9016-fb') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG os_vif [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:c6:df,bridge_name='br-int',has_traffic_filtering=True,id=4a2c9016-fb98-43d4-8d02-ccc26f4698bb,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2c9016-fb') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a2c9016-fb, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:58:59 user nova-compute[72782]: INFO os_vif [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:c6:df,bridge_name='br-int',has_traffic_filtering=True,id=4a2c9016-fb98-43d4-8d02-ccc26f4698bb,network=Network(10eb6fd6-aa4e-45fc-abce-163d6c1e4721),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2c9016-fb')
Aug 14 19:58:59 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Deleting instance files /opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056_del
Aug 14 19:58:59 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Deletion of /opt/stack/data/nova/instances/f057c9c2-9c75-4c4b-8f95-444f135e4056_del complete
Aug 14 19:58:59 user nova-compute[72782]: INFO nova.compute.manager [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 19:58:59 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:58:59 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:59:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:59:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:59:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:59:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:59:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:59:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:00 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:59:00 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Took 0.95 seconds to deallocate network for instance.
Aug 14 19:59:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-2011e36a-8618-4870-9c00-22da6306614e req-e0be4687-78e5-4c06-8505-e37a9457522b service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Received event network-vif-plugged-4a2c9016-fb98-43d4-8d02-ccc26f4698bb {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2011e36a-8618-4870-9c00-22da6306614e req-e0be4687-78e5-4c06-8505-e37a9457522b service nova] Acquiring lock "f057c9c2-9c75-4c4b-8f95-444f135e4056-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2011e36a-8618-4870-9c00-22da6306614e req-e0be4687-78e5-4c06-8505-e37a9457522b service nova] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2011e36a-8618-4870-9c00-22da6306614e req-e0be4687-78e5-4c06-8505-e37a9457522b service nova] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-2011e36a-8618-4870-9c00-22da6306614e req-e0be4687-78e5-4c06-8505-e37a9457522b service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] No waiting events found dispatching network-vif-plugged-4a2c9016-fb98-43d4-8d02-ccc26f4698bb {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:59:01 user nova-compute[72782]: WARNING nova.compute.manager [req-2011e36a-8618-4870-9c00-22da6306614e req-e0be4687-78e5-4c06-8505-e37a9457522b service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Received unexpected event network-vif-plugged-4a2c9016-fb98-43d4-8d02-ccc26f4698bb for instance with vm_state deleted and task_state None.
Aug 14 19:59:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-2011e36a-8618-4870-9c00-22da6306614e req-e0be4687-78e5-4c06-8505-e37a9457522b service nova] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Received event network-vif-deleted-4a2c9016-fb98-43d4-8d02-ccc26f4698bb {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:01 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Deleted allocations for instance f057c9c2-9c75-4c4b-8f95-444f135e4056
Aug 14 19:59:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-73847763-6c7e-4901-b6ee-8daecf3e902b tempest-AttachVolumeNegativeTest-1229463629 tempest-AttachVolumeNegativeTest-1229463629-project-member] Lock "f057c9c2-9c75-4c4b-8f95-444f135e4056" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.709s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 19:59:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:04 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:59:04 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:59:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7170MB free_disk=25.272598266601562GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:59:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:59:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance d0ffe207-a89e-41ef-85af-7927ce06627e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:59:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:59:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance a4ae2e60-c4d4-4a7e-826e-fb315fa98138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:59:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance c748103b-a37c-47c5-8394-ea54749f27eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:59:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ad4011a9-ab9f-4647-b677-a1c6337d2c2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:59:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:59:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ebed33f0-94c7-4094-a181-335784ab8819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:59:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:59:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2c924d52-aa8a-47ed-857c-b863efe95258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:59:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:59:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:59:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:04 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:59:04 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:59:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:59:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.456s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:59:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:05 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:59:05 user nova-compute[72782]: INFO nova.compute.claims [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Claim successful on node user
Aug 14 19:59:06 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG nova.compute.manager [req-fbf804cb-24bd-456f-8ca9-d80f7324c0c4 req-0f32fbb8-6a0d-4b0d-a775-dd301c7114e0 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Received event network-changed-4e700e02-4ab0-47e7-98c5-fab5d76d37a6 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG nova.compute.manager [req-fbf804cb-24bd-456f-8ca9-d80f7324c0c4 req-0f32fbb8-6a0d-4b0d-a775-dd301c7114e0 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Refreshing instance network info cache due to event network-changed-4e700e02-4ab0-47e7-98c5-fab5d76d37a6. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fbf804cb-24bd-456f-8ca9-d80f7324c0c4 req-0f32fbb8-6a0d-4b0d-a775-dd301c7114e0 service nova] Acquiring lock "refresh_cache-64face75-3aba-4cb8-8ff2-a1bbdf9835e1" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fbf804cb-24bd-456f-8ca9-d80f7324c0c4 req-0f32fbb8-6a0d-4b0d-a775-dd301c7114e0 service nova] Acquired lock "refresh_cache-64face75-3aba-4cb8-8ff2-a1bbdf9835e1" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG nova.network.neutron [req-fbf804cb-24bd-456f-8ca9-d80f7324c0c4 req-0f32fbb8-6a0d-4b0d-a775-dd301c7114e0 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Refreshing network info cache for port 4e700e02-4ab0-47e7-98c5-fab5d76d37a6 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:59:06 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:59:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:59:06 user nova-compute[72782]: INFO nova.virt.block_device [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Booting with volume 029bcc2b-b3c5-4483-b696-5218bfe52e0d at /dev/vda
Aug 14 19:59:06 user nova-compute[72782]: DEBUG os_brick.utils [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1c52f7-bfaa-4d8c-93eb-63d3b3f47182]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG nova.policy [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a38fa907d804b81903eb97ab88ae181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c0483a97574e7794c73fe43e51795e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce432a63-7cc0-4647-ae95-e14bc553a583]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.036s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ab0d81-4d4a-4714-9b14-5cffc1941671]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f30f346-d728-45a3-9897-d9db5b96a1fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:59:06 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[46021681-178d-4891-9aa8-a69e19da8798]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG os_brick.utils [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Updating existing volume attachment record: ce7a5856-fefc-4687-8f33-5383ac60aa7b {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG nova.objects.instance [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lazy-loading 'flavor' on Instance uuid 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:59:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:07 user nova-compute[72782]: INFO nova.compute.manager [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Attaching volume 78ce2fd5-ab80-48fc-9234-3d4e94329609 to /dev/vdb
Aug 14 19:59:07 user nova-compute[72782]: DEBUG nova.network.neutron [req-fbf804cb-24bd-456f-8ca9-d80f7324c0c4 req-0f32fbb8-6a0d-4b0d-a775-dd301c7114e0 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Updated VIF entry in instance network info cache for port 4e700e02-4ab0-47e7-98c5-fab5d76d37a6. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG nova.network.neutron [req-fbf804cb-24bd-456f-8ca9-d80f7324c0c4 req-0f32fbb8-6a0d-4b0d-a775-dd301c7114e0 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Updating instance_info_cache with network_info: [{"id": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "address": "fa:16:3e:6f:8e:bd", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e700e02-4a", "ovs_interfaceid": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fbf804cb-24bd-456f-8ca9-d80f7324c0c4 req-0f32fbb8-6a0d-4b0d-a775-dd301c7114e0 service nova] Releasing lock "refresh_cache-64face75-3aba-4cb8-8ff2-a1bbdf9835e1" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG os_brick.utils [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f14b1b-6929-4edf-84e4-2ea272609a87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5acef21-0861-4329-b980-590d013761f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe62295e-da69-40ac-9a6d-f37a0f657b66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4488a466-ed1a-4803-8a71-3b2e6fd1ec6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:59:07 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:59:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3779ef3f-38d3-4242-b694-b883e0685132]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG os_brick.utils [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Updating existing volume attachment record: c241209e-af7e-4fff-ad43-d6181d2f1d1c {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Successfully created port: e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:59:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:59:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:59:08 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Successfully updated port: e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:59:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "refresh_cache-ca7d1bf8-168b-4484-a965-72ff0aea93ef" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:59:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquired lock "refresh_cache-ca7d1bf8-168b-4484-a965-72ff0aea93ef" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:59:08 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:59:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-ab85b8b4-eff1-426d-9904-3f9172e4ae5a req-2da1ced5-14f4-4896-87dc-24c68270f842 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received event network-changed-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:59:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-ab85b8b4-eff1-426d-9904-3f9172e4ae5a req-2da1ced5-14f4-4896-87dc-24c68270f842 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Refreshing instance network info cache due to event network-changed-e2aad177-8aef-4cc1-98a3-9ee3117db998. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:59:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ab85b8b4-eff1-426d-9904-3f9172e4ae5a req-2da1ced5-14f4-4896-87dc-24c68270f842 service nova] Acquiring lock "refresh_cache-ca7d1bf8-168b-4484-a965-72ff0aea93ef" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:59:08 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:59:09 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Updating instance_info_cache with network_info: [{"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:59:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Releasing lock "refresh_cache-ca7d1bf8-168b-4484-a965-72ff0aea93ef" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:59:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Instance network_info: |[{"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:59:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ab85b8b4-eff1-426d-9904-3f9172e4ae5a req-2da1ced5-14f4-4896-87dc-24c68270f842 service nova] Acquired lock "refresh_cache-ca7d1bf8-168b-4484-a965-72ff0aea93ef" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:59:09 user nova-compute[72782]: DEBUG nova.network.neutron [req-ab85b8b4-eff1-426d-9904-3f9172e4ae5a req-2da1ced5-14f4-4896-87dc-24c68270f842 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Refreshing network info cache for port e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:59:09 user nova-compute[72782]: DEBUG nova.network.neutron [req-ab85b8b4-eff1-426d-9904-3f9172e4ae5a req-2da1ced5-14f4-4896-87dc-24c68270f842 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Updated VIF entry in instance network info cache for port e2aad177-8aef-4cc1-98a3-9ee3117db998. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:59:09 user nova-compute[72782]: DEBUG nova.network.neutron [req-ab85b8b4-eff1-426d-9904-3f9172e4ae5a req-2da1ced5-14f4-4896-87dc-24c68270f842 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Updating instance_info_cache with network_info: [{"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:59:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ab85b8b4-eff1-426d-9904-3f9172e4ae5a req-2da1ced5-14f4-4896-87dc-24c68270f842 service nova] Releasing lock "refresh_cache-ca7d1bf8-168b-4484-a965-72ff0aea93ef" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:59:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:14 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692043139.798261, f057c9c2-9c75-4c4b-8f95-444f135e4056 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:59:14 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] VM Stopped (Lifecycle Event)
Aug 14 19:59:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4ac920e1-0275-4974-bdeb-518a0ab4df6a None None] [instance: f057c9c2-9c75-4c4b-8f95-444f135e4056] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:59:15 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Creating image(s)
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Did not create local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Ensure instance console log exists: /opt/stack/data/nova/instances/ca7d1bf8-168b-4484-a965-72ff0aea93ef/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Start _get_guest_xml network_info=[{"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'ce7a5856-fefc-4687-8f33-5383ac60aa7b', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcytDLPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ca7d1bf8-168b-4484-a965-72ff0aea93ef', 'attached_at': '', 'detached_at': '', 'volume_id': '029bcc2b-b3c5-4483-b696-5218bfe52e0d', 'serial': '029bcc2b-b3c5-4483-b696-5218bfe52e0d'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:59:15 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:59:15 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcytDLPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:59:15 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:59:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:59:15 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:59:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:59:15 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfb168b-7708-417b-8571-3d4341a9a4ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:59:15 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c26a69-2fde-4b7d-ba58-0daa78716447]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d] added
Aug 14 19:59:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[db92d2f6-9153-4e4d-8e3d-8784755864d0]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d0cdfa-68c2-4b54-98d6-2f677411ffc8]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcytDLPb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcytDLPb" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18b872e-168e-4fed-a471-568e9c710347]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CcytDLPb'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[77688fcc-5893-4eae-8080-553756a59c38]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fba334-b4d6-43a4-9fe5-c0f15e877b9f]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:59:15 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:59:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:59:15 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:59:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c7b7ec-4611-4107-b9da-fe7bc5fc7c37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d, portal: 172.16.0.220,3260]
Aug 14 19:59:15 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d, portal: 172.16.0.220,3260] successful.
Aug 14 19:59:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc52252-d794-48bf-83e6-2358545e4165]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LsMQeBEZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:59:16 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:59:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a79914d-d79d-4768-9f73-299277250430]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:59:16 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:59:16 user nova-compute[72782]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 19:59:16 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:59:16 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:59:16 user nova-compute[72782]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 19:59:16 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb3f2d2-9a02-443d-b9b3-999ded56c806]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:59:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcytDLPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26364346639356230', 'path': '/dev/sdd'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364346639356230', 'path': '/dev/sdd'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.036s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:59:17 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:59:17 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:59:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-392999089',display_name='tempest-ServerActionsTestOtherA-server-392999089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-392999089',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjPa06vtlcnEwf9WmNngHo77ZQLE/dqlpBjCZ69lCWox+6yOHeDlaru6JozyQO8VPG/SE5WTpKRBcOS1LznFcAxBQR7z97DyBcD1Q9ZGwfJ2pOvn+iIjcliFOke0KJwkg==',key_name='tempest-keypair-525631678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6c0483a97574e7794c73fe43e51795e',ramdisk_id='',reservation_id='r-54bl51xf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-956209876',owner_user_name='tempest-ServerActionsTestOtherA-956209876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:59:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a38fa907d804b81903eb97ab88ae181',uuid=ca7d1bf8-168b-4484-a965-72ff0aea93ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converting VIF {"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=e2aad177-8aef-4cc1-98a3-9ee3117db998,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aad177-8a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'pci_devices' on Instance uuid ca7d1bf8-168b-4484-a965-72ff0aea93ef {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c46cb30-3ad7-4cac-ab10-1f38b1833252]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:59:17 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:59:17 user nova-compute[72782]:   <uuid>ca7d1bf8-168b-4484-a965-72ff0aea93ef</uuid>
Aug 14 19:59:17 user nova-compute[72782]:   <name>instance-0000001f</name>
Aug 14 19:59:17 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 19:59:17 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 19:59:17 user nova-compute[72782]:   <metadata>
Aug 14 19:59:17 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:59:17 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 19:59:17 user nova-compute[72782]:       <nova:name>tempest-ServerActionsTestOtherA-server-392999089</nova:name>
Aug 14 19:59:17 user nova-compute[72782]:       <nova:creationTime>2023-08-14 19:59:15</nova:creationTime>
Aug 14 19:59:17 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 19:59:17 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 19:59:17 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 19:59:17 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 19:59:17 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:59:17 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:59:17 user nova-compute[72782]:       </nova:flavor>
Aug 14 19:59:17 user nova-compute[72782]:       <nova:owner>
Aug 14 19:59:17 user nova-compute[72782]:         <nova:user uuid="8a38fa907d804b81903eb97ab88ae181">tempest-ServerActionsTestOtherA-956209876-project-member</nova:user>
Aug 14 19:59:17 user nova-compute[72782]:         <nova:project uuid="b6c0483a97574e7794c73fe43e51795e">tempest-ServerActionsTestOtherA-956209876</nova:project>
Aug 14 19:59:17 user nova-compute[72782]:       </nova:owner>
Aug 14 19:59:17 user nova-compute[72782]:       <nova:ports>
Aug 14 19:59:17 user nova-compute[72782]:         <nova:port uuid="e2aad177-8aef-4cc1-98a3-9ee3117db998">
Aug 14 19:59:17 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 19:59:17 user nova-compute[72782]:         </nova:port>
Aug 14 19:59:17 user nova-compute[72782]:       </nova:ports>
Aug 14 19:59:17 user nova-compute[72782]:     </nova:instance>
Aug 14 19:59:17 user nova-compute[72782]:   </metadata>
Aug 14 19:59:17 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 19:59:17 user nova-compute[72782]:     <system>
Aug 14 19:59:17 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:59:17 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:59:17 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 19:59:17 user nova-compute[72782]:       <entry name="serial">ca7d1bf8-168b-4484-a965-72ff0aea93ef</entry>
Aug 14 19:59:17 user nova-compute[72782]:       <entry name="uuid">ca7d1bf8-168b-4484-a965-72ff0aea93ef</entry>
Aug 14 19:59:17 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:59:17 user nova-compute[72782]:     </system>
Aug 14 19:59:17 user nova-compute[72782]:   </sysinfo>
Aug 14 19:59:17 user nova-compute[72782]:   <os>
Aug 14 19:59:17 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:59:17 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 19:59:17 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 19:59:17 user nova-compute[72782]:   </os>
Aug 14 19:59:17 user nova-compute[72782]:   <features>
Aug 14 19:59:17 user nova-compute[72782]:     <acpi/>
Aug 14 19:59:17 user nova-compute[72782]:     <apic/>
Aug 14 19:59:17 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 19:59:17 user nova-compute[72782]:   </features>
Aug 14 19:59:17 user nova-compute[72782]:   <clock offset="utc">
Aug 14 19:59:17 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:59:17 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:59:17 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 19:59:17 user nova-compute[72782]:   </clock>
Aug 14 19:59:17 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 19:59:17 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 19:59:17 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:59:17 user nova-compute[72782]:   </cpu>
Aug 14 19:59:17 user nova-compute[72782]:   <devices>
Aug 14 19:59:17 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 19:59:17 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:59:17 user nova-compute[72782]:       <source dev="/dev/sdd"/>
Aug 14 19:59:17 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 19:59:17 user nova-compute[72782]:       <serial>029bcc2b-b3c5-4483-b696-5218bfe52e0d</serial>
Aug 14 19:59:17 user nova-compute[72782]:     </disk>
Aug 14 19:59:17 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 19:59:17 user nova-compute[72782]:       <mac address="fa:16:3e:fc:64:3b"/>
Aug 14 19:59:17 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:59:17 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 19:59:17 user nova-compute[72782]:       <target dev="tape2aad177-8a"/>
Aug 14 19:59:17 user nova-compute[72782]:     </interface>
Aug 14 19:59:17 user nova-compute[72782]:     <serial type="pty">
Aug 14 19:59:17 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/ca7d1bf8-168b-4484-a965-72ff0aea93ef/console.log" append="off"/>
Aug 14 19:59:17 user nova-compute[72782]:     </serial>
Aug 14 19:59:17 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:59:17 user nova-compute[72782]:     <video>
Aug 14 19:59:17 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 19:59:17 user nova-compute[72782]:     </video>
Aug 14 19:59:17 user nova-compute[72782]:     <rng model="virtio">
Aug 14 19:59:17 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:59:17 user nova-compute[72782]:     </rng>
Aug 14 19:59:17 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:59:17 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 19:59:17 user nova-compute[72782]:       <stats period="10"/>
Aug 14 19:59:17 user nova-compute[72782]:     </memballoon>
Aug 14 19:59:17 user nova-compute[72782]:   </devices>
Aug 14 19:59:17 user nova-compute[72782]: </domain>
Aug 14 19:59:17 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:59:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-392999089',display_name='tempest-ServerActionsTestOtherA-server-392999089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-392999089',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjPa06vtlcnEwf9WmNngHo77ZQLE/dqlpBjCZ69lCWox+6yOHeDlaru6JozyQO8VPG/SE5WTpKRBcOS1LznFcAxBQR7z97DyBcD1Q9ZGwfJ2pOvn+iIjcliFOke0KJwkg==',key_name='tempest-keypair-525631678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6c0483a97574e7794c73fe43e51795e',ramdisk_id='',reservation_id='r-54bl51xf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-956209876',owner_user_name='tempest-ServerActionsTestOtherA-956209876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:59:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a38fa907d804b81903eb97ab88ae181',uuid=ca7d1bf8-168b-4484-a965-72ff0aea93ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converting VIF {"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=e2aad177-8aef-4cc1-98a3-9ee3117db998,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aad177-8a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_vif [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=e2aad177-8aef-4cc1-98a3-9ee3117db998,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aad177-8a') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cafe78-430a-4867-a898-2652659e831e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609] added
Aug 14 19:59:17 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2aad177-8a, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2aad177-8a, col_values=(('external_ids', {'iface-id': 'e2aad177-8aef-4cc1-98a3-9ee3117db998', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:64:3b', 'vm-uuid': 'ca7d1bf8-168b-4484-a965-72ff0aea93ef'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:17 user nova-compute[72782]: INFO os_vif [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=e2aad177-8aef-4cc1-98a3-9ee3117db998,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aad177-8a')
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ccf16a-0490-446b-b7cb-ccecdc20813b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d800116-502b-4f70-b9a6-970116748699]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LsMQeBEZ {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] No VIF found with MAC fa:16:3e:fc:64:3b, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LsMQeBEZ" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[528aa9ee-e703-4033-8184-78bb54082646]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LsMQeBEZ'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e3dc9a-0f47-492b-85ed-20623471628e]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4a3446-0482-463a-befe-95ab820a9a6f]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:59:17 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:59:17 user nova-compute[72782]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 19:59:17 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:59:17 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:59:17 user nova-compute[72782]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 19:59:17 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[da56b27a-9966-49fc-8af2-762b1ac54a94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609, portal: 172.16.0.220,3260]
Aug 14 19:59:17 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609, portal: 172.16.0.220,3260] successful.
Aug 14 19:59:17 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66fb6c1-0068-416e-bf0b-5034dab07de4]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5a0739-76a4-49f3-8cde-00b2e2b56454]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:59:17 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:59:17 user nova-compute[72782]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 19:59:17 user nova-compute[72782]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 (non-flash)
Aug 14 19:59:17 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:59:17 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:59:17 user nova-compute[72782]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 19:59:17 user nova-compute[72782]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 (non-flash)
Aug 14 19:59:17 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[984c6587-ac6f-45da-a4d7-7088e3f0bc28]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:59:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LsMQeBEZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] <== connect_volume: return (2379ms) {'type': 'block', 'scsi_wwn': '26537643934326437', 'path': '/dev/sde'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537643934326437', 'path': '/dev/sde'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG nova.objects.instance [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lazy-loading 'flavor' on Instance uuid 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:59:18 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:59:18 user nova-compute[72782]:   <source dev="/dev/sde"/>
Aug 14 19:59:18 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:59:18 user nova-compute[72782]:   <serial>78ce2fd5-ab80-48fc-9234-3d4e94329609</serial>
Aug 14 19:59:18 user nova-compute[72782]: </disk>
Aug 14 19:59:18 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG nova.compute.manager [req-00fc8b5f-2ed7-4e94-9d69-b6674e85bf6f req-22fd31d9-2519-49bd-9604-9933a486a58c service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received event network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-00fc8b5f-2ed7-4e94-9d69-b6674e85bf6f req-22fd31d9-2519-49bd-9604-9933a486a58c service nova] Acquiring lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-00fc8b5f-2ed7-4e94-9d69-b6674e85bf6f req-22fd31d9-2519-49bd-9604-9933a486a58c service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-00fc8b5f-2ed7-4e94-9d69-b6674e85bf6f req-22fd31d9-2519-49bd-9604-9933a486a58c service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG nova.compute.manager [req-00fc8b5f-2ed7-4e94-9d69-b6674e85bf6f req-22fd31d9-2519-49bd-9604-9933a486a58c service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] No waiting events found dispatching network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:59:18 user nova-compute[72782]: WARNING nova.compute.manager [req-00fc8b5f-2ed7-4e94-9d69-b6674e85bf6f req-22fd31d9-2519-49bd-9604-9933a486a58c service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received unexpected event network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 for instance with vm_state building and task_state spawning.
Aug 14 19:59:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "c748103b-a37c-47c5-8394-ea54749f27eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:18 user nova-compute[72782]: INFO nova.compute.manager [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Terminating instance
Aug 14 19:59:18 user nova-compute[72782]: DEBUG nova.compute.manager [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-966bc7f4-c678-4eb9-99a6-b4ec5967fa91 req-d2973cc5-b275-43f0-b134-2cb2253d7c6c service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received event network-vif-unplugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-966bc7f4-c678-4eb9-99a6-b4ec5967fa91 req-d2973cc5-b275-43f0-b134-2cb2253d7c6c service nova] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-966bc7f4-c678-4eb9-99a6-b4ec5967fa91 req-d2973cc5-b275-43f0-b134-2cb2253d7c6c service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-966bc7f4-c678-4eb9-99a6-b4ec5967fa91 req-d2973cc5-b275-43f0-b134-2cb2253d7c6c service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-966bc7f4-c678-4eb9-99a6-b4ec5967fa91 req-d2973cc5-b275-43f0-b134-2cb2253d7c6c service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] No waiting events found dispatching network-vif-unplugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-966bc7f4-c678-4eb9-99a6-b4ec5967fa91 req-d2973cc5-b275-43f0-b134-2cb2253d7c6c service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received event network-vif-unplugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] No VIF found with MAC fa:16:3e:6f:8e:bd, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7cabf5e4-0851-48a7-834f-09b28067861d tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.331s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:19 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Instance destroyed successfully.
Aug 14 19:59:19 user nova-compute[72782]: DEBUG nova.objects.instance [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lazy-loading 'resources' on Instance uuid c748103b-a37c-47c5-8394-ea54749f27eb {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-541757814',display_name='tempest-ServerActionsTestOtherB-server-541757814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-541757814',id=17,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAarAxn7T7X51FB9WvWO3LMKvuHfCnYFXmKg73GAqFcCk71N2M9odae+ScSuYIAVSuzCKRu92FXDYUypvnCOyLRjSrxNpiNed5PJ7CB2bOBIRMco4NgzPsIxo+nrGJWEGg==',key_name='tempest-keypair-1073189448',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:56:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b283da9d5774739a1749f7684439c35',ramdisk_id='',reservation_id='r-2esch0g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1314711059',owner_user_name='tempest-ServerActionsTestOtherB-1314711059-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:56:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613ae0366fc5462081f877c1f2c40c7e',uuid=c748103b-a37c-47c5-8394-ea54749f27eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Converting VIF {"id": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "address": "fa:16:3e:5f:41:29", "network": {"id": "9d98e33a-819b-435e-b204-6871e846fb89", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-693085563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b283da9d5774739a1749f7684439c35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356eefe9-57", "ovs_interfaceid": "356eefe9-57d0-4af1-b7bd-842e2cfa33d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_vif [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap356eefe9-57, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:19 user nova-compute[72782]: INFO os_vif [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:41:29,bridge_name='br-int',has_traffic_filtering=True,id=356eefe9-57d0-4af1-b7bd-842e2cfa33d0,network=Network(9d98e33a-819b-435e-b204-6871e846fb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356eefe9-57')
Aug 14 19:59:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyJZBnql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:59:19 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f740e7f-fbea-4119-8865-c247f1142569]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c397fc-7f01-41c4-bc52-fd72a6457066]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:59:19 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:59:19 user nova-compute[72782]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 19:59:19 user nova-compute[72782]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 (non-flash)
Aug 14 19:59:19 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:59:19 user nova-compute[72782]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d (non-flash)
Aug 14 19:59:19 user nova-compute[72782]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 19:59:19 user nova-compute[72782]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 (non-flash)
Aug 14 19:59:19 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e86baef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[34312688-78a4-4738-83bf-d1e31f457cd6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f3320b-397a-4b55-a92e-a27becc5a06e]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6211acb8-383b-493b-9edd-2e000faa5943]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd20f917-10e1-4ac8-9343-01b92ba6ed34]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0210969b-b04e-48a7-9279-f6846131c265]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f68147-5525-4c28-89c7-730a22d5299b]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260]
Aug 14 19:59:19 user nova-compute[72782]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d, portal: 172.16.0.220,3260] successful.
Aug 14 19:59:19 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69e9edf2-c2d1-4226-bc9c-3bafe0415b7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e336e8-a9fe-465c-bd08-a0e7df94fe0c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] <== disconnect_volume: return (291ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:59:19 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Deleting instance files /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb_del
Aug 14 19:59:19 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Deletion of /opt/stack/data/nova/instances/c748103b-a37c-47c5-8394-ea54749f27eb_del complete
Aug 14 19:59:19 user nova-compute[72782]: INFO nova.compute.manager [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 14 19:59:19 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:59:19 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:59:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-94ff85ee-3d7f-4bec-aaf8-284b1f9e5730 req-88d8193e-9ecf-4645-b648-96ee997d5fa8 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received event network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:59:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-94ff85ee-3d7f-4bec-aaf8-284b1f9e5730 req-88d8193e-9ecf-4645-b648-96ee997d5fa8 service nova] Acquiring lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-94ff85ee-3d7f-4bec-aaf8-284b1f9e5730 req-88d8193e-9ecf-4645-b648-96ee997d5fa8 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-94ff85ee-3d7f-4bec-aaf8-284b1f9e5730 req-88d8193e-9ecf-4645-b648-96ee997d5fa8 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-94ff85ee-3d7f-4bec-aaf8-284b1f9e5730 req-88d8193e-9ecf-4645-b648-96ee997d5fa8 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] No waiting events found dispatching network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:59:20 user nova-compute[72782]: WARNING nova.compute.manager [req-94ff85ee-3d7f-4bec-aaf8-284b1f9e5730 req-88d8193e-9ecf-4645-b648-96ee997d5fa8 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received unexpected event network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 for instance with vm_state building and task_state spawning.
Aug 14 19:59:20 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:59:20 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Took 0.81 seconds to deallocate network for instance.
Aug 14 19:59:20 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043160.891827, ca7d1bf8-168b-4484-a965-72ff0aea93ef => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:59:20 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] VM Resumed (Lifecycle Event)
Aug 14 19:59:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:59:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:59:20 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Instance spawned successfully.
Aug 14 19:59:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:59:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:59:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:59:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:59:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:59:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:59:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:59:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:59:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:59:20 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:59:20 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043160.9016604, ca7d1bf8-168b-4484-a965-72ff0aea93ef => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:59:20 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] VM Started (Lifecycle Event)
Aug 14 19:59:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:59:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:59:20 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:59:21 user nova-compute[72782]: INFO nova.compute.manager [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Took 5.36 seconds to spawn the instance on the hypervisor.
Aug 14 19:59:21 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:59:21 user nova-compute[72782]: INFO nova.compute.manager [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Took 15.46 seconds to build instance.
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f853bcf-2c22-444d-b546-8504d3ecfc4d tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.587s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-eff406f8-ee30-4cb1-a933-876d236b51b0 req-e781afe4-f6f8-471e-afdf-6405c10c31dc service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received event network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eff406f8-ee30-4cb1-a933-876d236b51b0 req-e781afe4-f6f8-471e-afdf-6405c10c31dc service nova] Acquiring lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eff406f8-ee30-4cb1-a933-876d236b51b0 req-e781afe4-f6f8-471e-afdf-6405c10c31dc service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eff406f8-ee30-4cb1-a933-876d236b51b0 req-e781afe4-f6f8-471e-afdf-6405c10c31dc service nova] Lock "c748103b-a37c-47c5-8394-ea54749f27eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-eff406f8-ee30-4cb1-a933-876d236b51b0 req-e781afe4-f6f8-471e-afdf-6405c10c31dc service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] No waiting events found dispatching network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:59:21 user nova-compute[72782]: WARNING nova.compute.manager [req-eff406f8-ee30-4cb1-a933-876d236b51b0 req-e781afe4-f6f8-471e-afdf-6405c10c31dc service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received unexpected event network-vif-plugged-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 for instance with vm_state active and task_state deleting.
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:21 user nova-compute[72782]: INFO nova.compute.manager [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Detaching volume 78ce2fd5-ab80-48fc-9234-3d4e94329609
Aug 14 19:59:21 user nova-compute[72782]: INFO nova.virt.block_device [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Attempting to driver detach volume 78ce2fd5-ab80-48fc-9234-3d4e94329609 from mountpoint /dev/vdb
Aug 14 19:59:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Attempting to detach device vdb from instance 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:59:21 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:59:21 user nova-compute[72782]:   <source dev="/dev/sde"/>
Aug 14 19:59:21 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:59:21 user nova-compute[72782]:   <serial>78ce2fd5-ab80-48fc-9234-3d4e94329609</serial>
Aug 14 19:59:21 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:59:21 user nova-compute[72782]: </disk>
Aug 14 19:59:21 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:59:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Successfully detached device vdb from instance 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 from the persistent domain config.
Aug 14 19:59:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:59:21 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:59:21 user nova-compute[72782]:   <source dev="/dev/sde"/>
Aug 14 19:59:21 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:59:21 user nova-compute[72782]:   <serial>78ce2fd5-ab80-48fc-9234-3d4e94329609</serial>
Aug 14 19:59:21 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:59:21 user nova-compute[72782]: </disk>
Aug 14 19:59:21 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:59:21 user nova-compute[72782]: INFO nova.compute.manager [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Took 0.80 seconds to detach 1 volumes for instance.
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692043161.6997323, 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:59:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Successfully detached device vdb from instance 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 from the live domain config.
Aug 14 19:59:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LsMQeBEZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:59:21 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:59:21 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97b6217-6e0c-45ce-95d3-e751b3e1a7d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3f6dbb-7281-4bd7-8809-3f8968055c35]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:59:21 user nova-compute[72782]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 19:59:21 user nova-compute[72782]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 (non-flash)
Aug 14 19:59:21 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 19:59:21 user nova-compute[72782]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 19:59:21 user nova-compute[72782]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 (non-flash)
Aug 14 19:59:21 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e86ca290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609'): ({'sde'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Removing single pathed devices sde {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0490c6-8a4c-40c0-9c84-058323458a9c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[012a23e0-0a40-483d-ad9c-fb69858ac73c]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Flushing IO for device /dev/sde {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[37417e9c-4aaa-48fd-9090-1d57d736b8d1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[46223e88-3352-420a-ac91-ea9484d97d6e]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] SCSI volumes sde have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[33593cfd-6474-416c-971a-d16833731f18]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:21 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Deleted allocations for instance c748103b-a37c-47c5-8394-ea54749f27eb
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aca766-c608-4084-b202-68bcb8fdad9d]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609, portal: 172.16.0.220,3260]
Aug 14 19:59:21 user nova-compute[72782]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609, portal: 172.16.0.220,3260] successful.
Aug 14 19:59:21 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:59:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ce2fd5-ab80-48fc-9234-3d4e94329609 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:59:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[145c1a67-dc54-451d-817c-673e09f340e5]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:59:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:59:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:59:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] <== disconnect_volume: return (303ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:59:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:59:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-2196cbf2-3858-4470-a0c3-cd75d8b56818 tempest-ServerActionsTestOtherB-1314711059 tempest-ServerActionsTestOtherB-1314711059-project-member] Lock "c748103b-a37c-47c5-8394-ea54749f27eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.361s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:22 user nova-compute[72782]: DEBUG nova.compute.manager [req-2deb5007-ce0a-401e-bdb6-34e715bb5bbe req-82fd9990-39a1-468b-b235-18d5044ba80b service nova] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Received event network-vif-deleted-356eefe9-57d0-4af1-b7bd-842e2cfa33d0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:59:22 user nova-compute[72782]: DEBUG nova.objects.instance [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lazy-loading 'flavor' on Instance uuid 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:59:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1adfbcc8-aec0-4062-9b28-54edf544b6ca tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.746s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:34 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692043159.470727, c748103b-a37c-47c5-8394-ea54749f27eb => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:59:34 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] VM Stopped (Lifecycle Event)
Aug 14 19:59:34 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4a1b7a0c-1fd0-4590-870e-ce41bf765fa7 None None] [instance: c748103b-a37c-47c5-8394-ea54749f27eb] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:59:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:59:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:59:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:59:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:59:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:47 user nova-compute[72782]: INFO nova.compute.manager [None req-88989a7b-6ace-4497-b064-8d4e7e83d198 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Unrescuing
Aug 14 19:59:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-88989a7b-6ace-4497-b064-8d4e7e83d198 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "refresh_cache-ad4011a9-ab9f-4647-b677-a1c6337d2c2c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:59:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-88989a7b-6ace-4497-b064-8d4e7e83d198 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquired lock "refresh_cache-ad4011a9-ab9f-4647-b677-a1c6337d2c2c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:59:47 user nova-compute[72782]: DEBUG nova.network.neutron [None req-88989a7b-6ace-4497-b064-8d4e7e83d198 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:59:48 user nova-compute[72782]: DEBUG nova.network.neutron [None req-88989a7b-6ace-4497-b064-8d4e7e83d198 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Updating instance_info_cache with network_info: [{"id": "2858462d-1715-4c67-aee3-a0c15eac235b", "address": "fa:16:3e:f1:85:57", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2858462d-17", "ovs_interfaceid": "2858462d-1715-4c67-aee3-a0c15eac235b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:59:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-88989a7b-6ace-4497-b064-8d4e7e83d198 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Releasing lock "refresh_cache-ad4011a9-ab9f-4647-b677-a1c6337d2c2c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:59:48 user nova-compute[72782]: DEBUG nova.objects.instance [None req-88989a7b-6ace-4497-b064-8d4e7e83d198 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'flavor' on Instance uuid ad4011a9-ab9f-4647-b677-a1c6337d2c2c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:59:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-86d47543-e800-4bb8-ad03-6a973f658528 req-c1c0355f-da6b-4873-9b64-b53b5e34de1f service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received event network-vif-unplugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:59:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-86d47543-e800-4bb8-ad03-6a973f658528 req-c1c0355f-da6b-4873-9b64-b53b5e34de1f service nova] Acquiring lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-86d47543-e800-4bb8-ad03-6a973f658528 req-c1c0355f-da6b-4873-9b64-b53b5e34de1f service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-86d47543-e800-4bb8-ad03-6a973f658528 req-c1c0355f-da6b-4873-9b64-b53b5e34de1f service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-86d47543-e800-4bb8-ad03-6a973f658528 req-c1c0355f-da6b-4873-9b64-b53b5e34de1f service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] No waiting events found dispatching network-vif-unplugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:59:49 user nova-compute[72782]: WARNING nova.compute.manager [req-86d47543-e800-4bb8-ad03-6a973f658528 req-c1c0355f-da6b-4873-9b64-b53b5e34de1f service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received unexpected event network-vif-unplugged-2858462d-1715-4c67-aee3-a0c15eac235b for instance with vm_state rescued and task_state unrescuing.
Aug 14 19:59:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:49 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Instance destroyed successfully.
Aug 14 19:59:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:51 user nova-compute[72782]: DEBUG nova.compute.manager [req-465416ec-4416-422b-b919-0bec1a9ed8fe req-38bb1606-2c20-4adf-8813-866d0d4a574a service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received event network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:59:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-465416ec-4416-422b-b919-0bec1a9ed8fe req-38bb1606-2c20-4adf-8813-866d0d4a574a service nova] Acquiring lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-465416ec-4416-422b-b919-0bec1a9ed8fe req-38bb1606-2c20-4adf-8813-866d0d4a574a service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-465416ec-4416-422b-b919-0bec1a9ed8fe req-38bb1606-2c20-4adf-8813-866d0d4a574a service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:51 user nova-compute[72782]: DEBUG nova.compute.manager [req-465416ec-4416-422b-b919-0bec1a9ed8fe req-38bb1606-2c20-4adf-8813-866d0d4a574a service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] No waiting events found dispatching network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:59:51 user nova-compute[72782]: WARNING nova.compute.manager [req-465416ec-4416-422b-b919-0bec1a9ed8fe req-38bb1606-2c20-4adf-8813-866d0d4a574a service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received unexpected event network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b for instance with vm_state rescued and task_state unrescuing.
Aug 14 19:59:51 user nova-compute[72782]: DEBUG nova.compute.manager [req-465416ec-4416-422b-b919-0bec1a9ed8fe req-38bb1606-2c20-4adf-8813-866d0d4a574a service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received event network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:59:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-465416ec-4416-422b-b919-0bec1a9ed8fe req-38bb1606-2c20-4adf-8813-866d0d4a574a service nova] Acquiring lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-465416ec-4416-422b-b919-0bec1a9ed8fe req-38bb1606-2c20-4adf-8813-866d0d4a574a service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-465416ec-4416-422b-b919-0bec1a9ed8fe req-38bb1606-2c20-4adf-8813-866d0d4a574a service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:51 user nova-compute[72782]: DEBUG nova.compute.manager [req-465416ec-4416-422b-b919-0bec1a9ed8fe req-38bb1606-2c20-4adf-8813-866d0d4a574a service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] No waiting events found dispatching network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:59:51 user nova-compute[72782]: WARNING nova.compute.manager [req-465416ec-4416-422b-b919-0bec1a9ed8fe req-38bb1606-2c20-4adf-8813-866d0d4a574a service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received unexpected event network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b for instance with vm_state rescued and task_state unrescuing.
Aug 14 19:59:51 user nova-compute[72782]: DEBUG nova.compute.manager [req-465416ec-4416-422b-b919-0bec1a9ed8fe req-38bb1606-2c20-4adf-8813-866d0d4a574a service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received event network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:59:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-465416ec-4416-422b-b919-0bec1a9ed8fe req-38bb1606-2c20-4adf-8813-866d0d4a574a service nova] Acquiring lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:59:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-465416ec-4416-422b-b919-0bec1a9ed8fe req-38bb1606-2c20-4adf-8813-866d0d4a574a service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:59:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-465416ec-4416-422b-b919-0bec1a9ed8fe req-38bb1606-2c20-4adf-8813-866d0d4a574a service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:59:51 user nova-compute[72782]: DEBUG nova.compute.manager [req-465416ec-4416-422b-b919-0bec1a9ed8fe req-38bb1606-2c20-4adf-8813-866d0d4a574a service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] No waiting events found dispatching network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:59:51 user nova-compute[72782]: WARNING nova.compute.manager [req-465416ec-4416-422b-b919-0bec1a9ed8fe req-38bb1606-2c20-4adf-8813-866d0d4a574a service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received unexpected event network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b for instance with vm_state rescued and task_state unrescuing.
Aug 14 19:59:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Removed pending event for ad4011a9-ab9f-4647-b677-a1c6337d2c2c due to event {{(pid=72782) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 19:59:52 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043192.742093, ad4011a9-ab9f-4647-b677-a1c6337d2c2c => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:59:52 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] VM Resumed (Lifecycle Event)
Aug 14 19:59:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-88989a7b-6ace-4497-b064-8d4e7e83d198 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:59:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:59:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:59:52 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 19:59:52 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043192.746471, ad4011a9-ab9f-4647-b677-a1c6337d2c2c => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:59:52 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] VM Started (Lifecycle Event)
Aug 14 19:59:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:59:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:59:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:54 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:59:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:59:55 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:59:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:00:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:00:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:00:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-3c2df162-332c-4391-95b8-223e07546d74" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:00:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-3c2df162-332c-4391-95b8-223e07546d74" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:00:00 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:00:00 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Updating instance_info_cache with network_info: [{"id": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "address": "fa:16:3e:fe:b9:74", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb361406-de", "ovs_interfaceid": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:00:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-3c2df162-332c-4391-95b8-223e07546d74" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:00:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:00:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:00:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:00:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:00:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:00:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:00:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:00:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:00:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:00:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:00:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:00:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:00:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:00:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:00:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:00:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:00:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:00:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:00:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:00:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:00:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:00:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:00:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:00:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:00:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:00:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:00:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:00:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:00:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:00:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:00:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:00:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:00:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:00:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:00:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:00:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:00:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:00:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:00:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:00:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:00:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:00:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:00:06 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:00:06 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:00:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7362MB free_disk=25.2861328125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:00:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:00:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance d0ffe207-a89e-41ef-85af-7927ce06627e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:00:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:00:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance a4ae2e60-c4d4-4a7e-826e-fb315fa98138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:00:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ad4011a9-ab9f-4647-b677-a1c6337d2c2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:00:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:00:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ebed33f0-94c7-4094-a181-335784ab8819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:00:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:00:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2c924d52-aa8a-47ed-857c-b863efe95258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:00:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ca7d1bf8-168b-4484-a965-72ff0aea93ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:00:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:00:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:00:06 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:00:06 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:00:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:00:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquiring lock "d0ffe207-a89e-41ef-85af-7927ce06627e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "d0ffe207-a89e-41ef-85af-7927ce06627e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquiring lock "d0ffe207-a89e-41ef-85af-7927ce06627e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "d0ffe207-a89e-41ef-85af-7927ce06627e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "d0ffe207-a89e-41ef-85af-7927ce06627e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:09 user nova-compute[72782]: INFO nova.compute.manager [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Terminating instance
Aug 14 20:00:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:00:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:09 user nova-compute[72782]: DEBUG nova.compute.manager [req-0b305c9f-8492-4a55-90ab-a9dafc50b88b req-551add76-897f-41ff-a171-3b034596af73 service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Received event network-vif-unplugged-bf5a9b82-2e2d-4417-8650-bbc67e82d953 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:00:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0b305c9f-8492-4a55-90ab-a9dafc50b88b req-551add76-897f-41ff-a171-3b034596af73 service nova] Acquiring lock "d0ffe207-a89e-41ef-85af-7927ce06627e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0b305c9f-8492-4a55-90ab-a9dafc50b88b req-551add76-897f-41ff-a171-3b034596af73 service nova] Lock "d0ffe207-a89e-41ef-85af-7927ce06627e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0b305c9f-8492-4a55-90ab-a9dafc50b88b req-551add76-897f-41ff-a171-3b034596af73 service nova] Lock "d0ffe207-a89e-41ef-85af-7927ce06627e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:09 user nova-compute[72782]: DEBUG nova.compute.manager [req-0b305c9f-8492-4a55-90ab-a9dafc50b88b req-551add76-897f-41ff-a171-3b034596af73 service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] No waiting events found dispatching network-vif-unplugged-bf5a9b82-2e2d-4417-8650-bbc67e82d953 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:00:09 user nova-compute[72782]: DEBUG nova.compute.manager [req-0b305c9f-8492-4a55-90ab-a9dafc50b88b req-551add76-897f-41ff-a171-3b034596af73 service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Received event network-vif-unplugged-bf5a9b82-2e2d-4417-8650-bbc67e82d953 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:00:09 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:00:09 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:00:10 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Instance destroyed successfully.
Aug 14 20:00:10 user nova-compute[72782]: DEBUG nova.objects.instance [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lazy-loading 'resources' on Instance uuid d0ffe207-a89e-41ef-85af-7927ce06627e {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:00:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:51:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1274803257',display_name='tempest-ServersNegativeTestJSON-server-1274803257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1274803257',id=18,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:51:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fcc7dac78fa47eab14a10d2fe59d320',ramdisk_id='',reservation_id='r-xxvxdr9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1211486287',owner_user_name='tempest-ServersNegativeTestJSON-1211486287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:51:16Z,user_data=None,user_id='1f6db9beff934039b38439a362287274',uuid=d0ffe207-a89e-41ef-85af-7927ce06627e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "address": "fa:16:3e:fa:0f:ec", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5a9b82-2e", "ovs_interfaceid": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:00:10 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Converting VIF {"id": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "address": "fa:16:3e:fa:0f:ec", "network": {"id": "8e9d9f90-4c74-4a14-9f51-0dc87928a619", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2132555026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fcc7dac78fa47eab14a10d2fe59d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5a9b82-2e", "ovs_interfaceid": "bf5a9b82-2e2d-4417-8650-bbc67e82d953", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:00:10 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=bf5a9b82-2e2d-4417-8650-bbc67e82d953,network=Network(8e9d9f90-4c74-4a14-9f51-0dc87928a619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5a9b82-2e') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:00:10 user nova-compute[72782]: DEBUG os_vif [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=bf5a9b82-2e2d-4417-8650-bbc67e82d953,network=Network(8e9d9f90-4c74-4a14-9f51-0dc87928a619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5a9b82-2e') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:00:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf5a9b82-2e, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:00:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:10 user nova-compute[72782]: INFO os_vif [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=bf5a9b82-2e2d-4417-8650-bbc67e82d953,network=Network(8e9d9f90-4c74-4a14-9f51-0dc87928a619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5a9b82-2e')
Aug 14 20:00:10 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Deleting instance files /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e_del
Aug 14 20:00:10 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Deletion of /opt/stack/data/nova/instances/d0ffe207-a89e-41ef-85af-7927ce06627e_del complete
Aug 14 20:00:10 user nova-compute[72782]: INFO nova.compute.manager [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 14 20:00:10 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:00:10 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:00:10 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:00:10 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:00:10 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Took 0.48 seconds to deallocate network for instance.
Aug 14 20:00:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-6fbc0f7f-37fa-4baf-b13d-1ba81855d6f6 req-3a26076e-9d2c-4355-a810-6ed8ebcbd3df service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Received event network-vif-deleted-bf5a9b82-2e2d-4417-8650-bbc67e82d953 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:00:10 user nova-compute[72782]: INFO nova.compute.manager [req-6fbc0f7f-37fa-4baf-b13d-1ba81855d6f6 req-3a26076e-9d2c-4355-a810-6ed8ebcbd3df service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Neutron deleted interface bf5a9b82-2e2d-4417-8650-bbc67e82d953; detaching it from the instance and deleting it from the info cache
Aug 14 20:00:10 user nova-compute[72782]: DEBUG nova.network.neutron [req-6fbc0f7f-37fa-4baf-b13d-1ba81855d6f6 req-3a26076e-9d2c-4355-a810-6ed8ebcbd3df service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:00:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-6fbc0f7f-37fa-4baf-b13d-1ba81855d6f6 req-3a26076e-9d2c-4355-a810-6ed8ebcbd3df service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Detach interface failed, port_id=bf5a9b82-2e2d-4417-8650-bbc67e82d953, reason: Instance d0ffe207-a89e-41ef-85af-7927ce06627e could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 20:00:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:11 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:00:11 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:00:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:11 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Deleted allocations for instance d0ffe207-a89e-41ef-85af-7927ce06627e
Aug 14 20:00:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-83b5c217-be7d-4c16-b0ab-15932e212f0b tempest-ServersNegativeTestJSON-1211486287 tempest-ServersNegativeTestJSON-1211486287-project-member] Lock "d0ffe207-a89e-41ef-85af-7927ce06627e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.895s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-c6d530bd-9eeb-4055-b3dc-24980fdf6906 req-438dc35d-82a5-4109-aa05-b9542a1ca755 service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Received event network-vif-plugged-bf5a9b82-2e2d-4417-8650-bbc67e82d953 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:00:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c6d530bd-9eeb-4055-b3dc-24980fdf6906 req-438dc35d-82a5-4109-aa05-b9542a1ca755 service nova] Acquiring lock "d0ffe207-a89e-41ef-85af-7927ce06627e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c6d530bd-9eeb-4055-b3dc-24980fdf6906 req-438dc35d-82a5-4109-aa05-b9542a1ca755 service nova] Lock "d0ffe207-a89e-41ef-85af-7927ce06627e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c6d530bd-9eeb-4055-b3dc-24980fdf6906 req-438dc35d-82a5-4109-aa05-b9542a1ca755 service nova] Lock "d0ffe207-a89e-41ef-85af-7927ce06627e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-c6d530bd-9eeb-4055-b3dc-24980fdf6906 req-438dc35d-82a5-4109-aa05-b9542a1ca755 service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] No waiting events found dispatching network-vif-plugged-bf5a9b82-2e2d-4417-8650-bbc67e82d953 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:00:11 user nova-compute[72782]: WARNING nova.compute.manager [req-c6d530bd-9eeb-4055-b3dc-24980fdf6906 req-438dc35d-82a5-4109-aa05-b9542a1ca755 service nova] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Received unexpected event network-vif-plugged-bf5a9b82-2e2d-4417-8650-bbc67e82d953 for instance with vm_state deleted and task_state None.
Aug 14 20:00:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:12 user nova-compute[72782]: INFO nova.compute.manager [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Terminating instance
Aug 14 20:00:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:00:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:12 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Instance destroyed successfully.
Aug 14 20:00:12 user nova-compute[72782]: DEBUG nova.objects.instance [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lazy-loading 'resources' on Instance uuid 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:00:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1908923615',display_name='tempest-TestStampPattern-server-1908923615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1908923615',id=27,image_ref='9ba367a2-e9e3-4055-85bc-587369c3d583',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM83rJpi+PWJVg1bcMN9+UzFWK7I+4X1gYs6cuilTIZnJOuWki/JRMmqnsb5/j9U7gZMW4Fb1jbj8E3oTngmEYniu5bxs0zhFngi/h3GEmcDqt3L25ZYVeHugUHVbYP8eA==',key_name='tempest-TestStampPattern-666114121',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:57:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b23edaa22c50450b9b35fc42fcd4f59f',ramdisk_id='',reservation_id='r-qabfshzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a4ae2e60-c4d4-4a7e-826e-fb315fa98138',image_min_disk='1',image_min_ram='0',image_owner_id='b23edaa22c50450b9b35fc42fcd4f59f',image_owner_project_name='tempest-TestStampPattern-890299113',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-890299113-project-member',image_user_id='9d0b98a72a4843beafc4bda85ae07f61',owner_project_name='tempest-TestStampPattern-890299113',owner_user_name='tempest-TestStampPattern-890299113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:57:21Z,user_data=None,user_id='9d0b98a72a4843beafc4bda85ae07f61',uuid=64face75-3aba-4cb8-8ff2-a1bbdf9835e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "address": "fa:16:3e:6f:8e:bd", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e700e02-4a", "ovs_interfaceid": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:00:12 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Converting VIF {"id": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "address": "fa:16:3e:6f:8e:bd", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e700e02-4a", "ovs_interfaceid": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:00:12 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:8e:bd,bridge_name='br-int',has_traffic_filtering=True,id=4e700e02-4ab0-47e7-98c5-fab5d76d37a6,network=Network(6cd1aff4-7785-41f1-8881-49783a46d7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e700e02-4a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:00:12 user nova-compute[72782]: DEBUG os_vif [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:8e:bd,bridge_name='br-int',has_traffic_filtering=True,id=4e700e02-4ab0-47e7-98c5-fab5d76d37a6,network=Network(6cd1aff4-7785-41f1-8881-49783a46d7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e700e02-4a') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:00:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e700e02-4a, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:00:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:00:13 user nova-compute[72782]: INFO os_vif [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:8e:bd,bridge_name='br-int',has_traffic_filtering=True,id=4e700e02-4ab0-47e7-98c5-fab5d76d37a6,network=Network(6cd1aff4-7785-41f1-8881-49783a46d7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e700e02-4a')
Aug 14 20:00:13 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Deleting instance files /opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1_del
Aug 14 20:00:13 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Deletion of /opt/stack/data/nova/instances/64face75-3aba-4cb8-8ff2-a1bbdf9835e1_del complete
Aug 14 20:00:13 user nova-compute[72782]: INFO nova.compute.manager [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 20:00:13 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:00:13 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:00:13 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:00:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Received event network-changed-4e700e02-4ab0-47e7-98c5-fab5d76d37a6 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:00:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Refreshing instance network info cache due to event network-changed-4e700e02-4ab0-47e7-98c5-fab5d76d37a6. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:00:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] Acquiring lock "refresh_cache-64face75-3aba-4cb8-8ff2-a1bbdf9835e1" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:00:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] Acquired lock "refresh_cache-64face75-3aba-4cb8-8ff2-a1bbdf9835e1" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:00:13 user nova-compute[72782]: DEBUG nova.network.neutron [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Refreshing network info cache for port 4e700e02-4ab0-47e7-98c5-fab5d76d37a6 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:00:14 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Took 1.16 seconds to deallocate network for instance.
Aug 14 20:00:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-8a99dc07-d224-477c-b6ee-36b6856b03d1 req-d686cdd2-3b81-4c9c-80c7-47b53e140624 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Received event network-vif-deleted-4e700e02-4ab0-47e7-98c5-fab5d76d37a6 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:00:14 user nova-compute[72782]: INFO nova.compute.manager [req-8a99dc07-d224-477c-b6ee-36b6856b03d1 req-d686cdd2-3b81-4c9c-80c7-47b53e140624 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Neutron deleted interface 4e700e02-4ab0-47e7-98c5-fab5d76d37a6; detaching it from the instance and deleting it from the info cache
Aug 14 20:00:14 user nova-compute[72782]: DEBUG nova.network.neutron [req-8a99dc07-d224-477c-b6ee-36b6856b03d1 req-d686cdd2-3b81-4c9c-80c7-47b53e140624 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-8a99dc07-d224-477c-b6ee-36b6856b03d1 req-d686cdd2-3b81-4c9c-80c7-47b53e140624 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Detach interface failed, port_id=4e700e02-4ab0-47e7-98c5-fab5d76d37a6, reason: Instance 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG nova.network.neutron [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Updated VIF entry in instance network info cache for port 4e700e02-4ab0-47e7-98c5-fab5d76d37a6. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG nova.network.neutron [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Updating instance_info_cache with network_info: [{"id": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "address": "fa:16:3e:6f:8e:bd", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e700e02-4a", "ovs_interfaceid": "4e700e02-4ab0-47e7-98c5-fab5d76d37a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] Releasing lock "refresh_cache-64face75-3aba-4cb8-8ff2-a1bbdf9835e1" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Received event network-vif-unplugged-4e700e02-4ab0-47e7-98c5-fab5d76d37a6 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] Acquiring lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] No waiting events found dispatching network-vif-unplugged-4e700e02-4ab0-47e7-98c5-fab5d76d37a6 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Received event network-vif-unplugged-4e700e02-4ab0-47e7-98c5-fab5d76d37a6 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Received event network-vif-plugged-4e700e02-4ab0-47e7-98c5-fab5d76d37a6 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] Acquiring lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] No waiting events found dispatching network-vif-plugged-4e700e02-4ab0-47e7-98c5-fab5d76d37a6 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:00:14 user nova-compute[72782]: WARNING nova.compute.manager [req-2c3f2d28-7b2e-4a2b-9ab5-f8680a5ed6a1 req-b9bec9d8-ee6f-48ee-8974-6bfae9123a57 service nova] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Received unexpected event network-vif-plugged-4e700e02-4ab0-47e7-98c5-fab5d76d37a6 for instance with vm_state active and task_state deleting.
Aug 14 20:00:14 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:00:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:14 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Deleted allocations for instance 64face75-3aba-4cb8-8ff2-a1bbdf9835e1
Aug 14 20:00:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c2eee5b4-7569-4285-8aef-b9f902c2f7ce tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "64face75-3aba-4cb8-8ff2-a1bbdf9835e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.599s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Acquiring lock "ebed33f0-94c7-4094-a181-335784ab8819" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lock "ebed33f0-94c7-4094-a181-335784ab8819" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Acquiring lock "ebed33f0-94c7-4094-a181-335784ab8819-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lock "ebed33f0-94c7-4094-a181-335784ab8819-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lock "ebed33f0-94c7-4094-a181-335784ab8819-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:19 user nova-compute[72782]: INFO nova.compute.manager [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Terminating instance
Aug 14 20:00:19 user nova-compute[72782]: DEBUG nova.compute.manager [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:00:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-68ac6460-c879-472e-b506-76cb072a8000 req-4e1e92c4-a735-40ca-91a9-b6d66aff6e00 service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Received event network-vif-unplugged-f161b84e-9df3-4c23-9202-a814824405f7 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-68ac6460-c879-472e-b506-76cb072a8000 req-4e1e92c4-a735-40ca-91a9-b6d66aff6e00 service nova] Acquiring lock "ebed33f0-94c7-4094-a181-335784ab8819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-68ac6460-c879-472e-b506-76cb072a8000 req-4e1e92c4-a735-40ca-91a9-b6d66aff6e00 service nova] Lock "ebed33f0-94c7-4094-a181-335784ab8819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-68ac6460-c879-472e-b506-76cb072a8000 req-4e1e92c4-a735-40ca-91a9-b6d66aff6e00 service nova] Lock "ebed33f0-94c7-4094-a181-335784ab8819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-68ac6460-c879-472e-b506-76cb072a8000 req-4e1e92c4-a735-40ca-91a9-b6d66aff6e00 service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] No waiting events found dispatching network-vif-unplugged-f161b84e-9df3-4c23-9202-a814824405f7 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-68ac6460-c879-472e-b506-76cb072a8000 req-4e1e92c4-a735-40ca-91a9-b6d66aff6e00 service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Received event network-vif-unplugged-f161b84e-9df3-4c23-9202-a814824405f7 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:20 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Instance destroyed successfully.
Aug 14 20:00:20 user nova-compute[72782]: DEBUG nova.objects.instance [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lazy-loading 'resources' on Instance uuid ebed33f0-94c7-4094-a181-335784ab8819 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-323991577',display_name='tempest-VolumesNegativeTest-instance-323991577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-323991577',id=28,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:58:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27657b177ec241148d5a41316528a4cb',ramdisk_id='',reservation_id='r-c1yry7c1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1700451336',owner_user_name='tempest-VolumesNegativeTest-1700451336-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:58:36Z,user_data=None,user_id='93e0589a04ee4b1ca72c7c3d7555c1f0',uuid=ebed33f0-94c7-4094-a181-335784ab8819,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f161b84e-9df3-4c23-9202-a814824405f7", "address": "fa:16:3e:7e:e2:ef", "network": {"id": "f092445f-c653-4c63-b2f8-6f5868c04fa6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3d33562bad004467893841e90a8b6160", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf161b84e-9d", "ovs_interfaceid": "f161b84e-9df3-4c23-9202-a814824405f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Converting VIF {"id": "f161b84e-9df3-4c23-9202-a814824405f7", "address": "fa:16:3e:7e:e2:ef", "network": {"id": "f092445f-c653-4c63-b2f8-6f5868c04fa6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3d33562bad004467893841e90a8b6160", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf161b84e-9d", "ovs_interfaceid": "f161b84e-9df3-4c23-9202-a814824405f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e2:ef,bridge_name='br-int',has_traffic_filtering=True,id=f161b84e-9df3-4c23-9202-a814824405f7,network=Network(f092445f-c653-4c63-b2f8-6f5868c04fa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf161b84e-9d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG os_vif [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e2:ef,bridge_name='br-int',has_traffic_filtering=True,id=f161b84e-9df3-4c23-9202-a814824405f7,network=Network(f092445f-c653-4c63-b2f8-6f5868c04fa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf161b84e-9d') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf161b84e-9d, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:00:20 user nova-compute[72782]: INFO os_vif [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e2:ef,bridge_name='br-int',has_traffic_filtering=True,id=f161b84e-9df3-4c23-9202-a814824405f7,network=Network(f092445f-c653-4c63-b2f8-6f5868c04fa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf161b84e-9d')
Aug 14 20:00:20 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Deleting instance files /opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819_del
Aug 14 20:00:20 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Deletion of /opt/stack/data/nova/instances/ebed33f0-94c7-4094-a181-335784ab8819_del complete
Aug 14 20:00:20 user nova-compute[72782]: INFO nova.compute.manager [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 20:00:20 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:00:20 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: ebed33f0-94c7-4094-a181-335784ab8819] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:00:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:21 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:00:21 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Took 0.88 seconds to deallocate network for instance.
Aug 14 20:00:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-1a8bae1c-52ce-4937-a68b-e57075218da6 req-5534d6df-9c4b-483a-ae13-761214e16171 service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Received event network-vif-deleted-f161b84e-9df3-4c23-9202-a814824405f7 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:00:21 user nova-compute[72782]: INFO nova.compute.manager [req-1a8bae1c-52ce-4937-a68b-e57075218da6 req-5534d6df-9c4b-483a-ae13-761214e16171 service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Neutron deleted interface f161b84e-9df3-4c23-9202-a814824405f7; detaching it from the instance and deleting it from the info cache
Aug 14 20:00:21 user nova-compute[72782]: DEBUG nova.network.neutron [req-1a8bae1c-52ce-4937-a68b-e57075218da6 req-5534d6df-9c4b-483a-ae13-761214e16171 service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:00:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-1a8bae1c-52ce-4937-a68b-e57075218da6 req-5534d6df-9c4b-483a-ae13-761214e16171 service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Detach interface failed, port_id=f161b84e-9df3-4c23-9202-a814824405f7, reason: Instance ebed33f0-94c7-4094-a181-335784ab8819 could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 20:00:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:21 user nova-compute[72782]: INFO nova.compute.manager [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Rescuing
Aug 14 20:00:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "refresh_cache-2c924d52-aa8a-47ed-857c-b863efe95258" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:00:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquired lock "refresh_cache-2c924d52-aa8a-47ed-857c-b863efe95258" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:00:21 user nova-compute[72782]: DEBUG nova.network.neutron [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:00:22 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:00:22 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:00:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:22 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Deleted allocations for instance ebed33f0-94c7-4094-a181-335784ab8819
Aug 14 20:00:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-822003ba-f63e-4f21-912a-14d244c7407f tempest-VolumesNegativeTest-1700451336 tempest-VolumesNegativeTest-1700451336-project-member] Lock "ebed33f0-94c7-4094-a181-335784ab8819" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.369s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:22 user nova-compute[72782]: DEBUG nova.compute.manager [req-0ff604bf-f5da-4072-a16d-a98aa5c24a24 req-14f3a7bb-2bd5-45b3-896c-17942fe73b19 service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Received event network-vif-plugged-f161b84e-9df3-4c23-9202-a814824405f7 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:00:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0ff604bf-f5da-4072-a16d-a98aa5c24a24 req-14f3a7bb-2bd5-45b3-896c-17942fe73b19 service nova] Acquiring lock "ebed33f0-94c7-4094-a181-335784ab8819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0ff604bf-f5da-4072-a16d-a98aa5c24a24 req-14f3a7bb-2bd5-45b3-896c-17942fe73b19 service nova] Lock "ebed33f0-94c7-4094-a181-335784ab8819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0ff604bf-f5da-4072-a16d-a98aa5c24a24 req-14f3a7bb-2bd5-45b3-896c-17942fe73b19 service nova] Lock "ebed33f0-94c7-4094-a181-335784ab8819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:22 user nova-compute[72782]: DEBUG nova.compute.manager [req-0ff604bf-f5da-4072-a16d-a98aa5c24a24 req-14f3a7bb-2bd5-45b3-896c-17942fe73b19 service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] No waiting events found dispatching network-vif-plugged-f161b84e-9df3-4c23-9202-a814824405f7 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:00:22 user nova-compute[72782]: WARNING nova.compute.manager [req-0ff604bf-f5da-4072-a16d-a98aa5c24a24 req-14f3a7bb-2bd5-45b3-896c-17942fe73b19 service nova] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Received unexpected event network-vif-plugged-f161b84e-9df3-4c23-9202-a814824405f7 for instance with vm_state deleted and task_state None.
Aug 14 20:00:22 user nova-compute[72782]: DEBUG nova.network.neutron [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Updating instance_info_cache with network_info: [{"id": "8b971464-be37-4d45-a3c6-05d413e65cb2", "address": "fa:16:3e:a0:14:ff", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b971464-be", "ovs_interfaceid": "8b971464-be37-4d45-a3c6-05d413e65cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:00:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Releasing lock "refresh_cache-2c924d52-aa8a-47ed-857c-b863efe95258" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:00:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:23 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Instance destroyed successfully.
Aug 14 20:00:23 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Attempting rescue
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72782) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Instance directory exists: not creating {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 20:00:23 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Creating image(s)
Aug 14 20:00:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "/opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "/opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.objects.instance [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2c924d52-aa8a-47ed-857c-b863efe95258 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.185s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue" returned: 0 in 0.050s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.objects.instance [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'migration_context' on Instance uuid 2c924d52-aa8a-47ed-857c-b863efe95258 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Start _get_guest_xml network_info=[{"id": "8b971464-be37-4d45-a3c6-05d413e65cb2", "address": "fa:16:3e:a0:14:ff", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "vif_mac": "fa:16:3e:a0:14:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b971464-be", "ovs_interfaceid": "8b971464-be37-4d45-a3c6-05d413e65cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.objects.instance [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'resources' on Instance uuid 2c924d52-aa8a-47ed-857c-b863efe95258 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.objects.instance [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'numa_topology' on Instance uuid 2c924d52-aa8a-47ed-857c-b863efe95258 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:00:23 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:00:23 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.objects.instance [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2c924d52-aa8a-47ed-857c-b863efe95258 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-351871757',display_name='tempest-ServerRescueNegativeTestJSON-server-351871757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-351871757',id=30,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:58:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14952037d1dc44e7b64d0663c7a033c8',ramdisk_id='',reservation_id='r-og2q6lkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1321611883',owner_user_name='tempest-ServerRescueNegativeTestJSON-1321611883-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:58:40Z,user_data=None,user_id='d2d39528bc994a25b9e6fea9f6b8b34c',uuid=2c924d52-aa8a-47ed-857c-b863efe95258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b971464-be37-4d45-a3c6-05d413e65cb2", "address": "fa:16:3e:a0:14:ff", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "vif_mac": "fa:16:3e:a0:14:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b971464-be", "ovs_interfaceid": "8b971464-be37-4d45-a3c6-05d413e65cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converting VIF {"id": "8b971464-be37-4d45-a3c6-05d413e65cb2", "address": "fa:16:3e:a0:14:ff", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "vif_mac": "fa:16:3e:a0:14:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b971464-be", "ovs_interfaceid": "8b971464-be37-4d45-a3c6-05d413e65cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:14:ff,bridge_name='br-int',has_traffic_filtering=True,id=8b971464-be37-4d45-a3c6-05d413e65cb2,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b971464-be') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.objects.instance [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c924d52-aa8a-47ed-857c-b863efe95258 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:00:23 user nova-compute[72782]:   <uuid>2c924d52-aa8a-47ed-857c-b863efe95258</uuid>
Aug 14 20:00:23 user nova-compute[72782]:   <name>instance-0000001e</name>
Aug 14 20:00:23 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:00:23 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:00:23 user nova-compute[72782]:   <metadata>
Aug 14 20:00:23 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:00:23 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:00:23 user nova-compute[72782]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-351871757</nova:name>
Aug 14 20:00:23 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:00:23</nova:creationTime>
Aug 14 20:00:23 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:00:23 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:00:23 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:00:23 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:00:23 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:00:23 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:00:23 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:00:23 user nova-compute[72782]:       <nova:owner>
Aug 14 20:00:23 user nova-compute[72782]:         <nova:user uuid="d2d39528bc994a25b9e6fea9f6b8b34c">tempest-ServerRescueNegativeTestJSON-1321611883-project-member</nova:user>
Aug 14 20:00:23 user nova-compute[72782]:         <nova:project uuid="14952037d1dc44e7b64d0663c7a033c8">tempest-ServerRescueNegativeTestJSON-1321611883</nova:project>
Aug 14 20:00:23 user nova-compute[72782]:       </nova:owner>
Aug 14 20:00:23 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 20:00:23 user nova-compute[72782]:       <nova:ports>
Aug 14 20:00:23 user nova-compute[72782]:         <nova:port uuid="8b971464-be37-4d45-a3c6-05d413e65cb2">
Aug 14 20:00:23 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 20:00:23 user nova-compute[72782]:         </nova:port>
Aug 14 20:00:23 user nova-compute[72782]:       </nova:ports>
Aug 14 20:00:23 user nova-compute[72782]:     </nova:instance>
Aug 14 20:00:23 user nova-compute[72782]:   </metadata>
Aug 14 20:00:23 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:00:23 user nova-compute[72782]:     <system>
Aug 14 20:00:23 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:00:23 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:00:23 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:00:23 user nova-compute[72782]:       <entry name="serial">2c924d52-aa8a-47ed-857c-b863efe95258</entry>
Aug 14 20:00:23 user nova-compute[72782]:       <entry name="uuid">2c924d52-aa8a-47ed-857c-b863efe95258</entry>
Aug 14 20:00:23 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:00:23 user nova-compute[72782]:     </system>
Aug 14 20:00:23 user nova-compute[72782]:   </sysinfo>
Aug 14 20:00:23 user nova-compute[72782]:   <os>
Aug 14 20:00:23 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:00:23 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:00:23 user nova-compute[72782]:   </os>
Aug 14 20:00:23 user nova-compute[72782]:   <features>
Aug 14 20:00:23 user nova-compute[72782]:     <acpi/>
Aug 14 20:00:23 user nova-compute[72782]:     <apic/>
Aug 14 20:00:23 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:00:23 user nova-compute[72782]:   </features>
Aug 14 20:00:23 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:00:23 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:00:23 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:00:23 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:00:23 user nova-compute[72782]:   </clock>
Aug 14 20:00:23 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:00:23 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:00:23 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:00:23 user nova-compute[72782]:   </cpu>
Aug 14 20:00:23 user nova-compute[72782]:   <devices>
Aug 14 20:00:23 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:00:23 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:00:23 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue"/>
Aug 14 20:00:23 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:00:23 user nova-compute[72782]:     </disk>
Aug 14 20:00:23 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:00:23 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:00:23 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk"/>
Aug 14 20:00:23 user nova-compute[72782]:       <target dev="vdb" bus="virtio"/>
Aug 14 20:00:23 user nova-compute[72782]:     </disk>
Aug 14 20:00:23 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:00:23 user nova-compute[72782]:       <mac address="fa:16:3e:a0:14:ff"/>
Aug 14 20:00:23 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:00:23 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:00:23 user nova-compute[72782]:       <target dev="tap8b971464-be"/>
Aug 14 20:00:23 user nova-compute[72782]:     </interface>
Aug 14 20:00:23 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:00:23 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/console.log" append="off"/>
Aug 14 20:00:23 user nova-compute[72782]:     </serial>
Aug 14 20:00:23 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:00:23 user nova-compute[72782]:     <video>
Aug 14 20:00:23 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:00:23 user nova-compute[72782]:     </video>
Aug 14 20:00:23 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:00:23 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:00:23 user nova-compute[72782]:     </rng>
Aug 14 20:00:23 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:00:23 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:00:23 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:00:23 user nova-compute[72782]:     </memballoon>
Aug 14 20:00:23 user nova-compute[72782]:   </devices>
Aug 14 20:00:23 user nova-compute[72782]: </domain>
Aug 14 20:00:23 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:00:23 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Instance destroyed successfully.
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:00:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] No VIF found with MAC fa:16:3e:a0:14:ff, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:00:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-1dbcf080-17f2-423b-9463-fceb439f41e3 req-9b930c6e-1eb1-40f2-93d3-7f7ad32b29f9 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received event network-vif-unplugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:00:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1dbcf080-17f2-423b-9463-fceb439f41e3 req-9b930c6e-1eb1-40f2-93d3-7f7ad32b29f9 service nova] Acquiring lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1dbcf080-17f2-423b-9463-fceb439f41e3 req-9b930c6e-1eb1-40f2-93d3-7f7ad32b29f9 service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1dbcf080-17f2-423b-9463-fceb439f41e3 req-9b930c6e-1eb1-40f2-93d3-7f7ad32b29f9 service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-1dbcf080-17f2-423b-9463-fceb439f41e3 req-9b930c6e-1eb1-40f2-93d3-7f7ad32b29f9 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] No waiting events found dispatching network-vif-unplugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:00:24 user nova-compute[72782]: WARNING nova.compute.manager [req-1dbcf080-17f2-423b-9463-fceb439f41e3 req-9b930c6e-1eb1-40f2-93d3-7f7ad32b29f9 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received unexpected event network-vif-unplugged-8b971464-be37-4d45-a3c6-05d413e65cb2 for instance with vm_state active and task_state rescuing.
Aug 14 20:00:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-1dbcf080-17f2-423b-9463-fceb439f41e3 req-9b930c6e-1eb1-40f2-93d3-7f7ad32b29f9 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received event network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:00:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1dbcf080-17f2-423b-9463-fceb439f41e3 req-9b930c6e-1eb1-40f2-93d3-7f7ad32b29f9 service nova] Acquiring lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1dbcf080-17f2-423b-9463-fceb439f41e3 req-9b930c6e-1eb1-40f2-93d3-7f7ad32b29f9 service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1dbcf080-17f2-423b-9463-fceb439f41e3 req-9b930c6e-1eb1-40f2-93d3-7f7ad32b29f9 service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-1dbcf080-17f2-423b-9463-fceb439f41e3 req-9b930c6e-1eb1-40f2-93d3-7f7ad32b29f9 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] No waiting events found dispatching network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:00:24 user nova-compute[72782]: WARNING nova.compute.manager [req-1dbcf080-17f2-423b-9463-fceb439f41e3 req-9b930c6e-1eb1-40f2-93d3-7f7ad32b29f9 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received unexpected event network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 for instance with vm_state active and task_state rescuing.
Aug 14 20:00:25 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692043210.0569224, d0ffe207-a89e-41ef-85af-7927ce06627e => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:00:25 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] VM Stopped (Lifecycle Event)
Aug 14 20:00:25 user nova-compute[72782]: DEBUG nova.compute.manager [None req-ba334d6b-0abf-4947-8364-6d942382d11c None None] [instance: d0ffe207-a89e-41ef-85af-7927ce06627e] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:00:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-a8bfb1e7-9f5f-409c-99dc-3f29e87255d9 req-2455fc13-d491-4606-8505-4f1e09f6aa64 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received event network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:00:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a8bfb1e7-9f5f-409c-99dc-3f29e87255d9 req-2455fc13-d491-4606-8505-4f1e09f6aa64 service nova] Acquiring lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a8bfb1e7-9f5f-409c-99dc-3f29e87255d9 req-2455fc13-d491-4606-8505-4f1e09f6aa64 service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a8bfb1e7-9f5f-409c-99dc-3f29e87255d9 req-2455fc13-d491-4606-8505-4f1e09f6aa64 service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-a8bfb1e7-9f5f-409c-99dc-3f29e87255d9 req-2455fc13-d491-4606-8505-4f1e09f6aa64 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] No waiting events found dispatching network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:00:26 user nova-compute[72782]: WARNING nova.compute.manager [req-a8bfb1e7-9f5f-409c-99dc-3f29e87255d9 req-2455fc13-d491-4606-8505-4f1e09f6aa64 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received unexpected event network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 for instance with vm_state active and task_state rescuing.
Aug 14 20:00:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-a8bfb1e7-9f5f-409c-99dc-3f29e87255d9 req-2455fc13-d491-4606-8505-4f1e09f6aa64 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received event network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:00:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a8bfb1e7-9f5f-409c-99dc-3f29e87255d9 req-2455fc13-d491-4606-8505-4f1e09f6aa64 service nova] Acquiring lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a8bfb1e7-9f5f-409c-99dc-3f29e87255d9 req-2455fc13-d491-4606-8505-4f1e09f6aa64 service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a8bfb1e7-9f5f-409c-99dc-3f29e87255d9 req-2455fc13-d491-4606-8505-4f1e09f6aa64 service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-a8bfb1e7-9f5f-409c-99dc-3f29e87255d9 req-2455fc13-d491-4606-8505-4f1e09f6aa64 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] No waiting events found dispatching network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:00:26 user nova-compute[72782]: WARNING nova.compute.manager [req-a8bfb1e7-9f5f-409c-99dc-3f29e87255d9 req-2455fc13-d491-4606-8505-4f1e09f6aa64 service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received unexpected event network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 for instance with vm_state active and task_state rescuing.
Aug 14 20:00:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Removed pending event for 2c924d52-aa8a-47ed-857c-b863efe95258 due to event {{(pid=72782) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 20:00:27 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043227.57001, 2c924d52-aa8a-47ed-857c-b863efe95258 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:00:27 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] VM Resumed (Lifecycle Event)
Aug 14 20:00:27 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7414e086-c4cc-4241-941e-42a9a06139de tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:00:27 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:00:27 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:00:27 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 20:00:27 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043227.5720532, 2c924d52-aa8a-47ed-857c-b863efe95258 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:00:27 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] VM Started (Lifecycle Event)
Aug 14 20:00:27 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:00:27 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:00:27 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 20:00:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:27 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692043212.9649243, 64face75-3aba-4cb8-8ff2-a1bbdf9835e1 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:00:27 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] VM Stopped (Lifecycle Event)
Aug 14 20:00:27 user nova-compute[72782]: DEBUG nova.compute.manager [None req-61720077-7bf9-44fa-a32c-38dfc1d4c24b None None] [instance: 64face75-3aba-4cb8-8ff2-a1bbdf9835e1] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:00:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:35 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692043220.6307056, ebed33f0-94c7-4094-a181-335784ab8819 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:00:35 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: ebed33f0-94c7-4094-a181-335784ab8819] VM Stopped (Lifecycle Event)
Aug 14 20:00:35 user nova-compute[72782]: DEBUG nova.compute.manager [None req-eb81873d-7751-4b3d-a708-ad7e1c6d38a9 None None] [instance: ebed33f0-94c7-4094-a181-335784ab8819] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:00:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:56 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:00:56 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:00:56 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:00:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-e756247d-0359-4248-bde3-8c036e92c31d req-0c0b880a-b443-4c07-af9c-132bb7374b13 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Received event network-changed-35b9955c-a82a-42b9-a936-5f3429cda375 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:00:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-e756247d-0359-4248-bde3-8c036e92c31d req-0c0b880a-b443-4c07-af9c-132bb7374b13 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Refreshing instance network info cache due to event network-changed-35b9955c-a82a-42b9-a936-5f3429cda375. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:00:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e756247d-0359-4248-bde3-8c036e92c31d req-0c0b880a-b443-4c07-af9c-132bb7374b13 service nova] Acquiring lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:00:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e756247d-0359-4248-bde3-8c036e92c31d req-0c0b880a-b443-4c07-af9c-132bb7374b13 service nova] Acquired lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:00:57 user nova-compute[72782]: DEBUG nova.network.neutron [req-e756247d-0359-4248-bde3-8c036e92c31d req-0c0b880a-b443-4c07-af9c-132bb7374b13 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Refreshing network info cache for port 35b9955c-a82a-42b9-a936-5f3429cda375 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:00:57 user nova-compute[72782]: DEBUG nova.network.neutron [req-e756247d-0359-4248-bde3-8c036e92c31d req-0c0b880a-b443-4c07-af9c-132bb7374b13 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Updated VIF entry in instance network info cache for port 35b9955c-a82a-42b9-a936-5f3429cda375. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:00:57 user nova-compute[72782]: DEBUG nova.network.neutron [req-e756247d-0359-4248-bde3-8c036e92c31d req-0c0b880a-b443-4c07-af9c-132bb7374b13 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Updating instance_info_cache with network_info: [{"id": "35b9955c-a82a-42b9-a936-5f3429cda375", "address": "fa:16:3e:36:7a:36", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b9955c-a8", "ovs_interfaceid": "35b9955c-a82a-42b9-a936-5f3429cda375", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:00:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e756247d-0359-4248-bde3-8c036e92c31d req-0c0b880a-b443-4c07-af9c-132bb7374b13 service nova] Releasing lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:00:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:00:59 user nova-compute[72782]: DEBUG nova.compute.manager [req-e4b6f730-7437-44a3-bdc1-d0ddffcff4bc req-3ccb8298-30a5-4990-8686-cba329b25ab7 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received event network-changed-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:00:59 user nova-compute[72782]: DEBUG nova.compute.manager [req-e4b6f730-7437-44a3-bdc1-d0ddffcff4bc req-3ccb8298-30a5-4990-8686-cba329b25ab7 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Refreshing instance network info cache due to event network-changed-e2aad177-8aef-4cc1-98a3-9ee3117db998. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:00:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e4b6f730-7437-44a3-bdc1-d0ddffcff4bc req-3ccb8298-30a5-4990-8686-cba329b25ab7 service nova] Acquiring lock "refresh_cache-ca7d1bf8-168b-4484-a965-72ff0aea93ef" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:00:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e4b6f730-7437-44a3-bdc1-d0ddffcff4bc req-3ccb8298-30a5-4990-8686-cba329b25ab7 service nova] Acquired lock "refresh_cache-ca7d1bf8-168b-4484-a965-72ff0aea93ef" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:00:59 user nova-compute[72782]: DEBUG nova.network.neutron [req-e4b6f730-7437-44a3-bdc1-d0ddffcff4bc req-3ccb8298-30a5-4990-8686-cba329b25ab7 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Refreshing network info cache for port e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:00:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Stashing vm_state: active {{(pid=72782) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 14 20:00:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:00:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:00:59 user nova-compute[72782]: DEBUG nova.objects.instance [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'pci_requests' on Instance uuid ca7d1bf8-168b-4484-a965-72ff0aea93ef {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:00:59 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:00:59 user nova-compute[72782]: INFO nova.compute.claims [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Claim successful on node user
Aug 14 20:00:59 user nova-compute[72782]: DEBUG nova.objects.instance [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'resources' on Instance uuid ca7d1bf8-168b-4484-a965-72ff0aea93ef {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:00:59 user nova-compute[72782]: DEBUG nova.objects.instance [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'pci_devices' on Instance uuid ca7d1bf8-168b-4484-a965-72ff0aea93ef {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:00:59 user nova-compute[72782]: INFO nova.compute.resource_tracker [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Updating resource usage from migration d7f7dd24-98c3-418a-aba1-2f5d06a07431
Aug 14 20:00:59 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:00:59 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:00:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.414s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:00:59 user nova-compute[72782]: INFO nova.compute.manager [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Migrating
Aug 14 20:00:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "refresh_cache-ca7d1bf8-168b-4484-a965-72ff0aea93ef" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:01:00 user nova-compute[72782]: DEBUG nova.network.neutron [req-e4b6f730-7437-44a3-bdc1-d0ddffcff4bc req-3ccb8298-30a5-4990-8686-cba329b25ab7 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Updated VIF entry in instance network info cache for port e2aad177-8aef-4cc1-98a3-9ee3117db998. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:01:00 user nova-compute[72782]: DEBUG nova.network.neutron [req-e4b6f730-7437-44a3-bdc1-d0ddffcff4bc req-3ccb8298-30a5-4990-8686-cba329b25ab7 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Updating instance_info_cache with network_info: [{"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:01:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e4b6f730-7437-44a3-bdc1-d0ddffcff4bc req-3ccb8298-30a5-4990-8686-cba329b25ab7 service nova] Releasing lock "refresh_cache-ca7d1bf8-168b-4484-a965-72ff0aea93ef" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:01:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquired lock "refresh_cache-ca7d1bf8-168b-4484-a965-72ff0aea93ef" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:01:00 user nova-compute[72782]: DEBUG nova.network.neutron [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:01:00 user nova-compute[72782]: DEBUG nova.network.neutron [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Updating instance_info_cache with network_info: [{"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:01:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Releasing lock "refresh_cache-ca7d1bf8-168b-4484-a965-72ff0aea93ef" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:01:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Starting migrate_disk_and_power_off {{(pid=72782) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 14 20:01:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-1660184b-f5f3-49ad-afc2-24ac009746f3 req-b4bdf658-ba4c-4b2c-8979-3750320ab6d3 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received event network-vif-unplugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1660184b-f5f3-49ad-afc2-24ac009746f3 req-b4bdf658-ba4c-4b2c-8979-3750320ab6d3 service nova] Acquiring lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1660184b-f5f3-49ad-afc2-24ac009746f3 req-b4bdf658-ba4c-4b2c-8979-3750320ab6d3 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1660184b-f5f3-49ad-afc2-24ac009746f3 req-b4bdf658-ba4c-4b2c-8979-3750320ab6d3 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-1660184b-f5f3-49ad-afc2-24ac009746f3 req-b4bdf658-ba4c-4b2c-8979-3750320ab6d3 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] No waiting events found dispatching network-vif-unplugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:01:01 user nova-compute[72782]: WARNING nova.compute.manager [req-1660184b-f5f3-49ad-afc2-24ac009746f3 req-b4bdf658-ba4c-4b2c-8979-3750320ab6d3 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received unexpected event network-vif-unplugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 for instance with vm_state active and task_state resize_migrating.
Aug 14 20:01:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:01 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Instance destroyed successfully.
Aug 14 20:01:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:59:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-392999089',display_name='tempest-ServerActionsTestOtherA-server-392999089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-392999089',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjPa06vtlcnEwf9WmNngHo77ZQLE/dqlpBjCZ69lCWox+6yOHeDlaru6JozyQO8VPG/SE5WTpKRBcOS1LznFcAxBQR7z97DyBcD1Q9ZGwfJ2pOvn+iIjcliFOke0KJwkg==',key_name='tempest-keypair-525631678',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:59:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b6c0483a97574e7794c73fe43e51795e',ramdisk_id='',reservation_id='r-54bl51xf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-956209876',owner_user_name='tempest-ServerActionsTestOtherA-956209876-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a38fa907d804b81903eb97ab88ae181',uuid=ca7d1bf8-168b-4484-a965-72ff0aea93ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1328707283-network", "vif_mac": "fa:16:3e:fc:64:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converting VIF {"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1328707283-network", "vif_mac": "fa:16:3e:fc:64:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=e2aad177-8aef-4cc1-98a3-9ee3117db998,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aad177-8a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_vif [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=e2aad177-8aef-4cc1-98a3-9ee3117db998,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aad177-8a') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2aad177-8a, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:01:01 user nova-compute[72782]: INFO os_vif [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=e2aad177-8aef-4cc1-98a3-9ee3117db998,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aad177-8a')
Aug 14 20:01:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcytDLPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:01:01 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[078cc19a-8ed3-4d9e-9911-0c99bd7d9982]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[095e44a2-d089-40fc-b96b-7736253a2f6e]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:01:01 user nova-compute[72782]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 20:01:01 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:01:01 user nova-compute[72782]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 20:01:01 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e86595a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d'): ({'sdd'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Removing single pathed devices sdd {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ef5c7d-d4d1-4fb3-9a60-3fc933e9e628]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b3ac2d-f180-4c36-86bf-4697c4317bda]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Flushing IO for device /dev/sdd {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df6cc0a-39bf-4c2a-913a-ee22ff6032de]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae62f37-45a3-4a0c-ba0f-866ea7b85d1d]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[058eac1c-5e85-42cc-9ac6-a3cd80d2e63d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da686da-4330-49ac-b852-f921723f1370]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d, portal: 172.16.0.220,3260]
Aug 14 20:01:01 user nova-compute[72782]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d, portal: 172.16.0.220,3260] successful.
Aug 14 20:01:01 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[340a802e-dc24-4e5b-a2df-fb00112a3ce5]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] <== disconnect_volume: return (295ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:01:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:01:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:01:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:01:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-a4ae2e60-c4d4-4a7e-826e-fb315fa98138" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:01:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-a4ae2e60-c4d4-4a7e-826e-fb315fa98138" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:01:02 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:01:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:02 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Updating instance_info_cache with network_info: [{"id": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "address": "fa:16:3e:2d:5e:cf", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f53b30-4c", "ovs_interfaceid": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:01:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-a4ae2e60-c4d4-4a7e-826e-fb315fa98138" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:01:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:01:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:01:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:01:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Port e2aad177-8aef-4cc1-98a3-9ee3117db998 binding to destination host user is already ACTIVE {{(pid=72782) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "refresh_cache-ca7d1bf8-168b-4484-a965-72ff0aea93ef" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquired lock "refresh_cache-ca7d1bf8-168b-4484-a965-72ff0aea93ef" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received event network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] Acquiring lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] No waiting events found dispatching network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:01:03 user nova-compute[72782]: WARNING nova.compute.manager [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received unexpected event network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 for instance with vm_state active and task_state resize_migrated.
Aug 14 20:01:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received event network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] Acquiring lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] No waiting events found dispatching network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:01:03 user nova-compute[72782]: WARNING nova.compute.manager [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received unexpected event network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 for instance with vm_state active and task_state resize_migrated.
Aug 14 20:01:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received event network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] Acquiring lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] No waiting events found dispatching network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:01:03 user nova-compute[72782]: WARNING nova.compute.manager [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received unexpected event network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 for instance with vm_state active and task_state resize_migrated.
Aug 14 20:01:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received event network-vif-unplugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] Acquiring lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] No waiting events found dispatching network-vif-unplugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:01:03 user nova-compute[72782]: WARNING nova.compute.manager [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received unexpected event network-vif-unplugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 for instance with vm_state active and task_state resize_migrated.
Aug 14 20:01:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received event network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] Acquiring lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] No waiting events found dispatching network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:01:03 user nova-compute[72782]: WARNING nova.compute.manager [req-1a62f19f-b63c-447c-8df7-30ade4106f28 req-dfe930ed-888d-4965-a4b0-db8f882c0317 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received unexpected event network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 for instance with vm_state active and task_state resize_migrated.
Aug 14 20:01:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Updating instance_info_cache with network_info: [{"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:01:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Releasing lock "refresh_cache-ca7d1bf8-168b-4484-a965-72ff0aea93ef" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG os_brick.utils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acbcbf3-a6af-425d-9300-03b61fd31ab2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1960a8d0-744c-4ac1-9bac-c64bfb4403d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88f9046-d31c-4b21-9329-f88cf9e48175]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e75794-ec84-4c38-8ad0-898c9530b05d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:01:04 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[24805b01-381d-40b6-95f2-f9c28ab684bc]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG os_brick.utils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:01:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:01:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.277s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.260s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:07 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:01:07 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:01:07 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7898MB free_disk=25.328533172607422GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:01:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:07 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Applying migration context for instance ca7d1bf8-168b-4484-a965-72ff0aea93ef as it has an incoming, in-progress migration d7f7dd24-98c3-418a-aba1-2f5d06a07431. Migration status is post-migrating {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 20:01:07 user nova-compute[72782]: INFO nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Updating resource usage from migration d7f7dd24-98c3-418a-aba1-2f5d06a07431
Aug 14 20:01:07 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:01:07 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:01:07 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance a4ae2e60-c4d4-4a7e-826e-fb315fa98138 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:01:07 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ad4011a9-ab9f-4647-b677-a1c6337d2c2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:01:07 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:01:07 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2c924d52-aa8a-47ed-857c-b863efe95258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:01:07 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Migration d7f7dd24-98c3-418a-aba1-2f5d06a07431 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 20:01:07 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ca7d1bf8-168b-4484-a965-72ff0aea93ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:01:07 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:01:07 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:01:08 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing inventories for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 20:01:08 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating ProviderTree inventory for provider d26c9e3b-40e6-476e-9664-3119ebf5873b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 20:01:08 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 20:01:08 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing aggregate associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, aggregates: None {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 20:01:08 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing trait associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 20:01:08 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:01:08 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:01:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:01:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.863s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:01:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 20:01:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] There are 0 instances to clean {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 20:01:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:01:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72782) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 20:01:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:01:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:01:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:16 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692043261.5621247, ca7d1bf8-168b-4484-a965-72ff0aea93ef => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:01:16 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] VM Stopped (Lifecycle Event)
Aug 14 20:01:16 user nova-compute[72782]: DEBUG nova.compute.manager [None req-677458f5-4e3e-4154-9306-c18e7f5ed6cb None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:01:16 user nova-compute[72782]: DEBUG nova.compute.manager [None req-677458f5-4e3e-4154-9306-c18e7f5ed6cb None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:01:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:01:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:01:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:01:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:01:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:16 user nova-compute[72782]: INFO nova.compute.manager [None req-677458f5-4e3e-4154-9306-c18e7f5ed6cb None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 20:01:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:17 user nova-compute[72782]: INFO nova.compute.manager [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Terminating instance
Aug 14 20:01:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG nova.compute.manager [req-73c96d14-3ff6-4b09-9845-e68f59e35c45 req-edc2b840-e1f7-4bb8-9872-171fa47dbfbf service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Received event network-changed-06f53b30-4cdd-4b86-a06d-2734de26fb74 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG nova.compute.manager [req-73c96d14-3ff6-4b09-9845-e68f59e35c45 req-edc2b840-e1f7-4bb8-9872-171fa47dbfbf service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Refreshing instance network info cache due to event network-changed-06f53b30-4cdd-4b86-a06d-2734de26fb74. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-73c96d14-3ff6-4b09-9845-e68f59e35c45 req-edc2b840-e1f7-4bb8-9872-171fa47dbfbf service nova] Acquiring lock "refresh_cache-a4ae2e60-c4d4-4a7e-826e-fb315fa98138" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-73c96d14-3ff6-4b09-9845-e68f59e35c45 req-edc2b840-e1f7-4bb8-9872-171fa47dbfbf service nova] Acquired lock "refresh_cache-a4ae2e60-c4d4-4a7e-826e-fb315fa98138" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG nova.network.neutron [req-73c96d14-3ff6-4b09-9845-e68f59e35c45 req-edc2b840-e1f7-4bb8-9872-171fa47dbfbf service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Refreshing network info cache for port 06f53b30-4cdd-4b86-a06d-2734de26fb74 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG nova.compute.manager [req-150e1041-682f-4ca3-aa47-48791f3c4c49 req-04ae0104-59da-4531-aae2-3112bf7ac4a3 service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Received event network-vif-unplugged-06f53b30-4cdd-4b86-a06d-2734de26fb74 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-150e1041-682f-4ca3-aa47-48791f3c4c49 req-04ae0104-59da-4531-aae2-3112bf7ac4a3 service nova] Acquiring lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-150e1041-682f-4ca3-aa47-48791f3c4c49 req-04ae0104-59da-4531-aae2-3112bf7ac4a3 service nova] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-150e1041-682f-4ca3-aa47-48791f3c4c49 req-04ae0104-59da-4531-aae2-3112bf7ac4a3 service nova] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG nova.compute.manager [req-150e1041-682f-4ca3-aa47-48791f3c4c49 req-04ae0104-59da-4531-aae2-3112bf7ac4a3 service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] No waiting events found dispatching network-vif-unplugged-06f53b30-4cdd-4b86-a06d-2734de26fb74 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG nova.compute.manager [req-150e1041-682f-4ca3-aa47-48791f3c4c49 req-04ae0104-59da-4531-aae2-3112bf7ac4a3 service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Received event network-vif-unplugged-06f53b30-4cdd-4b86-a06d-2734de26fb74 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG nova.network.neutron [req-73c96d14-3ff6-4b09-9845-e68f59e35c45 req-edc2b840-e1f7-4bb8-9872-171fa47dbfbf service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Updated VIF entry in instance network info cache for port 06f53b30-4cdd-4b86-a06d-2734de26fb74. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG nova.network.neutron [req-73c96d14-3ff6-4b09-9845-e68f59e35c45 req-edc2b840-e1f7-4bb8-9872-171fa47dbfbf service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Updating instance_info_cache with network_info: [{"id": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "address": "fa:16:3e:2d:5e:cf", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f53b30-4c", "ovs_interfaceid": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-73c96d14-3ff6-4b09-9845-e68f59e35c45 req-edc2b840-e1f7-4bb8-9872-171fa47dbfbf service nova] Releasing lock "refresh_cache-a4ae2e60-c4d4-4a7e-826e-fb315fa98138" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:01:17 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Instance destroyed successfully.
Aug 14 20:01:17 user nova-compute[72782]: DEBUG nova.objects.instance [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lazy-loading 'resources' on Instance uuid a4ae2e60-c4d4-4a7e-826e-fb315fa98138 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-424258125',display_name='tempest-TestStampPattern-server-424258125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-424258125',id=24,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM83rJpi+PWJVg1bcMN9+UzFWK7I+4X1gYs6cuilTIZnJOuWki/JRMmqnsb5/j9U7gZMW4Fb1jbj8E3oTngmEYniu5bxs0zhFngi/h3GEmcDqt3L25ZYVeHugUHVbYP8eA==',key_name='tempest-TestStampPattern-666114121',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b23edaa22c50450b9b35fc42fcd4f59f',ramdisk_id='',reservation_id='r-os8wlxsn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-890299113',owner_user_name='tempest-TestStampPattern-890299113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:57:12Z,user_data=None,user_id='9d0b98a72a4843beafc4bda85ae07f61',uuid=a4ae2e60-c4d4-4a7e-826e-fb315fa98138,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "address": "fa:16:3e:2d:5e:cf", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f53b30-4c", "ovs_interfaceid": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Converting VIF {"id": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "address": "fa:16:3e:2d:5e:cf", "network": {"id": "6cd1aff4-7785-41f1-8881-49783a46d7d9", "bridge": "br-int", "label": "tempest-TestStampPattern-827863734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b23edaa22c50450b9b35fc42fcd4f59f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f53b30-4c", "ovs_interfaceid": "06f53b30-4cdd-4b86-a06d-2734de26fb74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:5e:cf,bridge_name='br-int',has_traffic_filtering=True,id=06f53b30-4cdd-4b86-a06d-2734de26fb74,network=Network(6cd1aff4-7785-41f1-8881-49783a46d7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f53b30-4c') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG os_vif [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:5e:cf,bridge_name='br-int',has_traffic_filtering=True,id=06f53b30-4cdd-4b86-a06d-2734de26fb74,network=Network(6cd1aff4-7785-41f1-8881-49783a46d7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f53b30-4c') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06f53b30-4c, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:17 user nova-compute[72782]: INFO os_vif [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:5e:cf,bridge_name='br-int',has_traffic_filtering=True,id=06f53b30-4cdd-4b86-a06d-2734de26fb74,network=Network(6cd1aff4-7785-41f1-8881-49783a46d7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f53b30-4c')
Aug 14 20:01:17 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Deleting instance files /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138_del
Aug 14 20:01:17 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Deletion of /opt/stack/data/nova/instances/a4ae2e60-c4d4-4a7e-826e-fb315fa98138_del complete
Aug 14 20:01:18 user nova-compute[72782]: INFO nova.compute.manager [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 14 20:01:18 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:01:18 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:01:18 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:01:18 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:01:18 user nova-compute[72782]: DEBUG nova.compute.manager [req-13038d6e-d971-4174-9100-181e3137bc5c req-fe17caeb-3dae-4aae-9cec-8d74ba88d05c service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Received event network-vif-deleted-06f53b30-4cdd-4b86-a06d-2734de26fb74 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:01:18 user nova-compute[72782]: INFO nova.compute.manager [req-13038d6e-d971-4174-9100-181e3137bc5c req-fe17caeb-3dae-4aae-9cec-8d74ba88d05c service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Neutron deleted interface 06f53b30-4cdd-4b86-a06d-2734de26fb74; detaching it from the instance and deleting it from the info cache
Aug 14 20:01:18 user nova-compute[72782]: DEBUG nova.network.neutron [req-13038d6e-d971-4174-9100-181e3137bc5c req-fe17caeb-3dae-4aae-9cec-8d74ba88d05c service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:01:18 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Took 0.55 seconds to deallocate network for instance.
Aug 14 20:01:18 user nova-compute[72782]: DEBUG nova.compute.manager [req-13038d6e-d971-4174-9100-181e3137bc5c req-fe17caeb-3dae-4aae-9cec-8d74ba88d05c service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Detach interface failed, port_id=06f53b30-4cdd-4b86-a06d-2734de26fb74, reason: Instance a4ae2e60-c4d4-4a7e-826e-fb315fa98138 could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 20:01:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:19 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:01:19 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:01:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:19 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Deleted allocations for instance a4ae2e60-c4d4-4a7e-826e-fb315fa98138
Aug 14 20:01:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8a12dac1-0642-46fa-8c7b-9452cbeae35e tempest-TestStampPattern-890299113 tempest-TestStampPattern-890299113-project-member] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.160s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-6014dac9-cadc-431f-9728-3000c6d4978c req-5af5cb52-ef82-452a-94cd-c9333722a28d service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Received event network-vif-plugged-06f53b30-4cdd-4b86-a06d-2734de26fb74 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:01:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6014dac9-cadc-431f-9728-3000c6d4978c req-5af5cb52-ef82-452a-94cd-c9333722a28d service nova] Acquiring lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6014dac9-cadc-431f-9728-3000c6d4978c req-5af5cb52-ef82-452a-94cd-c9333722a28d service nova] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6014dac9-cadc-431f-9728-3000c6d4978c req-5af5cb52-ef82-452a-94cd-c9333722a28d service nova] Lock "a4ae2e60-c4d4-4a7e-826e-fb315fa98138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-6014dac9-cadc-431f-9728-3000c6d4978c req-5af5cb52-ef82-452a-94cd-c9333722a28d service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] No waiting events found dispatching network-vif-plugged-06f53b30-4cdd-4b86-a06d-2734de26fb74 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:01:19 user nova-compute[72782]: WARNING nova.compute.manager [req-6014dac9-cadc-431f-9728-3000c6d4978c req-5af5cb52-ef82-452a-94cd-c9333722a28d service nova] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Received unexpected event network-vif-plugged-06f53b30-4cdd-4b86-a06d-2734de26fb74 for instance with vm_state deleted and task_state None.
Aug 14 20:01:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Starting finish_migration {{(pid=72782) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Instance directory exists: not creating {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 20:01:24 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Creating image(s)
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Did not create local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Ensure instance console log exists: /opt/stack/data/nova/instances/ca7d1bf8-168b-4484-a965-72ff0aea93ef/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Start _get_guest_xml network_info=[{"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1328707283-network", "vif_mac": "fa:16:3e:fc:64:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '96e3abbc-41f5-49cc-8d8a-18c6299a2050', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcytDLPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ca7d1bf8-168b-4484-a965-72ff0aea93ef', 'attached_at': '2023-08-14T20:01:24.000000', 'detached_at': '', 'volume_id': '029bcc2b-b3c5-4483-b696-5218bfe52e0d', 'serial': '029bcc2b-b3c5-4483-b696-5218bfe52e0d'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:01:24 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:01:24 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.objects.instance [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'vcpu_model' on Instance uuid ca7d1bf8-168b-4484-a965-72ff0aea93ef {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcytDLPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:01:24 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:01:24 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:01:24 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ba76d4-25f3-4268-906d-e383c0a7efc0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:01:24 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e591cf-544d-4538-8ea6-8fbdbaa6ff5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d] added
Aug 14 20:01:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2770b044-9503-45d9-9ce3-9e9af0969de6]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd0d74c-f830-45a8-9c9a-fe1c09f99104]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcytDLPb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcytDLPb" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb579ae4-7cf3-4f36-85f1-2fc278917bb3]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CcytDLPb'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b6f978-32a0-429d-9dde-ca8fd996afd9]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f45aab-9a25-4efe-81ef-3f0eeb875645]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:01:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:01:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa966f3-927a-43a3-8749-b56d92ee75ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d, portal: 172.16.0.220,3260]
Aug 14 20:01:24 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d, portal: 172.16.0.220,3260] successful.
Aug 14 20:01:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0bca0e-2515-4e6b-8bbf-83ef918ac0c7]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[811437ea-3dfb-4708-a826-7d274d9789b7]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:01:24 user nova-compute[72782]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 20:01:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:01:24 user nova-compute[72782]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 20:01:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[854b1511-3118-4161-8955-cc3aba5065aa]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:01:24 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcytDLPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26364346639356230', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364346639356230', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:59:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-392999089',display_name='tempest-ServerActionsTestOtherA-server-392999089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-392999089',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjPa06vtlcnEwf9WmNngHo77ZQLE/dqlpBjCZ69lCWox+6yOHeDlaru6JozyQO8VPG/SE5WTpKRBcOS1LznFcAxBQR7z97DyBcD1Q9ZGwfJ2pOvn+iIjcliFOke0KJwkg==',key_name='tempest-keypair-525631678',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:59:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b6c0483a97574e7794c73fe43e51795e',ramdisk_id='',reservation_id='r-54bl51xf',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-956209876',owner_user_name='tempest-ServerActionsTestOtherA-956209876-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:01:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a38fa907d804b81903eb97ab88ae181',uuid=ca7d1bf8-168b-4484-a965-72ff0aea93ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1328707283-network", "vif_mac": "fa:16:3e:fc:64:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converting VIF {"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1328707283-network", "vif_mac": "fa:16:3e:fc:64:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=e2aad177-8aef-4cc1-98a3-9ee3117db998,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aad177-8a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:01:25 user nova-compute[72782]:   <uuid>ca7d1bf8-168b-4484-a965-72ff0aea93ef</uuid>
Aug 14 20:01:25 user nova-compute[72782]:   <name>instance-0000001f</name>
Aug 14 20:01:25 user nova-compute[72782]:   <memory>2097152</memory>
Aug 14 20:01:25 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:01:25 user nova-compute[72782]:   <metadata>
Aug 14 20:01:25 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:01:25 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:01:25 user nova-compute[72782]:       <nova:name>tempest-ServerActionsTestOtherA-server-392999089</nova:name>
Aug 14 20:01:25 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:01:24</nova:creationTime>
Aug 14 20:01:25 user nova-compute[72782]:       <nova:flavor name="m1.small">
Aug 14 20:01:25 user nova-compute[72782]:         <nova:memory>2048</nova:memory>
Aug 14 20:01:25 user nova-compute[72782]:         <nova:disk>20</nova:disk>
Aug 14 20:01:25 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:01:25 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:01:25 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:01:25 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:01:25 user nova-compute[72782]:       <nova:owner>
Aug 14 20:01:25 user nova-compute[72782]:         <nova:user uuid="8a38fa907d804b81903eb97ab88ae181">tempest-ServerActionsTestOtherA-956209876-project-member</nova:user>
Aug 14 20:01:25 user nova-compute[72782]:         <nova:project uuid="b6c0483a97574e7794c73fe43e51795e">tempest-ServerActionsTestOtherA-956209876</nova:project>
Aug 14 20:01:25 user nova-compute[72782]:       </nova:owner>
Aug 14 20:01:25 user nova-compute[72782]:       <nova:ports>
Aug 14 20:01:25 user nova-compute[72782]:         <nova:port uuid="e2aad177-8aef-4cc1-98a3-9ee3117db998">
Aug 14 20:01:25 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 20:01:25 user nova-compute[72782]:         </nova:port>
Aug 14 20:01:25 user nova-compute[72782]:       </nova:ports>
Aug 14 20:01:25 user nova-compute[72782]:     </nova:instance>
Aug 14 20:01:25 user nova-compute[72782]:   </metadata>
Aug 14 20:01:25 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:01:25 user nova-compute[72782]:     <system>
Aug 14 20:01:25 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:01:25 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:01:25 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:01:25 user nova-compute[72782]:       <entry name="serial">ca7d1bf8-168b-4484-a965-72ff0aea93ef</entry>
Aug 14 20:01:25 user nova-compute[72782]:       <entry name="uuid">ca7d1bf8-168b-4484-a965-72ff0aea93ef</entry>
Aug 14 20:01:25 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:01:25 user nova-compute[72782]:     </system>
Aug 14 20:01:25 user nova-compute[72782]:   </sysinfo>
Aug 14 20:01:25 user nova-compute[72782]:   <os>
Aug 14 20:01:25 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:01:25 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:01:25 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:01:25 user nova-compute[72782]:   </os>
Aug 14 20:01:25 user nova-compute[72782]:   <features>
Aug 14 20:01:25 user nova-compute[72782]:     <acpi/>
Aug 14 20:01:25 user nova-compute[72782]:     <apic/>
Aug 14 20:01:25 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:01:25 user nova-compute[72782]:   </features>
Aug 14 20:01:25 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:01:25 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:01:25 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:01:25 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:01:25 user nova-compute[72782]:   </clock>
Aug 14 20:01:25 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:01:25 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:01:25 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:01:25 user nova-compute[72782]:   </cpu>
Aug 14 20:01:25 user nova-compute[72782]:   <devices>
Aug 14 20:01:25 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 20:01:25 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:01:25 user nova-compute[72782]:       <source dev="/dev/sdb"/>
Aug 14 20:01:25 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:01:25 user nova-compute[72782]:       <serial>029bcc2b-b3c5-4483-b696-5218bfe52e0d</serial>
Aug 14 20:01:25 user nova-compute[72782]:     </disk>
Aug 14 20:01:25 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:01:25 user nova-compute[72782]:       <mac address="fa:16:3e:fc:64:3b"/>
Aug 14 20:01:25 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:01:25 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:01:25 user nova-compute[72782]:       <target dev="tape2aad177-8a"/>
Aug 14 20:01:25 user nova-compute[72782]:     </interface>
Aug 14 20:01:25 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:01:25 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/ca7d1bf8-168b-4484-a965-72ff0aea93ef/console.log" append="off"/>
Aug 14 20:01:25 user nova-compute[72782]:     </serial>
Aug 14 20:01:25 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:01:25 user nova-compute[72782]:     <video>
Aug 14 20:01:25 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:01:25 user nova-compute[72782]:     </video>
Aug 14 20:01:25 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:01:25 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:01:25 user nova-compute[72782]:     </rng>
Aug 14 20:01:25 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:01:25 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:01:25 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:01:25 user nova-compute[72782]:     </memballoon>
Aug 14 20:01:25 user nova-compute[72782]:   </devices>
Aug 14 20:01:25 user nova-compute[72782]: </domain>
Aug 14 20:01:25 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:59:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-392999089',display_name='tempest-ServerActionsTestOtherA-server-392999089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-392999089',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjPa06vtlcnEwf9WmNngHo77ZQLE/dqlpBjCZ69lCWox+6yOHeDlaru6JozyQO8VPG/SE5WTpKRBcOS1LznFcAxBQR7z97DyBcD1Q9ZGwfJ2pOvn+iIjcliFOke0KJwkg==',key_name='tempest-keypair-525631678',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:59:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b6c0483a97574e7794c73fe43e51795e',ramdisk_id='',reservation_id='r-54bl51xf',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-956209876',owner_user_name='tempest-ServerActionsTestOtherA-956209876-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:01:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a38fa907d804b81903eb97ab88ae181',uuid=ca7d1bf8-168b-4484-a965-72ff0aea93ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1328707283-network", "vif_mac": "fa:16:3e:fc:64:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converting VIF {"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1328707283-network", "vif_mac": "fa:16:3e:fc:64:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=e2aad177-8aef-4cc1-98a3-9ee3117db998,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aad177-8a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG os_vif [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=e2aad177-8aef-4cc1-98a3-9ee3117db998,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aad177-8a') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2aad177-8a, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2aad177-8a, col_values=(('external_ids', {'iface-id': 'e2aad177-8aef-4cc1-98a3-9ee3117db998', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:64:3b', 'vm-uuid': 'ca7d1bf8-168b-4484-a965-72ff0aea93ef'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:25 user nova-compute[72782]: INFO os_vif [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=e2aad177-8aef-4cc1-98a3-9ee3117db998,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aad177-8a')
Aug 14 20:01:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:01:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] No VIF found with MAC fa:16:3e:fc:64:3b, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:01:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-6f54a7c7-8b70-4f5b-ae7b-842afe62fbe7 req-0c1c05b6-6a53-45aa-846b-cb7bffbd4118 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received event network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:01:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6f54a7c7-8b70-4f5b-ae7b-842afe62fbe7 req-0c1c05b6-6a53-45aa-846b-cb7bffbd4118 service nova] Acquiring lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6f54a7c7-8b70-4f5b-ae7b-842afe62fbe7 req-0c1c05b6-6a53-45aa-846b-cb7bffbd4118 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6f54a7c7-8b70-4f5b-ae7b-842afe62fbe7 req-0c1c05b6-6a53-45aa-846b-cb7bffbd4118 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-6f54a7c7-8b70-4f5b-ae7b-842afe62fbe7 req-0c1c05b6-6a53-45aa-846b-cb7bffbd4118 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] No waiting events found dispatching network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:01:27 user nova-compute[72782]: WARNING nova.compute.manager [req-6f54a7c7-8b70-4f5b-ae7b-842afe62fbe7 req-0c1c05b6-6a53-45aa-846b-cb7bffbd4118 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received unexpected event network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 for instance with vm_state active and task_state resize_finish.
Aug 14 20:01:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:29 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043289.2902157, ca7d1bf8-168b-4484-a965-72ff0aea93ef => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:01:29 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] VM Resumed (Lifecycle Event)
Aug 14 20:01:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:01:29 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Instance running successfully.
Aug 14 20:01:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Failed to set time: agent not configured {{(pid=72782) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 14 20:01:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-865c36bc-488b-44ac-afa1-3a0e2721d0bc tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] finish_migration finished successfully. {{(pid=72782) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 14 20:01:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:01:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:01:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-76b6dc1e-a4df-4014-8919-997f5387b36b req-50b7eb44-e535-4bfc-94b8-98b676ad1ed2 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received event network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:01:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-76b6dc1e-a4df-4014-8919-997f5387b36b req-50b7eb44-e535-4bfc-94b8-98b676ad1ed2 service nova] Acquiring lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-76b6dc1e-a4df-4014-8919-997f5387b36b req-50b7eb44-e535-4bfc-94b8-98b676ad1ed2 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-76b6dc1e-a4df-4014-8919-997f5387b36b req-50b7eb44-e535-4bfc-94b8-98b676ad1ed2 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-76b6dc1e-a4df-4014-8919-997f5387b36b req-50b7eb44-e535-4bfc-94b8-98b676ad1ed2 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] No waiting events found dispatching network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:01:29 user nova-compute[72782]: WARNING nova.compute.manager [req-76b6dc1e-a4df-4014-8919-997f5387b36b req-50b7eb44-e535-4bfc-94b8-98b676ad1ed2 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received unexpected event network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 for instance with vm_state active and task_state resize_finish.
Aug 14 20:01:29 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 20:01:29 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043289.295883, ca7d1bf8-168b-4484-a965-72ff0aea93ef => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:01:29 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] VM Started (Lifecycle Event)
Aug 14 20:01:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:01:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:01:29 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 20:01:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:32 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692043277.889553, a4ae2e60-c4d4-4a7e-826e-fb315fa98138 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:01:32 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] VM Stopped (Lifecycle Event)
Aug 14 20:01:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c5c92924-a683-40a2-ae9b-80f1052464e7 None None] [instance: a4ae2e60-c4d4-4a7e-826e-fb315fa98138] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:01:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:01:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "13201da3-4908-4724-9759-100190ed16d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "13201da3-4908-4724-9759-100190ed16d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:01:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:40 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:01:40 user nova-compute[72782]: INFO nova.compute.claims [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Claim successful on node user
Aug 14 20:01:40 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:01:40 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG nova.network.neutron [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:01:41 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:01:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:01:41 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Creating image(s)
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "/opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "/opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "/opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG nova.policy [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12fb8b10952b4c6b8dc6823610830241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9f312ba4414905a8d6eb44933e430e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:01:41 user nova-compute[72782]: WARNING nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] While synchronizing instance power states, found 7 instances in the database and 6 instances on the hypervisor.
Aug 14 20:01:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid 259c51df-ccd6-456e-85f4-7aaf4cba2b69 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid 3c2df162-332c-4391-95b8-223e07546d74 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid ad4011a9-ab9f-4647-b677-a1c6337d2c2c {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid 2c924d52-aa8a-47ed-857c-b863efe95258 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid ca7d1bf8-168b-4484-a965-72ff0aea93ef {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid 13201da3-4908-4724-9759-100190ed16d3 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "3c2df162-332c-4391-95b8-223e07546d74" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "3c2df162-332c-4391-95b8-223e07546d74" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "2c924d52-aa8a-47ed-857c-b863efe95258" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "2c924d52-aa8a-47ed-857c-b863efe95258" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "13201da3-4908-4724-9759-100190ed16d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.208s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "3c2df162-332c-4391-95b8-223e07546d74" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "2c924d52-aa8a-47ed-857c-b863efe95258" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.126s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.210s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk 1073741824" returned: 0 in 0.061s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.220s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 20:01:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:42 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Cannot resize image /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 20:01:42 user nova-compute[72782]: DEBUG nova.objects.instance [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'migration_context' on Instance uuid 13201da3-4908-4724-9759-100190ed16d3 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:01:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:01:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Ensure instance console log exists: /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:01:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:42 user nova-compute[72782]: DEBUG nova.network.neutron [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Successfully created port: 32808424-a985-4d95-9900-fd909afa9e66 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:01:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:42 user nova-compute[72782]: DEBUG nova.network.neutron [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Successfully updated port: 32808424-a985-4d95-9900-fd909afa9e66 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "refresh_cache-13201da3-4908-4724-9759-100190ed16d3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquired lock "refresh_cache-13201da3-4908-4724-9759-100190ed16d3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.network.neutron [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.compute.manager [req-d09d33ad-e1f9-45e1-8c97-360bc9391a50 req-14c1ea50-7f01-4229-b3d6-9b5d42d4a10a service nova] [instance: 13201da3-4908-4724-9759-100190ed16d3] Received event network-changed-32808424-a985-4d95-9900-fd909afa9e66 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.compute.manager [req-d09d33ad-e1f9-45e1-8c97-360bc9391a50 req-14c1ea50-7f01-4229-b3d6-9b5d42d4a10a service nova] [instance: 13201da3-4908-4724-9759-100190ed16d3] Refreshing instance network info cache due to event network-changed-32808424-a985-4d95-9900-fd909afa9e66. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d09d33ad-e1f9-45e1-8c97-360bc9391a50 req-14c1ea50-7f01-4229-b3d6-9b5d42d4a10a service nova] Acquiring lock "refresh_cache-13201da3-4908-4724-9759-100190ed16d3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.network.neutron [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.network.neutron [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Updating instance_info_cache with network_info: [{"id": "32808424-a985-4d95-9900-fd909afa9e66", "address": "fa:16:3e:8f:3b:73", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32808424-a9", "ovs_interfaceid": "32808424-a985-4d95-9900-fd909afa9e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Releasing lock "refresh_cache-13201da3-4908-4724-9759-100190ed16d3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Instance network_info: |[{"id": "32808424-a985-4d95-9900-fd909afa9e66", "address": "fa:16:3e:8f:3b:73", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32808424-a9", "ovs_interfaceid": "32808424-a985-4d95-9900-fd909afa9e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d09d33ad-e1f9-45e1-8c97-360bc9391a50 req-14c1ea50-7f01-4229-b3d6-9b5d42d4a10a service nova] Acquired lock "refresh_cache-13201da3-4908-4724-9759-100190ed16d3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.network.neutron [req-d09d33ad-e1f9-45e1-8c97-360bc9391a50 req-14c1ea50-7f01-4229-b3d6-9b5d42d4a10a service nova] [instance: 13201da3-4908-4724-9759-100190ed16d3] Refreshing network info cache for port 32808424-a985-4d95-9900-fd909afa9e66 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Start _get_guest_xml network_info=[{"id": "32808424-a985-4d95-9900-fd909afa9e66", "address": "fa:16:3e:8f:3b:73", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32808424-a9", "ovs_interfaceid": "32808424-a985-4d95-9900-fd909afa9e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:01:43 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:01:43 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1989629223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1989629223',id=32,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f9f312ba4414905a8d6eb44933e430e',ramdisk_id='',reservation_id='r-rt9aj60i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:01:41Z,user_data=None,user_id='12fb8b10952b4c6b8dc6823610830241',uuid=13201da3-4908-4724-9759-100190ed16d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32808424-a985-4d95-9900-fd909afa9e66", "address": "fa:16:3e:8f:3b:73", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32808424-a9", "ovs_interfaceid": "32808424-a985-4d95-9900-fd909afa9e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converting VIF {"id": "32808424-a985-4d95-9900-fd909afa9e66", "address": "fa:16:3e:8f:3b:73", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32808424-a9", "ovs_interfaceid": "32808424-a985-4d95-9900-fd909afa9e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:3b:73,bridge_name='br-int',has_traffic_filtering=True,id=32808424-a985-4d95-9900-fd909afa9e66,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32808424-a9') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.objects.instance [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'pci_devices' on Instance uuid 13201da3-4908-4724-9759-100190ed16d3 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:01:43 user nova-compute[72782]:   <uuid>13201da3-4908-4724-9759-100190ed16d3</uuid>
Aug 14 20:01:43 user nova-compute[72782]:   <name>instance-00000020</name>
Aug 14 20:01:43 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:01:43 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:01:43 user nova-compute[72782]:   <metadata>
Aug 14 20:01:43 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:01:43 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:01:43 user nova-compute[72782]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1989629223</nova:name>
Aug 14 20:01:43 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:01:43</nova:creationTime>
Aug 14 20:01:43 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:01:43 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:01:43 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:01:43 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:01:43 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:01:43 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:01:43 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:01:43 user nova-compute[72782]:       <nova:owner>
Aug 14 20:01:43 user nova-compute[72782]:         <nova:user uuid="12fb8b10952b4c6b8dc6823610830241">tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member</nova:user>
Aug 14 20:01:43 user nova-compute[72782]:         <nova:project uuid="4f9f312ba4414905a8d6eb44933e430e">tempest-ServerBootFromVolumeStableRescueTest-1102073842</nova:project>
Aug 14 20:01:43 user nova-compute[72782]:       </nova:owner>
Aug 14 20:01:43 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 20:01:43 user nova-compute[72782]:       <nova:ports>
Aug 14 20:01:43 user nova-compute[72782]:         <nova:port uuid="32808424-a985-4d95-9900-fd909afa9e66">
Aug 14 20:01:43 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 20:01:43 user nova-compute[72782]:         </nova:port>
Aug 14 20:01:43 user nova-compute[72782]:       </nova:ports>
Aug 14 20:01:43 user nova-compute[72782]:     </nova:instance>
Aug 14 20:01:43 user nova-compute[72782]:   </metadata>
Aug 14 20:01:43 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:01:43 user nova-compute[72782]:     <system>
Aug 14 20:01:43 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:01:43 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:01:43 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:01:43 user nova-compute[72782]:       <entry name="serial">13201da3-4908-4724-9759-100190ed16d3</entry>
Aug 14 20:01:43 user nova-compute[72782]:       <entry name="uuid">13201da3-4908-4724-9759-100190ed16d3</entry>
Aug 14 20:01:43 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:01:43 user nova-compute[72782]:     </system>
Aug 14 20:01:43 user nova-compute[72782]:   </sysinfo>
Aug 14 20:01:43 user nova-compute[72782]:   <os>
Aug 14 20:01:43 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:01:43 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:01:43 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:01:43 user nova-compute[72782]:   </os>
Aug 14 20:01:43 user nova-compute[72782]:   <features>
Aug 14 20:01:43 user nova-compute[72782]:     <acpi/>
Aug 14 20:01:43 user nova-compute[72782]:     <apic/>
Aug 14 20:01:43 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:01:43 user nova-compute[72782]:   </features>
Aug 14 20:01:43 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:01:43 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:01:43 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:01:43 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:01:43 user nova-compute[72782]:   </clock>
Aug 14 20:01:43 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:01:43 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:01:43 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:01:43 user nova-compute[72782]:   </cpu>
Aug 14 20:01:43 user nova-compute[72782]:   <devices>
Aug 14 20:01:43 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:01:43 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:01:43 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk"/>
Aug 14 20:01:43 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:01:43 user nova-compute[72782]:     </disk>
Aug 14 20:01:43 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:01:43 user nova-compute[72782]:       <mac address="fa:16:3e:8f:3b:73"/>
Aug 14 20:01:43 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:01:43 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:01:43 user nova-compute[72782]:       <target dev="tap32808424-a9"/>
Aug 14 20:01:43 user nova-compute[72782]:     </interface>
Aug 14 20:01:43 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:01:43 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/console.log" append="off"/>
Aug 14 20:01:43 user nova-compute[72782]:     </serial>
Aug 14 20:01:43 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:01:43 user nova-compute[72782]:     <video>
Aug 14 20:01:43 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:01:43 user nova-compute[72782]:     </video>
Aug 14 20:01:43 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:01:43 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:01:43 user nova-compute[72782]:     </rng>
Aug 14 20:01:43 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:01:43 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:01:43 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:01:43 user nova-compute[72782]:     </memballoon>
Aug 14 20:01:43 user nova-compute[72782]:   </devices>
Aug 14 20:01:43 user nova-compute[72782]: </domain>
Aug 14 20:01:43 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1989629223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1989629223',id=32,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f9f312ba4414905a8d6eb44933e430e',ramdisk_id='',reservation_id='r-rt9aj60i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:01:41Z,user_data=None,user_id='12fb8b10952b4c6b8dc6823610830241',uuid=13201da3-4908-4724-9759-100190ed16d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32808424-a985-4d95-9900-fd909afa9e66", "address": "fa:16:3e:8f:3b:73", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32808424-a9", "ovs_interfaceid": "32808424-a985-4d95-9900-fd909afa9e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converting VIF {"id": "32808424-a985-4d95-9900-fd909afa9e66", "address": "fa:16:3e:8f:3b:73", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32808424-a9", "ovs_interfaceid": "32808424-a985-4d95-9900-fd909afa9e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:3b:73,bridge_name='br-int',has_traffic_filtering=True,id=32808424-a985-4d95-9900-fd909afa9e66,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32808424-a9') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG os_vif [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:3b:73,bridge_name='br-int',has_traffic_filtering=True,id=32808424-a985-4d95-9900-fd909afa9e66,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32808424-a9') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32808424-a9, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32808424-a9, col_values=(('external_ids', {'iface-id': '32808424-a985-4d95-9900-fd909afa9e66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:3b:73', 'vm-uuid': '13201da3-4908-4724-9759-100190ed16d3'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:43 user nova-compute[72782]: INFO os_vif [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:3b:73,bridge_name='br-int',has_traffic_filtering=True,id=32808424-a985-4d95-9900-fd909afa9e66,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32808424-a9')
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:01:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] No VIF found with MAC fa:16:3e:8f:3b:73, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:01:44 user nova-compute[72782]: DEBUG nova.network.neutron [req-d09d33ad-e1f9-45e1-8c97-360bc9391a50 req-14c1ea50-7f01-4229-b3d6-9b5d42d4a10a service nova] [instance: 13201da3-4908-4724-9759-100190ed16d3] Updated VIF entry in instance network info cache for port 32808424-a985-4d95-9900-fd909afa9e66. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:01:44 user nova-compute[72782]: DEBUG nova.network.neutron [req-d09d33ad-e1f9-45e1-8c97-360bc9391a50 req-14c1ea50-7f01-4229-b3d6-9b5d42d4a10a service nova] [instance: 13201da3-4908-4724-9759-100190ed16d3] Updating instance_info_cache with network_info: [{"id": "32808424-a985-4d95-9900-fd909afa9e66", "address": "fa:16:3e:8f:3b:73", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32808424-a9", "ovs_interfaceid": "32808424-a985-4d95-9900-fd909afa9e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:01:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d09d33ad-e1f9-45e1-8c97-360bc9391a50 req-14c1ea50-7f01-4229-b3d6-9b5d42d4a10a service nova] Releasing lock "refresh_cache-13201da3-4908-4724-9759-100190ed16d3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:01:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:47 user nova-compute[72782]: DEBUG nova.compute.manager [req-d5102414-4ccd-4fdc-9ffc-4bf6dc59b543 req-a4714aad-b02c-4c26-b301-6d0d9daeb288 service nova] [instance: 13201da3-4908-4724-9759-100190ed16d3] Received event network-vif-plugged-32808424-a985-4d95-9900-fd909afa9e66 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:01:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d5102414-4ccd-4fdc-9ffc-4bf6dc59b543 req-a4714aad-b02c-4c26-b301-6d0d9daeb288 service nova] Acquiring lock "13201da3-4908-4724-9759-100190ed16d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d5102414-4ccd-4fdc-9ffc-4bf6dc59b543 req-a4714aad-b02c-4c26-b301-6d0d9daeb288 service nova] Lock "13201da3-4908-4724-9759-100190ed16d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d5102414-4ccd-4fdc-9ffc-4bf6dc59b543 req-a4714aad-b02c-4c26-b301-6d0d9daeb288 service nova] Lock "13201da3-4908-4724-9759-100190ed16d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:47 user nova-compute[72782]: DEBUG nova.compute.manager [req-d5102414-4ccd-4fdc-9ffc-4bf6dc59b543 req-a4714aad-b02c-4c26-b301-6d0d9daeb288 service nova] [instance: 13201da3-4908-4724-9759-100190ed16d3] No waiting events found dispatching network-vif-plugged-32808424-a985-4d95-9900-fd909afa9e66 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:01:47 user nova-compute[72782]: WARNING nova.compute.manager [req-d5102414-4ccd-4fdc-9ffc-4bf6dc59b543 req-a4714aad-b02c-4c26-b301-6d0d9daeb288 service nova] [instance: 13201da3-4908-4724-9759-100190ed16d3] Received unexpected event network-vif-plugged-32808424-a985-4d95-9900-fd909afa9e66 for instance with vm_state building and task_state spawning.
Aug 14 20:01:47 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043307.1786058, 13201da3-4908-4724-9759-100190ed16d3 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:01:47 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 13201da3-4908-4724-9759-100190ed16d3] VM Resumed (Lifecycle Event)
Aug 14 20:01:47 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:01:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:01:47 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 13201da3-4908-4724-9759-100190ed16d3] Instance spawned successfully.
Aug 14 20:01:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:01:47 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 13201da3-4908-4724-9759-100190ed16d3] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:01:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:01:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:01:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:01:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:01:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:01:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:01:47 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 13201da3-4908-4724-9759-100190ed16d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:01:47 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 13201da3-4908-4724-9759-100190ed16d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:01:47 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043307.1810741, 13201da3-4908-4724-9759-100190ed16d3 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:01:47 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 13201da3-4908-4724-9759-100190ed16d3] VM Started (Lifecycle Event)
Aug 14 20:01:47 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 13201da3-4908-4724-9759-100190ed16d3] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:01:47 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 13201da3-4908-4724-9759-100190ed16d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:01:47 user nova-compute[72782]: INFO nova.compute.manager [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Took 6.05 seconds to spawn the instance on the hypervisor.
Aug 14 20:01:47 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:01:47 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 13201da3-4908-4724-9759-100190ed16d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:01:47 user nova-compute[72782]: INFO nova.compute.manager [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Took 6.85 seconds to build instance.
Aug 14 20:01:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c1b6a0be-e906-4ceb-b682-355bb87402da tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "13201da3-4908-4724-9759-100190ed16d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.956s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "13201da3-4908-4724-9759-100190ed16d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.946s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:47 user nova-compute[72782]: INFO nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 13201da3-4908-4724-9759-100190ed16d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:01:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "13201da3-4908-4724-9759-100190ed16d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-f76a151d-cf9c-4a21-8ac9-7c958646105d req-d57ff914-878f-4aeb-9a38-b2af46346cd1 service nova] [instance: 13201da3-4908-4724-9759-100190ed16d3] Received event network-vif-plugged-32808424-a985-4d95-9900-fd909afa9e66 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:01:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f76a151d-cf9c-4a21-8ac9-7c958646105d req-d57ff914-878f-4aeb-9a38-b2af46346cd1 service nova] Acquiring lock "13201da3-4908-4724-9759-100190ed16d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f76a151d-cf9c-4a21-8ac9-7c958646105d req-d57ff914-878f-4aeb-9a38-b2af46346cd1 service nova] Lock "13201da3-4908-4724-9759-100190ed16d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f76a151d-cf9c-4a21-8ac9-7c958646105d req-d57ff914-878f-4aeb-9a38-b2af46346cd1 service nova] Lock "13201da3-4908-4724-9759-100190ed16d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-f76a151d-cf9c-4a21-8ac9-7c958646105d req-d57ff914-878f-4aeb-9a38-b2af46346cd1 service nova] [instance: 13201da3-4908-4724-9759-100190ed16d3] No waiting events found dispatching network-vif-plugged-32808424-a985-4d95-9900-fd909afa9e66 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:01:49 user nova-compute[72782]: WARNING nova.compute.manager [req-f76a151d-cf9c-4a21-8ac9-7c958646105d req-d57ff914-878f-4aeb-9a38-b2af46346cd1 service nova] [instance: 13201da3-4908-4724-9759-100190ed16d3] Received unexpected event network-vif-plugged-32808424-a985-4d95-9900-fd909afa9e66 for instance with vm_state active and task_state None.
Aug 14 20:01:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:56 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:01:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:01:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:01:59 user nova-compute[72782]: INFO nova.compute.claims [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Claim successful on node user
Aug 14 20:01:59 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG nova.network.neutron [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:01:59 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:01:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG nova.policy [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b05d2dbed8be48fb811a0acf350d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074449bc387c4ae4b0c8325a98a42b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:01:59 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Creating image(s)
Aug 14 20:01:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "/opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "/opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "/opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.199s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:01:59 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:02:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.208s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:02:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:02:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk 1073741824" returned: 0 in 0.055s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:02:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:02:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:02:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.195s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:02:00 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 20:02:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:02:00 user nova-compute[72782]: DEBUG nova.network.neutron [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Successfully created port: a848fa88-7bfb-4843-96e8-ce6cc78e1860 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:02:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:02:00 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Cannot resize image /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 20:02:00 user nova-compute[72782]: DEBUG nova.objects.instance [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lazy-loading 'migration_context' on Instance uuid 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:02:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:02:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Ensure instance console log exists: /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:02:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:02:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:02:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:02:01 user nova-compute[72782]: DEBUG nova.network.neutron [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Successfully updated port: a848fa88-7bfb-4843-96e8-ce6cc78e1860 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:02:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "refresh_cache-804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:02:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquired lock "refresh_cache-804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:02:01 user nova-compute[72782]: DEBUG nova.network.neutron [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:02:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-bbc3f912-1d85-4161-91e7-13c3cdbe7243 req-f4ee5baf-7561-46fa-97cc-f23c4cea5cbe service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Received event network-changed-a848fa88-7bfb-4843-96e8-ce6cc78e1860 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:02:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-bbc3f912-1d85-4161-91e7-13c3cdbe7243 req-f4ee5baf-7561-46fa-97cc-f23c4cea5cbe service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Refreshing instance network info cache due to event network-changed-a848fa88-7bfb-4843-96e8-ce6cc78e1860. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:02:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bbc3f912-1d85-4161-91e7-13c3cdbe7243 req-f4ee5baf-7561-46fa-97cc-f23c4cea5cbe service nova] Acquiring lock "refresh_cache-804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:02:01 user nova-compute[72782]: DEBUG nova.network.neutron [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.network.neutron [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Updating instance_info_cache with network_info: [{"id": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "address": "fa:16:3e:f9:25:49", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa848fa88-7b", "ovs_interfaceid": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Releasing lock "refresh_cache-804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Instance network_info: |[{"id": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "address": "fa:16:3e:f9:25:49", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa848fa88-7b", "ovs_interfaceid": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bbc3f912-1d85-4161-91e7-13c3cdbe7243 req-f4ee5baf-7561-46fa-97cc-f23c4cea5cbe service nova] Acquired lock "refresh_cache-804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.network.neutron [req-bbc3f912-1d85-4161-91e7-13c3cdbe7243 req-f4ee5baf-7561-46fa-97cc-f23c4cea5cbe service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Refreshing network info cache for port a848fa88-7bfb-4843-96e8-ce6cc78e1860 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Start _get_guest_xml network_info=[{"id": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "address": "fa:16:3e:f9:25:49", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa848fa88-7b", "ovs_interfaceid": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:02:02 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:02:02 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:01:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1231138306',display_name='tempest-VolumesSnapshotTestJSON-instance-1231138306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1231138306',id=33,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+ycju7zM4eP0TmqFP2EILP6pJdfxol4rF/0fJ/GnXgtqWv4kmGMGAYbTEVcGy6CJBDZGyH5kH1JGqV8DGBApIXM826lNxZ4cl9YvfTCEsJ857OrlruUE96Gr7lywNtFg==',key_name='tempest-keypair-12251453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='074449bc387c4ae4b0c8325a98a42b85',ramdisk_id='',reservation_id='r-568wtr29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-738905962',owner_user_name='tempest-VolumesSnapshotTestJSON-738905962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:02:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b05d2dbed8be48fb811a0acf350d9765',uuid=804a6fb5-18ae-4ec7-a4e8-97c7df869e8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "address": "fa:16:3e:f9:25:49", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa848fa88-7b", "ovs_interfaceid": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Converting VIF {"id": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "address": "fa:16:3e:f9:25:49", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa848fa88-7b", "ovs_interfaceid": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:25:49,bridge_name='br-int',has_traffic_filtering=True,id=a848fa88-7bfb-4843-96e8-ce6cc78e1860,network=Network(2aca477c-9ad7-4708-8466-7934911f13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa848fa88-7b') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.objects.instance [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lazy-loading 'pci_devices' on Instance uuid 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:02:02 user nova-compute[72782]:   <uuid>804a6fb5-18ae-4ec7-a4e8-97c7df869e8a</uuid>
Aug 14 20:02:02 user nova-compute[72782]:   <name>instance-00000021</name>
Aug 14 20:02:02 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:02:02 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:02:02 user nova-compute[72782]:   <metadata>
Aug 14 20:02:02 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:02:02 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:02:02 user nova-compute[72782]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1231138306</nova:name>
Aug 14 20:02:02 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:02:02</nova:creationTime>
Aug 14 20:02:02 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:02:02 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:02:02 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:02:02 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:02:02 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:02:02 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:02:02 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:02:02 user nova-compute[72782]:       <nova:owner>
Aug 14 20:02:02 user nova-compute[72782]:         <nova:user uuid="b05d2dbed8be48fb811a0acf350d9765">tempest-VolumesSnapshotTestJSON-738905962-project-member</nova:user>
Aug 14 20:02:02 user nova-compute[72782]:         <nova:project uuid="074449bc387c4ae4b0c8325a98a42b85">tempest-VolumesSnapshotTestJSON-738905962</nova:project>
Aug 14 20:02:02 user nova-compute[72782]:       </nova:owner>
Aug 14 20:02:02 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 20:02:02 user nova-compute[72782]:       <nova:ports>
Aug 14 20:02:02 user nova-compute[72782]:         <nova:port uuid="a848fa88-7bfb-4843-96e8-ce6cc78e1860">
Aug 14 20:02:02 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 20:02:02 user nova-compute[72782]:         </nova:port>
Aug 14 20:02:02 user nova-compute[72782]:       </nova:ports>
Aug 14 20:02:02 user nova-compute[72782]:     </nova:instance>
Aug 14 20:02:02 user nova-compute[72782]:   </metadata>
Aug 14 20:02:02 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:02:02 user nova-compute[72782]:     <system>
Aug 14 20:02:02 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:02:02 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:02:02 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:02:02 user nova-compute[72782]:       <entry name="serial">804a6fb5-18ae-4ec7-a4e8-97c7df869e8a</entry>
Aug 14 20:02:02 user nova-compute[72782]:       <entry name="uuid">804a6fb5-18ae-4ec7-a4e8-97c7df869e8a</entry>
Aug 14 20:02:02 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:02:02 user nova-compute[72782]:     </system>
Aug 14 20:02:02 user nova-compute[72782]:   </sysinfo>
Aug 14 20:02:02 user nova-compute[72782]:   <os>
Aug 14 20:02:02 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:02:02 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:02:02 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:02:02 user nova-compute[72782]:   </os>
Aug 14 20:02:02 user nova-compute[72782]:   <features>
Aug 14 20:02:02 user nova-compute[72782]:     <acpi/>
Aug 14 20:02:02 user nova-compute[72782]:     <apic/>
Aug 14 20:02:02 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:02:02 user nova-compute[72782]:   </features>
Aug 14 20:02:02 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:02:02 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:02:02 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:02:02 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:02:02 user nova-compute[72782]:   </clock>
Aug 14 20:02:02 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:02:02 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:02:02 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:02:02 user nova-compute[72782]:   </cpu>
Aug 14 20:02:02 user nova-compute[72782]:   <devices>
Aug 14 20:02:02 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:02:02 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:02:02 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk"/>
Aug 14 20:02:02 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:02:02 user nova-compute[72782]:     </disk>
Aug 14 20:02:02 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:02:02 user nova-compute[72782]:       <mac address="fa:16:3e:f9:25:49"/>
Aug 14 20:02:02 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:02:02 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:02:02 user nova-compute[72782]:       <target dev="tapa848fa88-7b"/>
Aug 14 20:02:02 user nova-compute[72782]:     </interface>
Aug 14 20:02:02 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:02:02 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/console.log" append="off"/>
Aug 14 20:02:02 user nova-compute[72782]:     </serial>
Aug 14 20:02:02 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:02:02 user nova-compute[72782]:     <video>
Aug 14 20:02:02 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:02:02 user nova-compute[72782]:     </video>
Aug 14 20:02:02 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:02:02 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:02:02 user nova-compute[72782]:     </rng>
Aug 14 20:02:02 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:02:02 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:02:02 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:02:02 user nova-compute[72782]:     </memballoon>
Aug 14 20:02:02 user nova-compute[72782]:   </devices>
Aug 14 20:02:02 user nova-compute[72782]: </domain>
Aug 14 20:02:02 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:01:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1231138306',display_name='tempest-VolumesSnapshotTestJSON-instance-1231138306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1231138306',id=33,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+ycju7zM4eP0TmqFP2EILP6pJdfxol4rF/0fJ/GnXgtqWv4kmGMGAYbTEVcGy6CJBDZGyH5kH1JGqV8DGBApIXM826lNxZ4cl9YvfTCEsJ857OrlruUE96Gr7lywNtFg==',key_name='tempest-keypair-12251453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='074449bc387c4ae4b0c8325a98a42b85',ramdisk_id='',reservation_id='r-568wtr29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-738905962',owner_user_name='tempest-VolumesSnapshotTestJSON-738905962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:02:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b05d2dbed8be48fb811a0acf350d9765',uuid=804a6fb5-18ae-4ec7-a4e8-97c7df869e8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "address": "fa:16:3e:f9:25:49", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa848fa88-7b", "ovs_interfaceid": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Converting VIF {"id": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "address": "fa:16:3e:f9:25:49", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa848fa88-7b", "ovs_interfaceid": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:25:49,bridge_name='br-int',has_traffic_filtering=True,id=a848fa88-7bfb-4843-96e8-ce6cc78e1860,network=Network(2aca477c-9ad7-4708-8466-7934911f13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa848fa88-7b') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG os_vif [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:25:49,bridge_name='br-int',has_traffic_filtering=True,id=a848fa88-7bfb-4843-96e8-ce6cc78e1860,network=Network(2aca477c-9ad7-4708-8466-7934911f13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa848fa88-7b') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa848fa88-7b, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa848fa88-7b, col_values=(('external_ids', {'iface-id': 'a848fa88-7bfb-4843-96e8-ce6cc78e1860', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:25:49', 'vm-uuid': '804a6fb5-18ae-4ec7-a4e8-97c7df869e8a'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:02 user nova-compute[72782]: INFO os_vif [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:25:49,bridge_name='br-int',has_traffic_filtering=True,id=a848fa88-7bfb-4843-96e8-ce6cc78e1860,network=Network(2aca477c-9ad7-4708-8466-7934911f13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa848fa88-7b')
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] No VIF found with MAC fa:16:3e:f9:25:49, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.network.neutron [req-bbc3f912-1d85-4161-91e7-13c3cdbe7243 req-f4ee5baf-7561-46fa-97cc-f23c4cea5cbe service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Updated VIF entry in instance network info cache for port a848fa88-7bfb-4843-96e8-ce6cc78e1860. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG nova.network.neutron [req-bbc3f912-1d85-4161-91e7-13c3cdbe7243 req-f4ee5baf-7561-46fa-97cc-f23c4cea5cbe service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Updating instance_info_cache with network_info: [{"id": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "address": "fa:16:3e:f9:25:49", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa848fa88-7b", "ovs_interfaceid": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bbc3f912-1d85-4161-91e7-13c3cdbe7243 req-f4ee5baf-7561-46fa-97cc-f23c4cea5cbe service nova] Releasing lock "refresh_cache-804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:02:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Skipping network cache update for instance because it is Building. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 259c51df-ccd6-456e-85f4-7aaf4cba2b69 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Updating instance_info_cache with network_info: [{"id": "35b9955c-a82a-42b9-a936-5f3429cda375", "address": "fa:16:3e:36:7a:36", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b9955c-a8", "ovs_interfaceid": "35b9955c-a82a-42b9-a936-5f3429cda375", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-259c51df-ccd6-456e-85f4-7aaf4cba2b69" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-68e436ed-af20-4e21-89e4-57b10f7c7619 req-0f0c7ac8-782a-45bd-8359-10995122e9d3 service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Received event network-vif-plugged-a848fa88-7bfb-4843-96e8-ce6cc78e1860 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-68e436ed-af20-4e21-89e4-57b10f7c7619 req-0f0c7ac8-782a-45bd-8359-10995122e9d3 service nova] Acquiring lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-68e436ed-af20-4e21-89e4-57b10f7c7619 req-0f0c7ac8-782a-45bd-8359-10995122e9d3 service nova] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-68e436ed-af20-4e21-89e4-57b10f7c7619 req-0f0c7ac8-782a-45bd-8359-10995122e9d3 service nova] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:02:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-68e436ed-af20-4e21-89e4-57b10f7c7619 req-0f0c7ac8-782a-45bd-8359-10995122e9d3 service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] No waiting events found dispatching network-vif-plugged-a848fa88-7bfb-4843-96e8-ce6cc78e1860 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:02:03 user nova-compute[72782]: WARNING nova.compute.manager [req-68e436ed-af20-4e21-89e4-57b10f7c7619 req-0f0c7ac8-782a-45bd-8359-10995122e9d3 service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Received unexpected event network-vif-plugged-a848fa88-7bfb-4843-96e8-ce6cc78e1860 for instance with vm_state building and task_state spawning.
Aug 14 20:02:04 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:02:04 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:02:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:02:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:02:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:02:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:02:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:05 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043325.8084953, 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:02:05 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] VM Resumed (Lifecycle Event)
Aug 14 20:02:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:02:05 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Instance spawned successfully.
Aug 14 20:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:02:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:02:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:02:05 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:02:05 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043325.8102796, 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:02:05 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] VM Started (Lifecycle Event)
Aug 14 20:02:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-1d023fab-d56e-45a5-ba18-a3f2038dbbb5 req-37d9ec67-f81e-449f-a654-a206d996c9f6 service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Received event network-vif-plugged-a848fa88-7bfb-4843-96e8-ce6cc78e1860 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:02:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1d023fab-d56e-45a5-ba18-a3f2038dbbb5 req-37d9ec67-f81e-449f-a654-a206d996c9f6 service nova] Acquiring lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:02:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1d023fab-d56e-45a5-ba18-a3f2038dbbb5 req-37d9ec67-f81e-449f-a654-a206d996c9f6 service nova] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:02:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1d023fab-d56e-45a5-ba18-a3f2038dbbb5 req-37d9ec67-f81e-449f-a654-a206d996c9f6 service nova] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:02:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-1d023fab-d56e-45a5-ba18-a3f2038dbbb5 req-37d9ec67-f81e-449f-a654-a206d996c9f6 service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] No waiting events found dispatching network-vif-plugged-a848fa88-7bfb-4843-96e8-ce6cc78e1860 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:02:05 user nova-compute[72782]: WARNING nova.compute.manager [req-1d023fab-d56e-45a5-ba18-a3f2038dbbb5 req-37d9ec67-f81e-449f-a654-a206d996c9f6 service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Received unexpected event network-vif-plugged-a848fa88-7bfb-4843-96e8-ce6cc78e1860 for instance with vm_state building and task_state spawning.
Aug 14 20:02:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:02:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:02:05 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:02:06 user nova-compute[72782]: INFO nova.compute.manager [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Took 6.26 seconds to spawn the instance on the hypervisor.
Aug 14 20:02:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:02:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:02:06 user nova-compute[72782]: INFO nova.compute.manager [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Took 6.97 seconds to build instance.
Aug 14 20:02:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-457520dc-0473-45f9-b684-923a1a10e73b tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.070s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:02:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:02:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:02:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:02:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:02:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:02:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:02:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:02:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:02:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:02:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:02:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:02:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:02:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:02:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:02:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:02:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:02:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:02:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:02:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:02:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:02:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:02:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:02:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:02:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:02:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:02:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:02:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:02:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:02:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:02:09 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:02:09 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:02:09 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7769MB free_disk=25.403240203857422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:02:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:02:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:02:09 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Applying migration context for instance ca7d1bf8-168b-4484-a965-72ff0aea93ef as it has an incoming, in-progress migration d7f7dd24-98c3-418a-aba1-2f5d06a07431. Migration status is finished {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 20:02:09 user nova-compute[72782]: INFO nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Updating resource usage from migration d7f7dd24-98c3-418a-aba1-2f5d06a07431
Aug 14 20:02:09 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:02:09 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:02:09 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ad4011a9-ab9f-4647-b677-a1c6337d2c2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:02:09 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:02:09 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2c924d52-aa8a-47ed-857c-b863efe95258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:02:09 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Migration d7f7dd24-98c3-418a-aba1-2f5d06a07431 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 20:02:09 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ca7d1bf8-168b-4484-a965-72ff0aea93ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:02:09 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 13201da3-4908-4724-9759-100190ed16d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:02:09 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:02:09 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:02:09 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:02:09 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:02:09 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:02:09 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:02:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:02:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:02:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:02:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:02:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:02:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:02:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:02:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:02:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-57b858b1-a36d-4483-ba1d-61d1caf0d3fa tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:02:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-57b858b1-a36d-4483-ba1d-61d1caf0d3fa tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:02:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-57b858b1-a36d-4483-ba1d-61d1caf0d3fa tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Going to confirm migration 2 {{(pid=72782) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 14 20:02:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-57b858b1-a36d-4483-ba1d-61d1caf0d3fa tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "refresh_cache-ca7d1bf8-168b-4484-a965-72ff0aea93ef" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:02:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-57b858b1-a36d-4483-ba1d-61d1caf0d3fa tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquired lock "refresh_cache-ca7d1bf8-168b-4484-a965-72ff0aea93ef" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:02:49 user nova-compute[72782]: DEBUG nova.network.neutron [None req-57b858b1-a36d-4483-ba1d-61d1caf0d3fa tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:02:49 user nova-compute[72782]: DEBUG nova.objects.instance [None req-57b858b1-a36d-4483-ba1d-61d1caf0d3fa tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'info_cache' on Instance uuid ca7d1bf8-168b-4484-a965-72ff0aea93ef {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:02:49 user nova-compute[72782]: DEBUG nova.network.neutron [None req-57b858b1-a36d-4483-ba1d-61d1caf0d3fa tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Updating instance_info_cache with network_info: [{"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:02:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-57b858b1-a36d-4483-ba1d-61d1caf0d3fa tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Releasing lock "refresh_cache-ca7d1bf8-168b-4484-a965-72ff0aea93ef" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:02:49 user nova-compute[72782]: DEBUG nova.objects.instance [None req-57b858b1-a36d-4483-ba1d-61d1caf0d3fa tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'migration_context' on Instance uuid ca7d1bf8-168b-4484-a965-72ff0aea93ef {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:02:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-57b858b1-a36d-4483-ba1d-61d1caf0d3fa tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:02:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-57b858b1-a36d-4483-ba1d-61d1caf0d3fa tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:02:49 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-57b858b1-a36d-4483-ba1d-61d1caf0d3fa tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:02:49 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-57b858b1-a36d-4483-ba1d-61d1caf0d3fa tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:02:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-57b858b1-a36d-4483-ba1d-61d1caf0d3fa tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.381s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:02:50 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-57b858b1-a36d-4483-ba1d-61d1caf0d3fa tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Deleted allocation for migration d7f7dd24-98c3-418a-aba1-2f5d06a07431
Aug 14 20:02:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-57b858b1-a36d-4483-ba1d-61d1caf0d3fa tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.631s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:02:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:02:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:02:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:02:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:03:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:03:04 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:03:04 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:03:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-3c2df162-332c-4391-95b8-223e07546d74" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:03:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-3c2df162-332c-4391-95b8-223e07546d74" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:03:04 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:03:04 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Updating instance_info_cache with network_info: [{"id": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "address": "fa:16:3e:fe:b9:74", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb361406-de", "ovs_interfaceid": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:03:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-3c2df162-332c-4391-95b8-223e07546d74" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:03:04 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:03:04 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:03:05 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:03:05 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:03:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:03:05 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:03:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:03:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:03:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:03:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:03:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:03:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:03:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:08 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:03:08 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:03:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7830MB free_disk=25.363265991210938GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:03:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:03:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:03:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:03:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:03:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ad4011a9-ab9f-4647-b677-a1c6337d2c2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:03:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:03:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2c924d52-aa8a-47ed-857c-b863efe95258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:03:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ca7d1bf8-168b-4484-a965-72ff0aea93ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:03:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 13201da3-4908-4724-9759-100190ed16d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:03:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:03:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:03:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:03:08 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:03:08 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:03:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:03:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:03:09 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:03:09 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:03:09 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:03:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:03:16 user nova-compute[72782]: INFO nova.compute.manager [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Rescuing
Aug 14 20:03:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:03:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquired lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:03:16 user nova-compute[72782]: DEBUG nova.network.neutron [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:03:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:03:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:03:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:03:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:03:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:17 user nova-compute[72782]: DEBUG nova.network.neutron [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Updating instance_info_cache with network_info: [{"id": "325817ed-4de8-4d31-afb7-d338d9391c55", "address": "fa:16:3e:83:cb:20", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325817ed-4d", "ovs_interfaceid": "325817ed-4de8-4d31-afb7-d338d9391c55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:03:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Releasing lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:03:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:17 user nova-compute[72782]: DEBUG nova.compute.manager [req-428fd735-e12a-4c1c-a7d3-304c0b25ed01 req-e8088cf3-48c3-451d-bc7d-bc3f3212310d service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-vif-unplugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:03:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-428fd735-e12a-4c1c-a7d3-304c0b25ed01 req-e8088cf3-48c3-451d-bc7d-bc3f3212310d service nova] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:03:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-428fd735-e12a-4c1c-a7d3-304c0b25ed01 req-e8088cf3-48c3-451d-bc7d-bc3f3212310d service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:03:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-428fd735-e12a-4c1c-a7d3-304c0b25ed01 req-e8088cf3-48c3-451d-bc7d-bc3f3212310d service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:03:17 user nova-compute[72782]: DEBUG nova.compute.manager [req-428fd735-e12a-4c1c-a7d3-304c0b25ed01 req-e8088cf3-48c3-451d-bc7d-bc3f3212310d service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] No waiting events found dispatching network-vif-unplugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:03:17 user nova-compute[72782]: WARNING nova.compute.manager [req-428fd735-e12a-4c1c-a7d3-304c0b25ed01 req-e8088cf3-48c3-451d-bc7d-bc3f3212310d service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received unexpected event network-vif-unplugged-325817ed-4de8-4d31-afb7-d338d9391c55 for instance with vm_state active and task_state rescuing.
Aug 14 20:03:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:18 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Instance destroyed successfully.
Aug 14 20:03:18 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Attempting rescue
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72782) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Instance directory exists: not creating {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 20:03:18 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Creating image(s)
Aug 14 20:03:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "/opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "/opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.objects.instance [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.169s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk.rescue {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk.rescue" returned: 0 in 0.054s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.objects.instance [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'migration_context' on Instance uuid 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Start _get_guest_xml network_info=[{"id": "325817ed-4de8-4d31-afb7-d338d9391c55", "address": "fa:16:3e:83:cb:20", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "vif_mac": "fa:16:3e:83:cb:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325817ed-4d", "ovs_interfaceid": "325817ed-4de8-4d31-afb7-d338d9391c55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.objects.instance [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'resources' on Instance uuid 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.objects.instance [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'numa_topology' on Instance uuid 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:03:18 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:03:18 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.objects.instance [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:58:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-352284208',display_name='tempest-ServerRescueNegativeTestJSON-server-352284208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-352284208',id=29,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:58:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14952037d1dc44e7b64d0663c7a033c8',ramdisk_id='',reservation_id='r-j9s00kwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1321611883',owner_user_name='tempest-ServerRescueNegativeTestJSON-1321611883-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:58:40Z,user_data=None,user_id='d2d39528bc994a25b9e6fea9f6b8b34c',uuid=0fa5392c-ea30-4007-bcdc-2802a46ed7a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "325817ed-4de8-4d31-afb7-d338d9391c55", "address": "fa:16:3e:83:cb:20", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "vif_mac": "fa:16:3e:83:cb:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325817ed-4d", "ovs_interfaceid": "325817ed-4de8-4d31-afb7-d338d9391c55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converting VIF {"id": "325817ed-4de8-4d31-afb7-d338d9391c55", "address": "fa:16:3e:83:cb:20", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "vif_mac": "fa:16:3e:83:cb:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325817ed-4d", "ovs_interfaceid": "325817ed-4de8-4d31-afb7-d338d9391c55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:cb:20,bridge_name='br-int',has_traffic_filtering=True,id=325817ed-4de8-4d31-afb7-d338d9391c55,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325817ed-4d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.objects.instance [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:03:18 user nova-compute[72782]:   <uuid>0fa5392c-ea30-4007-bcdc-2802a46ed7a2</uuid>
Aug 14 20:03:18 user nova-compute[72782]:   <name>instance-0000001d</name>
Aug 14 20:03:18 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:03:18 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:03:18 user nova-compute[72782]:   <metadata>
Aug 14 20:03:18 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:03:18 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:03:18 user nova-compute[72782]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-352284208</nova:name>
Aug 14 20:03:18 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:03:18</nova:creationTime>
Aug 14 20:03:18 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:03:18 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:03:18 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:03:18 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:03:18 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:03:18 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:03:18 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:03:18 user nova-compute[72782]:       <nova:owner>
Aug 14 20:03:18 user nova-compute[72782]:         <nova:user uuid="d2d39528bc994a25b9e6fea9f6b8b34c">tempest-ServerRescueNegativeTestJSON-1321611883-project-member</nova:user>
Aug 14 20:03:18 user nova-compute[72782]:         <nova:project uuid="14952037d1dc44e7b64d0663c7a033c8">tempest-ServerRescueNegativeTestJSON-1321611883</nova:project>
Aug 14 20:03:18 user nova-compute[72782]:       </nova:owner>
Aug 14 20:03:18 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 20:03:18 user nova-compute[72782]:       <nova:ports>
Aug 14 20:03:18 user nova-compute[72782]:         <nova:port uuid="325817ed-4de8-4d31-afb7-d338d9391c55">
Aug 14 20:03:18 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 20:03:18 user nova-compute[72782]:         </nova:port>
Aug 14 20:03:18 user nova-compute[72782]:       </nova:ports>
Aug 14 20:03:18 user nova-compute[72782]:     </nova:instance>
Aug 14 20:03:18 user nova-compute[72782]:   </metadata>
Aug 14 20:03:18 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:03:18 user nova-compute[72782]:     <system>
Aug 14 20:03:18 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:03:18 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:03:18 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:03:18 user nova-compute[72782]:       <entry name="serial">0fa5392c-ea30-4007-bcdc-2802a46ed7a2</entry>
Aug 14 20:03:18 user nova-compute[72782]:       <entry name="uuid">0fa5392c-ea30-4007-bcdc-2802a46ed7a2</entry>
Aug 14 20:03:18 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:03:18 user nova-compute[72782]:     </system>
Aug 14 20:03:18 user nova-compute[72782]:   </sysinfo>
Aug 14 20:03:18 user nova-compute[72782]:   <os>
Aug 14 20:03:18 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:03:18 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:03:18 user nova-compute[72782]:   </os>
Aug 14 20:03:18 user nova-compute[72782]:   <features>
Aug 14 20:03:18 user nova-compute[72782]:     <acpi/>
Aug 14 20:03:18 user nova-compute[72782]:     <apic/>
Aug 14 20:03:18 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:03:18 user nova-compute[72782]:   </features>
Aug 14 20:03:18 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:03:18 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:03:18 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:03:18 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:03:18 user nova-compute[72782]:   </clock>
Aug 14 20:03:18 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:03:18 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:03:18 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:03:18 user nova-compute[72782]:   </cpu>
Aug 14 20:03:18 user nova-compute[72782]:   <devices>
Aug 14 20:03:18 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:03:18 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:03:18 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk.rescue"/>
Aug 14 20:03:18 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:03:18 user nova-compute[72782]:     </disk>
Aug 14 20:03:18 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:03:18 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:03:18 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk"/>
Aug 14 20:03:18 user nova-compute[72782]:       <target dev="vdb" bus="virtio"/>
Aug 14 20:03:18 user nova-compute[72782]:     </disk>
Aug 14 20:03:18 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:03:18 user nova-compute[72782]:       <mac address="fa:16:3e:83:cb:20"/>
Aug 14 20:03:18 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:03:18 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:03:18 user nova-compute[72782]:       <target dev="tap325817ed-4d"/>
Aug 14 20:03:18 user nova-compute[72782]:     </interface>
Aug 14 20:03:18 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:03:18 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/console.log" append="off"/>
Aug 14 20:03:18 user nova-compute[72782]:     </serial>
Aug 14 20:03:18 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:03:18 user nova-compute[72782]:     <video>
Aug 14 20:03:18 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:03:18 user nova-compute[72782]:     </video>
Aug 14 20:03:18 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:03:18 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:03:18 user nova-compute[72782]:     </rng>
Aug 14 20:03:18 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:03:18 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:03:18 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:03:18 user nova-compute[72782]:     </memballoon>
Aug 14 20:03:18 user nova-compute[72782]:   </devices>
Aug 14 20:03:18 user nova-compute[72782]: </domain>
Aug 14 20:03:18 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:03:18 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Instance destroyed successfully.
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:03:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] No VIF found with MAC fa:16:3e:83:cb:20, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:03:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-eecc9c24-5f3e-44a8-90b5-79aed16bbb3d req-19336dea-c201-4fb1-9dac-a096c18ab889 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:03:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eecc9c24-5f3e-44a8-90b5-79aed16bbb3d req-19336dea-c201-4fb1-9dac-a096c18ab889 service nova] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:03:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eecc9c24-5f3e-44a8-90b5-79aed16bbb3d req-19336dea-c201-4fb1-9dac-a096c18ab889 service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:03:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eecc9c24-5f3e-44a8-90b5-79aed16bbb3d req-19336dea-c201-4fb1-9dac-a096c18ab889 service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:03:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-eecc9c24-5f3e-44a8-90b5-79aed16bbb3d req-19336dea-c201-4fb1-9dac-a096c18ab889 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] No waiting events found dispatching network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:03:19 user nova-compute[72782]: WARNING nova.compute.manager [req-eecc9c24-5f3e-44a8-90b5-79aed16bbb3d req-19336dea-c201-4fb1-9dac-a096c18ab889 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received unexpected event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 for instance with vm_state active and task_state rescuing.
Aug 14 20:03:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-09909eb7-3a4a-4d6b-aa4a-5ba250625b75 req-624fb98c-ac4e-42b7-88de-31b3bdd1f047 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:03:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-09909eb7-3a4a-4d6b-aa4a-5ba250625b75 req-624fb98c-ac4e-42b7-88de-31b3bdd1f047 service nova] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:03:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-09909eb7-3a4a-4d6b-aa4a-5ba250625b75 req-624fb98c-ac4e-42b7-88de-31b3bdd1f047 service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:03:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-09909eb7-3a4a-4d6b-aa4a-5ba250625b75 req-624fb98c-ac4e-42b7-88de-31b3bdd1f047 service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:03:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-09909eb7-3a4a-4d6b-aa4a-5ba250625b75 req-624fb98c-ac4e-42b7-88de-31b3bdd1f047 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] No waiting events found dispatching network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:03:21 user nova-compute[72782]: WARNING nova.compute.manager [req-09909eb7-3a4a-4d6b-aa4a-5ba250625b75 req-624fb98c-ac4e-42b7-88de-31b3bdd1f047 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received unexpected event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 for instance with vm_state active and task_state rescuing.
Aug 14 20:03:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-09909eb7-3a4a-4d6b-aa4a-5ba250625b75 req-624fb98c-ac4e-42b7-88de-31b3bdd1f047 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:03:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-09909eb7-3a4a-4d6b-aa4a-5ba250625b75 req-624fb98c-ac4e-42b7-88de-31b3bdd1f047 service nova] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:03:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-09909eb7-3a4a-4d6b-aa4a-5ba250625b75 req-624fb98c-ac4e-42b7-88de-31b3bdd1f047 service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:03:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-09909eb7-3a4a-4d6b-aa4a-5ba250625b75 req-624fb98c-ac4e-42b7-88de-31b3bdd1f047 service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:03:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-09909eb7-3a4a-4d6b-aa4a-5ba250625b75 req-624fb98c-ac4e-42b7-88de-31b3bdd1f047 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] No waiting events found dispatching network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:03:21 user nova-compute[72782]: WARNING nova.compute.manager [req-09909eb7-3a4a-4d6b-aa4a-5ba250625b75 req-624fb98c-ac4e-42b7-88de-31b3bdd1f047 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received unexpected event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 for instance with vm_state active and task_state rescuing.
Aug 14 20:03:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Removed pending event for 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 due to event {{(pid=72782) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 20:03:22 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043402.365355, 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:03:22 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] VM Resumed (Lifecycle Event)
Aug 14 20:03:22 user nova-compute[72782]: DEBUG nova.compute.manager [None req-eadee4c7-9c90-4cde-a62a-5464d07a978a tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:03:22 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:03:22 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:03:22 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 20:03:22 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043402.36697, 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:03:22 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] VM Started (Lifecycle Event)
Aug 14 20:03:22 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:03:22 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:03:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:31 user nova-compute[72782]: DEBUG nova.compute.manager [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:03:31 user nova-compute[72782]: INFO nova.compute.manager [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] instance snapshotting
Aug 14 20:03:31 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Beginning live snapshot process
Aug 14 20:03:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json -f qcow2 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json -f qcow2 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.173s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmnmoi7yh/62f0364c2abd4f22adc11ae13ba57851.delta 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmnmoi7yh/62f0364c2abd4f22adc11ae13ba57851.delta 1073741824" returned: 0 in 0.047s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:31 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 20:03:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:03:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 20:03:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72782) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 20:03:33 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 20:03:33 user nova-compute[72782]: DEBUG nova.privsep.utils [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72782) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 20:03:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmnmoi7yh/62f0364c2abd4f22adc11ae13ba57851.delta /opt/stack/data/nova/instances/snapshots/tmpmnmoi7yh/62f0364c2abd4f22adc11ae13ba57851 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmnmoi7yh/62f0364c2abd4f22adc11ae13ba57851.delta /opt/stack/data/nova/instances/snapshots/tmpmnmoi7yh/62f0364c2abd4f22adc11ae13ba57851" returned: 0 in 0.433s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:33 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Snapshot extracted, beginning image upload
Aug 14 20:03:35 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Snapshot image upload complete
Aug 14 20:03:35 user nova-compute[72782]: INFO nova.compute.manager [None req-959886e0-5fe4-47d8-8f60-dbf2cf99d180 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Took 4.81 seconds to snapshot the instance on the hypervisor.
Aug 14 20:03:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:50 user nova-compute[72782]: DEBUG nova.compute.manager [req-f668ed43-594e-4ec5-bf7b-195080f678f9 req-30d7ffb6-1f39-46b0-bc87-5ca4f560184e service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Received event network-changed-a848fa88-7bfb-4843-96e8-ce6cc78e1860 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:03:50 user nova-compute[72782]: DEBUG nova.compute.manager [req-f668ed43-594e-4ec5-bf7b-195080f678f9 req-30d7ffb6-1f39-46b0-bc87-5ca4f560184e service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Refreshing instance network info cache due to event network-changed-a848fa88-7bfb-4843-96e8-ce6cc78e1860. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:03:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f668ed43-594e-4ec5-bf7b-195080f678f9 req-30d7ffb6-1f39-46b0-bc87-5ca4f560184e service nova] Acquiring lock "refresh_cache-804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:03:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f668ed43-594e-4ec5-bf7b-195080f678f9 req-30d7ffb6-1f39-46b0-bc87-5ca4f560184e service nova] Acquired lock "refresh_cache-804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:03:50 user nova-compute[72782]: DEBUG nova.network.neutron [req-f668ed43-594e-4ec5-bf7b-195080f678f9 req-30d7ffb6-1f39-46b0-bc87-5ca4f560184e service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Refreshing network info cache for port a848fa88-7bfb-4843-96e8-ce6cc78e1860 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:03:50 user nova-compute[72782]: DEBUG nova.network.neutron [req-f668ed43-594e-4ec5-bf7b-195080f678f9 req-30d7ffb6-1f39-46b0-bc87-5ca4f560184e service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Updated VIF entry in instance network info cache for port a848fa88-7bfb-4843-96e8-ce6cc78e1860. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:03:50 user nova-compute[72782]: DEBUG nova.network.neutron [req-f668ed43-594e-4ec5-bf7b-195080f678f9 req-30d7ffb6-1f39-46b0-bc87-5ca4f560184e service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Updating instance_info_cache with network_info: [{"id": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "address": "fa:16:3e:f9:25:49", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa848fa88-7b", "ovs_interfaceid": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:03:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f668ed43-594e-4ec5-bf7b-195080f678f9 req-30d7ffb6-1f39-46b0-bc87-5ca4f560184e service nova] Releasing lock "refresh_cache-804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lazy-loading 'flavor' on Instance uuid 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:03:51 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Ignoring supplied device name: /dev/vdb
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:03:51 user nova-compute[72782]: INFO nova.compute.manager [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Attaching volume 271f18c2-9e92-4e04-93c7-789e2650459b to /dev/vdb
Aug 14 20:03:51 user nova-compute[72782]: DEBUG os_brick.utils [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2e817d-0631-4775-9344-41a0e5e304d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[825d01b9-87a3-4045-ae72-afdf2b2d1c6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d4dea7-f3f4-415e-947c-8c79d5b03743]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f327823-1ad1-49f8-84f7-67ec1a7025ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:03:51 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:03:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c317c3-8840-4675-8ce5-85f648e1527b]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG os_brick.utils [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:03:51 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Updating existing volume attachment record: 3f368c88-7354-4268-bb5d-301429a41124 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:03:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:03:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:03:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgZwXRdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:04:00 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:04:00 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:04:00 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b359b130-0a41-41d5-a579-1dd9506e12f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:04:00 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[874b916d-1585-4daa-9a86-6652fa991fe5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b] added
Aug 14 20:04:00 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bbb382-a56c-403b-ab16-f1768885f281]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[efade0b2-2016-4541-9e96-b84e5785273e]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hgZwXRdQ {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hgZwXRdQ" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3368df0c-1c14-442a-9368-c537e9338162]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hgZwXRdQ'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05f4f47-57ba-40fe-9b55-818ef5b5e43a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[310040b6-cf46-4b7f-94d2-36e4986a35a1]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:04:00 user nova-compute[72782]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 20:04:00 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:04:00 user nova-compute[72782]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 20:04:00 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a44666-c1c8-434b-9aa8-2948dcf50f85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b, portal: 172.16.0.220,3260]
Aug 14 20:04:00 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b, portal: 172.16.0.220,3260] successful.
Aug 14 20:04:00 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a71f70d-f6c0-487e-b1f9-7abc9d82aa4f]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e382d2-f0e2-4ad6-884e-6ac30990eb7b]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:04:00 user nova-compute[72782]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 20:04:00 user nova-compute[72782]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b (non-flash)
Aug 14 20:04:00 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:04:00 user nova-compute[72782]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 20:04:00 user nova-compute[72782]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b (non-flash)
Aug 14 20:04:00 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf58b01-5d41-4e10-b0ad-75021f0ece0e]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:04:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgZwXRdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:04:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:04:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26134343263633563', 'path': '/dev/sdd'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:04:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134343263633563', 'path': '/dev/sdd'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:04:01 user nova-compute[72782]: DEBUG nova.objects.instance [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lazy-loading 'flavor' on Instance uuid 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:04:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 20:04:01 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:04:01 user nova-compute[72782]:   <source dev="/dev/sdd"/>
Aug 14 20:04:01 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:04:01 user nova-compute[72782]:   <serial>271f18c2-9e92-4e04-93c7-789e2650459b</serial>
Aug 14 20:04:01 user nova-compute[72782]: </disk>
Aug 14 20:04:01 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 20:04:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:04:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:04:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] No VIF found with MAC fa:16:3e:f9:25:49, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:04:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d46bb66f-bec0-4a51-b745-94d79afecb8e tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.639s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:04:04 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:04:04 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:04:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-ad4011a9-ab9f-4647-b677-a1c6337d2c2c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:04:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-ad4011a9-ab9f-4647-b677-a1c6337d2c2c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:04:04 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:04:04 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Updating instance_info_cache with network_info: [{"id": "2858462d-1715-4c67-aee3-a0c15eac235b", "address": "fa:16:3e:f1:85:57", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2858462d-17", "ovs_interfaceid": "2858462d-1715-4c67-aee3-a0c15eac235b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:04:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-ad4011a9-ab9f-4647-b677-a1c6337d2c2c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:04:04 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:04:04 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:04:05 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:04:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:04:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:04:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:04:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:04:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:04:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:04:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:04:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:08 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:04:08 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:04:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7919MB free_disk=25.312023162841797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:04:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:04:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:04:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:04:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:04:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ad4011a9-ab9f-4647-b677-a1c6337d2c2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:04:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:04:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2c924d52-aa8a-47ed-857c-b863efe95258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:04:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ca7d1bf8-168b-4484-a965-72ff0aea93ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:04:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 13201da3-4908-4724-9759-100190ed16d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:04:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:04:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:04:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:04:09 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:04:09 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:04:09 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:04:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:04:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:04:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:04:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:04:10 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:04:11 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:04:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:04:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:04:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:04:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:04:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:04:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "af6fee00-a067-4674-a356-f4f1c8d9f5db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:04:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:04:37 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:04:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:04:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:04:38 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:04:38 user nova-compute[72782]: INFO nova.compute.claims [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Claim successful on node user
Aug 14 20:04:38 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:04:38 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:04:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:04:38 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:04:38 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:04:38 user nova-compute[72782]: DEBUG nova.network.neutron [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:04:38 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:04:38 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:04:38 user nova-compute[72782]: INFO nova.virt.block_device [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Booting with volume-backed-image 450d2d82-4a73-4a35-bff3-71ddab4bfe0e at /dev/vda
Aug 14 20:04:38 user nova-compute[72782]: DEBUG nova.policy [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12fb8b10952b4c6b8dc6823610830241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9f312ba4414905a8d6eb44933e430e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:04:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:39 user nova-compute[72782]: DEBUG nova.network.neutron [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Successfully created port: bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:04:39 user nova-compute[72782]: INFO nova.compute.manager [None req-70ef7f1c-82a8-46df-b9b0-3d005de90592 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Get console output
Aug 14 20:04:39 user nova-compute[72782]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 14 20:04:40 user nova-compute[72782]: DEBUG nova.network.neutron [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Successfully updated port: bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:04:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "refresh_cache-af6fee00-a067-4674-a356-f4f1c8d9f5db" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:04:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquired lock "refresh_cache-af6fee00-a067-4674-a356-f4f1c8d9f5db" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:04:40 user nova-compute[72782]: DEBUG nova.network.neutron [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:04:40 user nova-compute[72782]: DEBUG nova.compute.manager [req-7d5f4e39-12e1-41b4-8a6a-ec87103fb34c req-b37687c8-d5f5-493c-afee-0fe8fb47d9a7 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received event network-changed-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:04:40 user nova-compute[72782]: DEBUG nova.compute.manager [req-7d5f4e39-12e1-41b4-8a6a-ec87103fb34c req-b37687c8-d5f5-493c-afee-0fe8fb47d9a7 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Refreshing instance network info cache due to event network-changed-bd96dc7a-44be-41db-9036-538ca592c701. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:04:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7d5f4e39-12e1-41b4-8a6a-ec87103fb34c req-b37687c8-d5f5-493c-afee-0fe8fb47d9a7 service nova] Acquiring lock "refresh_cache-af6fee00-a067-4674-a356-f4f1c8d9f5db" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:04:40 user nova-compute[72782]: DEBUG nova.network.neutron [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:04:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:04:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:04:40 user nova-compute[72782]: INFO nova.compute.manager [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Detaching volume 271f18c2-9e92-4e04-93c7-789e2650459b
Aug 14 20:04:40 user nova-compute[72782]: INFO nova.virt.block_device [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Attempting to driver detach volume 271f18c2-9e92-4e04-93c7-789e2650459b from mountpoint /dev/vdb
Aug 14 20:04:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Attempting to detach device vdb from instance 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 20:04:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:04:40 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:04:40 user nova-compute[72782]:   <source dev="/dev/sdd"/>
Aug 14 20:04:40 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:04:40 user nova-compute[72782]:   <serial>271f18c2-9e92-4e04-93c7-789e2650459b</serial>
Aug 14 20:04:40 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 20:04:40 user nova-compute[72782]: </disk>
Aug 14 20:04:40 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:04:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:04:40 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Successfully detached device vdb from instance 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a from the persistent domain config.
Aug 14 20:04:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 20:04:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:04:40 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:04:40 user nova-compute[72782]:   <source dev="/dev/sdd"/>
Aug 14 20:04:40 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:04:40 user nova-compute[72782]:   <serial>271f18c2-9e92-4e04-93c7-789e2650459b</serial>
Aug 14 20:04:40 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 20:04:40 user nova-compute[72782]: </disk>
Aug 14 20:04:40 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:04:40 user nova-compute[72782]: DEBUG nova.network.neutron [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Updating instance_info_cache with network_info: [{"id": "bd96dc7a-44be-41db-9036-538ca592c701", "address": "fa:16:3e:4a:23:dd", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd96dc7a-44", "ovs_interfaceid": "bd96dc7a-44be-41db-9036-538ca592c701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:04:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Releasing lock "refresh_cache-af6fee00-a067-4674-a356-f4f1c8d9f5db" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:04:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Instance network_info: |[{"id": "bd96dc7a-44be-41db-9036-538ca592c701", "address": "fa:16:3e:4a:23:dd", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd96dc7a-44", "ovs_interfaceid": "bd96dc7a-44be-41db-9036-538ca592c701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:04:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7d5f4e39-12e1-41b4-8a6a-ec87103fb34c req-b37687c8-d5f5-493c-afee-0fe8fb47d9a7 service nova] Acquired lock "refresh_cache-af6fee00-a067-4674-a356-f4f1c8d9f5db" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:04:40 user nova-compute[72782]: DEBUG nova.network.neutron [req-7d5f4e39-12e1-41b4-8a6a-ec87103fb34c req-b37687c8-d5f5-493c-afee-0fe8fb47d9a7 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Refreshing network info cache for port bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692043481.2239313, 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 20:04:41 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Successfully detached device vdb from instance 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a from the live domain config.
Aug 14 20:04:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgZwXRdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:04:41 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:04:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ff1167-bcf8-4318-82d5-a8b59e7f377f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[928cd3b3-3bcf-48ff-b839-c4696e966f0d]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:04:41 user nova-compute[72782]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 20:04:41 user nova-compute[72782]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b (non-flash)
Aug 14 20:04:41 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:04:41 user nova-compute[72782]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 20:04:41 user nova-compute[72782]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b (non-flash)
Aug 14 20:04:41 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e869a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b'): ({'sdd'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Removing single pathed devices sdd {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ff4ed5-febd-4b2b-a19a-03c58331f47b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[391571d1-13cf-4c8b-b571-ebf2c5e108ca]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Flushing IO for device /dev/sdd {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[915bf48e-a03a-41c9-9838-ce07c4bf2665]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG nova.network.neutron [req-7d5f4e39-12e1-41b4-8a6a-ec87103fb34c req-b37687c8-d5f5-493c-afee-0fe8fb47d9a7 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Updated VIF entry in instance network info cache for port bd96dc7a-44be-41db-9036-538ca592c701. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG nova.network.neutron [req-7d5f4e39-12e1-41b4-8a6a-ec87103fb34c req-b37687c8-d5f5-493c-afee-0fe8fb47d9a7 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Updating instance_info_cache with network_info: [{"id": "bd96dc7a-44be-41db-9036-538ca592c701", "address": "fa:16:3e:4a:23:dd", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd96dc7a-44", "ovs_interfaceid": "bd96dc7a-44be-41db-9036-538ca592c701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7d5f4e39-12e1-41b4-8a6a-ec87103fb34c req-b37687c8-d5f5-493c-afee-0fe8fb47d9a7 service nova] Releasing lock "refresh_cache-af6fee00-a067-4674-a356-f4f1c8d9f5db" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0155b2-f573-46f1-9ea5-7b474ba25741]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[50709cf6-b8ba-493c-bff7-e4054c6bc46b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf9fecb-c06f-40ab-adae-218d443bd003]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b, portal: 172.16.0.220,3260]
Aug 14 20:04:41 user nova-compute[72782]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b, portal: 172.16.0.220,3260] successful.
Aug 14 20:04:41 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4429e935-c826-4e95-ad85-db94fd5d7c37]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] <== disconnect_volume: return (311ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:04:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:04:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:46 user nova-compute[72782]: DEBUG nova.objects.instance [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lazy-loading 'flavor' on Instance uuid 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:04:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-674c8271-fd1c-406f-9127-fc77bcad8a00 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.989s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:04:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 5.882s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:04:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:04:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:04:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:04:46 user nova-compute[72782]: INFO nova.compute.manager [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Terminating instance
Aug 14 20:04:46 user nova-compute[72782]: DEBUG nova.compute.manager [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:04:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:46 user nova-compute[72782]: DEBUG nova.compute.manager [req-93638392-db44-44c9-aad6-f1ba310534f2 req-426ed500-3556-4769-9e76-4c9382b7254c service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Received event network-vif-unplugged-a848fa88-7bfb-4843-96e8-ce6cc78e1860 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:04:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-93638392-db44-44c9-aad6-f1ba310534f2 req-426ed500-3556-4769-9e76-4c9382b7254c service nova] Acquiring lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:04:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-93638392-db44-44c9-aad6-f1ba310534f2 req-426ed500-3556-4769-9e76-4c9382b7254c service nova] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:04:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-93638392-db44-44c9-aad6-f1ba310534f2 req-426ed500-3556-4769-9e76-4c9382b7254c service nova] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:04:46 user nova-compute[72782]: DEBUG nova.compute.manager [req-93638392-db44-44c9-aad6-f1ba310534f2 req-426ed500-3556-4769-9e76-4c9382b7254c service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] No waiting events found dispatching network-vif-unplugged-a848fa88-7bfb-4843-96e8-ce6cc78e1860 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:04:46 user nova-compute[72782]: DEBUG nova.compute.manager [req-93638392-db44-44c9-aad6-f1ba310534f2 req-426ed500-3556-4769-9e76-4c9382b7254c service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Received event network-vif-unplugged-a848fa88-7bfb-4843-96e8-ce6cc78e1860 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:47 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Instance destroyed successfully.
Aug 14 20:04:47 user nova-compute[72782]: DEBUG nova.objects.instance [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lazy-loading 'resources' on Instance uuid 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:01:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1231138306',display_name='tempest-VolumesSnapshotTestJSON-instance-1231138306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1231138306',id=33,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+ycju7zM4eP0TmqFP2EILP6pJdfxol4rF/0fJ/GnXgtqWv4kmGMGAYbTEVcGy6CJBDZGyH5kH1JGqV8DGBApIXM826lNxZ4cl9YvfTCEsJ857OrlruUE96Gr7lywNtFg==',key_name='tempest-keypair-12251453',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:02:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='074449bc387c4ae4b0c8325a98a42b85',ramdisk_id='',reservation_id='r-568wtr29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-738905962',owner_user_name='tempest-VolumesSnapshotTestJSON-738905962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:02:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b05d2dbed8be48fb811a0acf350d9765',uuid=804a6fb5-18ae-4ec7-a4e8-97c7df869e8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "address": "fa:16:3e:f9:25:49", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa848fa88-7b", "ovs_interfaceid": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Converting VIF {"id": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "address": "fa:16:3e:f9:25:49", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa848fa88-7b", "ovs_interfaceid": "a848fa88-7bfb-4843-96e8-ce6cc78e1860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:25:49,bridge_name='br-int',has_traffic_filtering=True,id=a848fa88-7bfb-4843-96e8-ce6cc78e1860,network=Network(2aca477c-9ad7-4708-8466-7934911f13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa848fa88-7b') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG os_vif [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:25:49,bridge_name='br-int',has_traffic_filtering=True,id=a848fa88-7bfb-4843-96e8-ce6cc78e1860,network=Network(2aca477c-9ad7-4708-8466-7934911f13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa848fa88-7b') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa848fa88-7b, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:47 user nova-compute[72782]: INFO os_vif [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:25:49,bridge_name='br-int',has_traffic_filtering=True,id=a848fa88-7bfb-4843-96e8-ce6cc78e1860,network=Network(2aca477c-9ad7-4708-8466-7934911f13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa848fa88-7b')
Aug 14 20:04:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgZwXRdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:04:47 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:04:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:271f18c2-9e92-4e04-93c7-789e2650459b', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be716a5-0f23-43e1-9115-1752677852e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e1a53a-b7f3-4ff7-8cf2-5e7659ee7e64]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:04:47 user nova-compute[72782]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 20:04:47 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:04:47 user nova-compute[72782]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 20:04:47 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e8461240>, {}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Disconnecting from: [] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] <== disconnect_volume: return (54ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:04:47 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Deleting instance files /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a_del
Aug 14 20:04:47 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Deletion of /opt/stack/data/nova/instances/804a6fb5-18ae-4ec7-a4e8-97c7df869e8a_del complete
Aug 14 20:04:47 user nova-compute[72782]: INFO nova.compute.manager [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 14 20:04:47 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:04:47 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:04:48 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:04:48 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Took 0.92 seconds to deallocate network for instance.
Aug 14 20:04:48 user nova-compute[72782]: WARNING nova.volume.cinder [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Attachment 3f368c88-7354-4268-bb5d-301429a41124 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3f368c88-7354-4268-bb5d-301429a41124. (HTTP 404) (Request-ID: req-814917b9-8071-49ff-99e6-5556498fd929)
Aug 14 20:04:48 user nova-compute[72782]: INFO nova.compute.manager [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Took 0.03 seconds to detach 1 volumes for instance.
Aug 14 20:04:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:04:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:04:48 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:04:48 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:04:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:04:48 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Deleted allocations for instance 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a
Aug 14 20:04:48 user nova-compute[72782]: DEBUG nova.compute.manager [req-81363d85-6230-4bbe-ab46-6511e84d9cd1 req-9a59af2d-b2bb-45c3-9da6-f3d087fa9c72 service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Received event network-vif-plugged-a848fa88-7bfb-4843-96e8-ce6cc78e1860 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:04:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-81363d85-6230-4bbe-ab46-6511e84d9cd1 req-9a59af2d-b2bb-45c3-9da6-f3d087fa9c72 service nova] Acquiring lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:04:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-81363d85-6230-4bbe-ab46-6511e84d9cd1 req-9a59af2d-b2bb-45c3-9da6-f3d087fa9c72 service nova] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:04:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-81363d85-6230-4bbe-ab46-6511e84d9cd1 req-9a59af2d-b2bb-45c3-9da6-f3d087fa9c72 service nova] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:04:48 user nova-compute[72782]: DEBUG nova.compute.manager [req-81363d85-6230-4bbe-ab46-6511e84d9cd1 req-9a59af2d-b2bb-45c3-9da6-f3d087fa9c72 service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] No waiting events found dispatching network-vif-plugged-a848fa88-7bfb-4843-96e8-ce6cc78e1860 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:04:48 user nova-compute[72782]: WARNING nova.compute.manager [req-81363d85-6230-4bbe-ab46-6511e84d9cd1 req-9a59af2d-b2bb-45c3-9da6-f3d087fa9c72 service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Received unexpected event network-vif-plugged-a848fa88-7bfb-4843-96e8-ce6cc78e1860 for instance with vm_state deleted and task_state None.
Aug 14 20:04:48 user nova-compute[72782]: DEBUG nova.compute.manager [req-81363d85-6230-4bbe-ab46-6511e84d9cd1 req-9a59af2d-b2bb-45c3-9da6-f3d087fa9c72 service nova] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Received event network-vif-deleted-a848fa88-7bfb-4843-96e8-ce6cc78e1860 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:04:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e64d55fc-1123-41e0-9628-10516057ab20 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "804a6fb5-18ae-4ec7-a4e8-97c7df869e8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.303s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG os_brick.utils [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17052af-1e0e-4f7f-93c6-620c9214aaa4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c890b5-8a08-4fb8-b65f-6b839a13fc65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5d69cf-65e6-4fd1-8988-ed6f2241ebab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce8494d-8383-4018-8904-c95e3e075583]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:04:49 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:04:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afe1eb4-4c6e-4a57-940a-a44880a4d2d1]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG os_brick.utils [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:04:49 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Updating existing volume attachment record: 26defa04-19e3-4d96-99aa-c840150b7791 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:04:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:04:57 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Creating image(s)
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Did not create local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Ensure instance console log exists: /opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Start _get_guest_xml network_info=[{"id": "bd96dc7a-44be-41db-9036-538ca592c701", "address": "fa:16:3e:4a:23:dd", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd96dc7a-44", "ovs_interfaceid": "bd96dc7a-44be-41db-9036-538ca592c701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '26defa04-19e3-4d96-99aa-c840150b7791', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyiolfKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af6fee00-a067-4674-a356-f4f1c8d9f5db', 'attached_at': '', 'detached_at': '', 'volume_id': '6b2cc395-413e-4cd9-966e-e7cbb9e605ea', 'serial': '6b2cc395-413e-4cd9-966e-e7cbb9e605ea'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:04:57 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:04:57 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyiolfKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:04:57 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:04:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:04:57 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:04:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:04:57 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:04:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a48ac0-d4af-4a02-8e4f-ecefd95ec4f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:04:57 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ec1ae6-f753-4c95-8ba1-abc3229b1111]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea] added
Aug 14 20:04:57 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90611c2-71b8-47e9-87e1-0dbc1b509120]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4dfc3b-e0ae-4ac7-8529-e8107b0459d3]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vyiolfKg {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vyiolfKg" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0c7827-c45c-4a14-ba5a-15961f5937ac]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vyiolfKg'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e25aab-fac9-4bba-93cc-e8c18fcb8144]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f9c43a-f3ed-4acf-8f37-3201da5ac933]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:04:58 user nova-compute[72782]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 20:04:58 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:04:58 user nova-compute[72782]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 20:04:58 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c38f76-92b6-4a6d-bc37-1849ef5c2b2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea, portal: 172.16.0.220,3260]
Aug 14 20:04:58 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea, portal: 172.16.0.220,3260] successful.
Aug 14 20:04:58 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5c70fa-8884-4088-baa8-0d245817a05b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc447b0-b889-4d2c-9249-db8e2f4242e8]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:04:58 user nova-compute[72782]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 20:04:58 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:04:58 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:04:58 user nova-compute[72782]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 20:04:58 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:04:58 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63ce6ea-16f9-40e3-ac20-67914796f406]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:04:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyiolfKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26531333935373936', 'path': '/dev/sdd'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531333935373936', 'path': '/dev/sdd'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-320971317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-320971317',id=34,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f9f312ba4414905a8d6eb44933e430e',ramdisk_id='',reservation_id='r-vhqmzwo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:04:39Z,user_data=None,user_id='12fb8b10952b4c6b8dc6823610830241',uuid=af6fee00-a067-4674-a356-f4f1c8d9f5db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd96dc7a-44be-41db-9036-538ca592c701", "address": "fa:16:3e:4a:23:dd", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd96dc7a-44", "ovs_interfaceid": "bd96dc7a-44be-41db-9036-538ca592c701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converting VIF {"id": "bd96dc7a-44be-41db-9036-538ca592c701", "address": "fa:16:3e:4a:23:dd", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd96dc7a-44", "ovs_interfaceid": "bd96dc7a-44be-41db-9036-538ca592c701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:23:dd,bridge_name='br-int',has_traffic_filtering=True,id=bd96dc7a-44be-41db-9036-538ca592c701,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd96dc7a-44') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG nova.objects.instance [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'pci_devices' on Instance uuid af6fee00-a067-4674-a356-f4f1c8d9f5db {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:04:59 user nova-compute[72782]:   <uuid>af6fee00-a067-4674-a356-f4f1c8d9f5db</uuid>
Aug 14 20:04:59 user nova-compute[72782]:   <name>instance-00000022</name>
Aug 14 20:04:59 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:04:59 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:04:59 user nova-compute[72782]:   <metadata>
Aug 14 20:04:59 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:04:59 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:04:59 user nova-compute[72782]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-320971317</nova:name>
Aug 14 20:04:59 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:04:57</nova:creationTime>
Aug 14 20:04:59 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:04:59 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:04:59 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:04:59 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:04:59 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:04:59 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:04:59 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:04:59 user nova-compute[72782]:       <nova:owner>
Aug 14 20:04:59 user nova-compute[72782]:         <nova:user uuid="12fb8b10952b4c6b8dc6823610830241">tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member</nova:user>
Aug 14 20:04:59 user nova-compute[72782]:         <nova:project uuid="4f9f312ba4414905a8d6eb44933e430e">tempest-ServerBootFromVolumeStableRescueTest-1102073842</nova:project>
Aug 14 20:04:59 user nova-compute[72782]:       </nova:owner>
Aug 14 20:04:59 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 20:04:59 user nova-compute[72782]:       <nova:ports>
Aug 14 20:04:59 user nova-compute[72782]:         <nova:port uuid="bd96dc7a-44be-41db-9036-538ca592c701">
Aug 14 20:04:59 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 20:04:59 user nova-compute[72782]:         </nova:port>
Aug 14 20:04:59 user nova-compute[72782]:       </nova:ports>
Aug 14 20:04:59 user nova-compute[72782]:     </nova:instance>
Aug 14 20:04:59 user nova-compute[72782]:   </metadata>
Aug 14 20:04:59 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:04:59 user nova-compute[72782]:     <system>
Aug 14 20:04:59 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:04:59 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:04:59 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:04:59 user nova-compute[72782]:       <entry name="serial">af6fee00-a067-4674-a356-f4f1c8d9f5db</entry>
Aug 14 20:04:59 user nova-compute[72782]:       <entry name="uuid">af6fee00-a067-4674-a356-f4f1c8d9f5db</entry>
Aug 14 20:04:59 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:04:59 user nova-compute[72782]:     </system>
Aug 14 20:04:59 user nova-compute[72782]:   </sysinfo>
Aug 14 20:04:59 user nova-compute[72782]:   <os>
Aug 14 20:04:59 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:04:59 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:04:59 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:04:59 user nova-compute[72782]:   </os>
Aug 14 20:04:59 user nova-compute[72782]:   <features>
Aug 14 20:04:59 user nova-compute[72782]:     <acpi/>
Aug 14 20:04:59 user nova-compute[72782]:     <apic/>
Aug 14 20:04:59 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:04:59 user nova-compute[72782]:   </features>
Aug 14 20:04:59 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:04:59 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:04:59 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:04:59 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:04:59 user nova-compute[72782]:   </clock>
Aug 14 20:04:59 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:04:59 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:04:59 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:04:59 user nova-compute[72782]:   </cpu>
Aug 14 20:04:59 user nova-compute[72782]:   <devices>
Aug 14 20:04:59 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 20:04:59 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:04:59 user nova-compute[72782]:       <source dev="/dev/sdd"/>
Aug 14 20:04:59 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:04:59 user nova-compute[72782]:       <serial>6b2cc395-413e-4cd9-966e-e7cbb9e605ea</serial>
Aug 14 20:04:59 user nova-compute[72782]:     </disk>
Aug 14 20:04:59 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:04:59 user nova-compute[72782]:       <mac address="fa:16:3e:4a:23:dd"/>
Aug 14 20:04:59 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:04:59 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:04:59 user nova-compute[72782]:       <target dev="tapbd96dc7a-44"/>
Aug 14 20:04:59 user nova-compute[72782]:     </interface>
Aug 14 20:04:59 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:04:59 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db/console.log" append="off"/>
Aug 14 20:04:59 user nova-compute[72782]:     </serial>
Aug 14 20:04:59 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:04:59 user nova-compute[72782]:     <video>
Aug 14 20:04:59 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:04:59 user nova-compute[72782]:     </video>
Aug 14 20:04:59 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:04:59 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:04:59 user nova-compute[72782]:     </rng>
Aug 14 20:04:59 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:04:59 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:04:59 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:04:59 user nova-compute[72782]:     </memballoon>
Aug 14 20:04:59 user nova-compute[72782]:   </devices>
Aug 14 20:04:59 user nova-compute[72782]: </domain>
Aug 14 20:04:59 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-320971317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-320971317',id=34,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f9f312ba4414905a8d6eb44933e430e',ramdisk_id='',reservation_id='r-vhqmzwo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:04:39Z,user_data=None,user_id='12fb8b10952b4c6b8dc6823610830241',uuid=af6fee00-a067-4674-a356-f4f1c8d9f5db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd96dc7a-44be-41db-9036-538ca592c701", "address": "fa:16:3e:4a:23:dd", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd96dc7a-44", "ovs_interfaceid": "bd96dc7a-44be-41db-9036-538ca592c701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converting VIF {"id": "bd96dc7a-44be-41db-9036-538ca592c701", "address": "fa:16:3e:4a:23:dd", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd96dc7a-44", "ovs_interfaceid": "bd96dc7a-44be-41db-9036-538ca592c701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:23:dd,bridge_name='br-int',has_traffic_filtering=True,id=bd96dc7a-44be-41db-9036-538ca592c701,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd96dc7a-44') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG os_vif [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:23:dd,bridge_name='br-int',has_traffic_filtering=True,id=bd96dc7a-44be-41db-9036-538ca592c701,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd96dc7a-44') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd96dc7a-44, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbd96dc7a-44, col_values=(('external_ids', {'iface-id': 'bd96dc7a-44be-41db-9036-538ca592c701', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:23:dd', 'vm-uuid': 'af6fee00-a067-4674-a356-f4f1c8d9f5db'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:04:59 user nova-compute[72782]: INFO os_vif [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:23:dd,bridge_name='br-int',has_traffic_filtering=True,id=bd96dc7a-44be-41db-9036-538ca592c701,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd96dc7a-44')
Aug 14 20:04:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:04:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] No VIF found with MAC fa:16:3e:4a:23:dd, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:05:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-ec453473-5e35-4e76-b940-40e4081ccaad req-da7dccdc-4ea9-4f32-98a0-e1c79091b88f service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received event network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:05:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ec453473-5e35-4e76-b940-40e4081ccaad req-da7dccdc-4ea9-4f32-98a0-e1c79091b88f service nova] Acquiring lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:05:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ec453473-5e35-4e76-b940-40e4081ccaad req-da7dccdc-4ea9-4f32-98a0-e1c79091b88f service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:05:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ec453473-5e35-4e76-b940-40e4081ccaad req-da7dccdc-4ea9-4f32-98a0-e1c79091b88f service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:05:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-ec453473-5e35-4e76-b940-40e4081ccaad req-da7dccdc-4ea9-4f32-98a0-e1c79091b88f service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] No waiting events found dispatching network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:05:00 user nova-compute[72782]: WARNING nova.compute.manager [req-ec453473-5e35-4e76-b940-40e4081ccaad req-da7dccdc-4ea9-4f32-98a0-e1c79091b88f service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received unexpected event network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 for instance with vm_state building and task_state spawning.
Aug 14 20:05:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:05:02 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692043487.414813, 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:05:02 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] VM Stopped (Lifecycle Event)
Aug 14 20:05:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-2fd07389-3b42-4de7-9163-6ee8a3bd0030 None None] [instance: 804a6fb5-18ae-4ec7-a4e8-97c7df869e8a] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:05:02 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043502.714881, af6fee00-a067-4674-a356-f4f1c8d9f5db => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:05:02 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] VM Resumed (Lifecycle Event)
Aug 14 20:05:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:05:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:05:02 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Instance spawned successfully.
Aug 14 20:05:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:05:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:05:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:05:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:05:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:05:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:05:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:05:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:05:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:05:02 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:05:02 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043502.7175663, af6fee00-a067-4674-a356-f4f1c8d9f5db => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:05:02 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] VM Started (Lifecycle Event)
Aug 14 20:05:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:05:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:05:02 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:05:02 user nova-compute[72782]: INFO nova.compute.manager [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Took 4.98 seconds to spawn the instance on the hypervisor.
Aug 14 20:05:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:05:02 user nova-compute[72782]: INFO nova.compute.manager [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Took 24.85 seconds to build instance.
Aug 14 20:05:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f3134eb9-ae27-464d-a471-efb344a3a509 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.071s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:05:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-bb36d747-cf13-450d-aa52-62d8b52b6d3b req-f2b0e9bf-b198-463c-afcd-83e8fc3cc6ab service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received event network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:05:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bb36d747-cf13-450d-aa52-62d8b52b6d3b req-f2b0e9bf-b198-463c-afcd-83e8fc3cc6ab service nova] Acquiring lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:05:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bb36d747-cf13-450d-aa52-62d8b52b6d3b req-f2b0e9bf-b198-463c-afcd-83e8fc3cc6ab service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:05:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bb36d747-cf13-450d-aa52-62d8b52b6d3b req-f2b0e9bf-b198-463c-afcd-83e8fc3cc6ab service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:05:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-bb36d747-cf13-450d-aa52-62d8b52b6d3b req-f2b0e9bf-b198-463c-afcd-83e8fc3cc6ab service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] No waiting events found dispatching network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:05:03 user nova-compute[72782]: WARNING nova.compute.manager [req-bb36d747-cf13-450d-aa52-62d8b52b6d3b req-f2b0e9bf-b198-463c-afcd-83e8fc3cc6ab service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received unexpected event network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 for instance with vm_state active and task_state None.
Aug 14 20:05:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:05:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:05:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:05:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:05:06 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:05:06 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Updating instance_info_cache with network_info: [{"id": "325817ed-4de8-4d31-afb7-d338d9391c55", "address": "fa:16:3e:83:cb:20", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325817ed-4d", "ovs_interfaceid": "325817ed-4de8-4d31-afb7-d338d9391c55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:05:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:05:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:05:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:05:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:05:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:05:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:05:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:05:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:05:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:05:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:05:07 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:05:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:07 user nova-compute[72782]: INFO nova.compute.manager [None req-7803a850-375a-4586-83b5-aebbb7ab6fa2 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Unrescuing
Aug 14 20:05:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7803a850-375a-4586-83b5-aebbb7ab6fa2 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:05:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7803a850-375a-4586-83b5-aebbb7ab6fa2 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquired lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:05:07 user nova-compute[72782]: DEBUG nova.network.neutron [None req-7803a850-375a-4586-83b5-aebbb7ab6fa2 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:05:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG nova.network.neutron [None req-7803a850-375a-4586-83b5-aebbb7ab6fa2 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Updating instance_info_cache with network_info: [{"id": "325817ed-4de8-4d31-afb7-d338d9391c55", "address": "fa:16:3e:83:cb:20", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325817ed-4d", "ovs_interfaceid": "325817ed-4de8-4d31-afb7-d338d9391c55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7803a850-375a-4586-83b5-aebbb7ab6fa2 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Releasing lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG nova.objects.instance [None req-7803a850-375a-4586-83b5-aebbb7ab6fa2 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'flavor' on Instance uuid 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-abfc37ca-036a-4c9c-8458-382e8a51639e req-6eae38cc-cac3-48a8-a29c-6f614d8ec366 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-vif-unplugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-abfc37ca-036a-4c9c-8458-382e8a51639e req-6eae38cc-cac3-48a8-a29c-6f614d8ec366 service nova] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-abfc37ca-036a-4c9c-8458-382e8a51639e req-6eae38cc-cac3-48a8-a29c-6f614d8ec366 service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-abfc37ca-036a-4c9c-8458-382e8a51639e req-6eae38cc-cac3-48a8-a29c-6f614d8ec366 service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG nova.compute.manager [req-abfc37ca-036a-4c9c-8458-382e8a51639e req-6eae38cc-cac3-48a8-a29c-6f614d8ec366 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] No waiting events found dispatching network-vif-unplugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:05:08 user nova-compute[72782]: WARNING nova.compute.manager [req-abfc37ca-036a-4c9c-8458-382e8a51639e req-6eae38cc-cac3-48a8-a29c-6f614d8ec366 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received unexpected event network-vif-unplugged-325817ed-4de8-4d31-afb7-d338d9391c55 for instance with vm_state rescued and task_state unrescuing.
Aug 14 20:05:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:09 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Instance destroyed successfully.
Aug 14 20:05:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:05:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:10 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:05:10 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:05:10 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8058MB free_disk=25.337570190429688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ad4011a9-ab9f-4647-b677-a1c6337d2c2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2c924d52-aa8a-47ed-857c-b863efe95258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ca7d1bf8-168b-4484-a965-72ff0aea93ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 13201da3-4908-4724-9759-100190ed16d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance af6fee00-a067-4674-a356-f4f1c8d9f5db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:05:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] No waiting events found dispatching network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:05:11 user nova-compute[72782]: WARNING nova.compute.manager [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received unexpected event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 for instance with vm_state rescued and task_state unrescuing.
Aug 14 20:05:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] No waiting events found dispatching network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:05:11 user nova-compute[72782]: WARNING nova.compute.manager [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received unexpected event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 for instance with vm_state rescued and task_state unrescuing.
Aug 14 20:05:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] No waiting events found dispatching network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:05:11 user nova-compute[72782]: WARNING nova.compute.manager [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received unexpected event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 for instance with vm_state rescued and task_state unrescuing.
Aug 14 20:05:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-vif-unplugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] No waiting events found dispatching network-vif-unplugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:05:11 user nova-compute[72782]: WARNING nova.compute.manager [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received unexpected event network-vif-unplugged-325817ed-4de8-4d31-afb7-d338d9391c55 for instance with vm_state rescued and task_state unrescuing.
Aug 14 20:05:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] No waiting events found dispatching network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:05:11 user nova-compute[72782]: WARNING nova.compute.manager [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received unexpected event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 for instance with vm_state rescued and task_state unrescuing.
Aug 14 20:05:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:05:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] No waiting events found dispatching network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:05:11 user nova-compute[72782]: WARNING nova.compute.manager [req-3383c8c7-1b63-4d2b-aa67-3a7b8b0bbccf req-20de192c-cf10-4b48-8a5c-33cfebfe31cd service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received unexpected event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 for instance with vm_state rescued and task_state unrescuing.
Aug 14 20:05:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Removed pending event for 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 due to event {{(pid=72782) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 20:05:12 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043512.6729698, 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:05:12 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] VM Resumed (Lifecycle Event)
Aug 14 20:05:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7803a850-375a-4586-83b5-aebbb7ab6fa2 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:05:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:05:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:05:12 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 20:05:12 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043512.6739902, 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:05:12 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] VM Started (Lifecycle Event)
Aug 14 20:05:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:05:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:05:12 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:05:12 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:05:12 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:05:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-0ac4899f-4561-494a-8366-7d7191fe1621 req-fcf75bb5-7490-4e83-b279-2052dfa57509 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:05:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0ac4899f-4561-494a-8366-7d7191fe1621 req-fcf75bb5-7490-4e83-b279-2052dfa57509 service nova] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:05:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0ac4899f-4561-494a-8366-7d7191fe1621 req-fcf75bb5-7490-4e83-b279-2052dfa57509 service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:05:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0ac4899f-4561-494a-8366-7d7191fe1621 req-fcf75bb5-7490-4e83-b279-2052dfa57509 service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:05:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-0ac4899f-4561-494a-8366-7d7191fe1621 req-fcf75bb5-7490-4e83-b279-2052dfa57509 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] No waiting events found dispatching network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:05:13 user nova-compute[72782]: WARNING nova.compute.manager [req-0ac4899f-4561-494a-8366-7d7191fe1621 req-fcf75bb5-7490-4e83-b279-2052dfa57509 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received unexpected event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 for instance with vm_state active and task_state None.
Aug 14 20:05:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:05:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:05:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:05:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:05:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:05:40 user nova-compute[72782]: INFO nova.compute.manager [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Terminating instance
Aug 14 20:05:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:05:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG nova.compute.manager [req-3ddd361d-e096-4b59-8f79-29ed1d77c734 req-1a11cdfa-95a7-4e28-9f74-d3e0ecf53428 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received event network-vif-unplugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3ddd361d-e096-4b59-8f79-29ed1d77c734 req-1a11cdfa-95a7-4e28-9f74-d3e0ecf53428 service nova] Acquiring lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3ddd361d-e096-4b59-8f79-29ed1d77c734 req-1a11cdfa-95a7-4e28-9f74-d3e0ecf53428 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3ddd361d-e096-4b59-8f79-29ed1d77c734 req-1a11cdfa-95a7-4e28-9f74-d3e0ecf53428 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG nova.compute.manager [req-3ddd361d-e096-4b59-8f79-29ed1d77c734 req-1a11cdfa-95a7-4e28-9f74-d3e0ecf53428 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] No waiting events found dispatching network-vif-unplugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG nova.compute.manager [req-3ddd361d-e096-4b59-8f79-29ed1d77c734 req-1a11cdfa-95a7-4e28-9f74-d3e0ecf53428 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received event network-vif-unplugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:41 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Instance destroyed successfully.
Aug 14 20:05:41 user nova-compute[72782]: DEBUG nova.objects.instance [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'resources' on Instance uuid ca7d1bf8-168b-4484-a965-72ff0aea93ef {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:59:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-392999089',display_name='tempest-ServerActionsTestOtherA-server-392999089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-392999089',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjPa06vtlcnEwf9WmNngHo77ZQLE/dqlpBjCZ69lCWox+6yOHeDlaru6JozyQO8VPG/SE5WTpKRBcOS1LznFcAxBQR7z97DyBcD1Q9ZGwfJ2pOvn+iIjcliFOke0KJwkg==',key_name='tempest-keypair-525631678',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:01:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6c0483a97574e7794c73fe43e51795e',ramdisk_id='',reservation_id='r-54bl51xf',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-956209876',owner_user_name='tempest-ServerActionsTestOtherA-956209876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a38fa907d804b81903eb97ab88ae181',uuid=ca7d1bf8-168b-4484-a965-72ff0aea93ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converting VIF {"id": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "address": "fa:16:3e:fc:64:3b", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2aad177-8a", "ovs_interfaceid": "e2aad177-8aef-4cc1-98a3-9ee3117db998", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=e2aad177-8aef-4cc1-98a3-9ee3117db998,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aad177-8a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_vif [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=e2aad177-8aef-4cc1-98a3-9ee3117db998,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aad177-8a') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2aad177-8a, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:05:41 user nova-compute[72782]: INFO os_vif [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=e2aad177-8aef-4cc1-98a3-9ee3117db998,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2aad177-8a')
Aug 14 20:05:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcytDLPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:05:41 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e789eb61-dba0-4929-be09-3de81058ace2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdfc774-d76c-469d-9142-c413b61d1438]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:05:41 user nova-compute[72782]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 20:05:41 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:05:41 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:05:41 user nova-compute[72782]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d (non-flash)
Aug 14 20:05:41 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:05:41 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e86a7490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e7fef1-bce7-4ff1-8b6a-163c2559eec5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[47177c3d-c517-483c-9da1-10290a8893f7]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd7782a-a4a1-42ef-a40e-7b3d05868413]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9e8dfc-cd8a-4c22-9a2e-c46214675633]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_dd5f9875', '/dev/disk/by-id/scsi-26364346639356230', '/dev/disk/by-id/scsi-1SCST_BIOdd5f9875-cd4f95b021f3614d') {{(pid=83776) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaf088d-1e28-4e6f-9ab9-d07df4d8577b]: (4, None) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[87713756-c09b-4c91-92c7-67f3d430266c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2b37c0-ff3e-4dba-8b95-dcb7a1896a04]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d, portal: 172.16.0.220,3260]
Aug 14 20:05:41 user nova-compute[72782]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d, portal: 172.16.0.220,3260] successful.
Aug 14 20:05:41 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029bcc2b-b3c5-4483-b696-5218bfe52e0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f518d7d-16fb-405a-849a-9a3493c4ec48]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] <== disconnect_volume: return (303ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:05:41 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Deleting instance files /opt/stack/data/nova/instances/ca7d1bf8-168b-4484-a965-72ff0aea93ef_del
Aug 14 20:05:41 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Deletion of /opt/stack/data/nova/instances/ca7d1bf8-168b-4484-a965-72ff0aea93ef_del complete
Aug 14 20:05:41 user nova-compute[72782]: INFO nova.compute.manager [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 14 20:05:41 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:05:41 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:05:42 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:05:42 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Took 0.87 seconds to deallocate network for instance.
Aug 14 20:05:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:43 user nova-compute[72782]: DEBUG nova.compute.manager [req-6dbc0269-d445-4b2f-bb82-15ed5dc21873 req-de01c672-b00e-49ca-9eda-ee8d723d8671 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received event network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:05:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6dbc0269-d445-4b2f-bb82-15ed5dc21873 req-de01c672-b00e-49ca-9eda-ee8d723d8671 service nova] Acquiring lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:05:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6dbc0269-d445-4b2f-bb82-15ed5dc21873 req-de01c672-b00e-49ca-9eda-ee8d723d8671 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:05:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6dbc0269-d445-4b2f-bb82-15ed5dc21873 req-de01c672-b00e-49ca-9eda-ee8d723d8671 service nova] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:05:43 user nova-compute[72782]: DEBUG nova.compute.manager [req-6dbc0269-d445-4b2f-bb82-15ed5dc21873 req-de01c672-b00e-49ca-9eda-ee8d723d8671 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] No waiting events found dispatching network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:05:43 user nova-compute[72782]: WARNING nova.compute.manager [req-6dbc0269-d445-4b2f-bb82-15ed5dc21873 req-de01c672-b00e-49ca-9eda-ee8d723d8671 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received unexpected event network-vif-plugged-e2aad177-8aef-4cc1-98a3-9ee3117db998 for instance with vm_state active and task_state deleting.
Aug 14 20:05:43 user nova-compute[72782]: DEBUG nova.compute.manager [req-6dbc0269-d445-4b2f-bb82-15ed5dc21873 req-de01c672-b00e-49ca-9eda-ee8d723d8671 service nova] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Received event network-vif-deleted-e2aad177-8aef-4cc1-98a3-9ee3117db998 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:05:43 user nova-compute[72782]: INFO nova.compute.manager [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Took 0.93 seconds to detach 1 volumes for instance.
Aug 14 20:05:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Deleting volume: 029bcc2b-b3c5-4483-b696-5218bfe52e0d {{(pid=72782) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 20:05:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:05:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:05:44 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:05:44 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:05:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:05:44 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Deleted allocations for instance ca7d1bf8-168b-4484-a965-72ff0aea93ef
Aug 14 20:05:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3b0a9e26-c217-475e-80cc-f37b364a24ee tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "ca7d1bf8-168b-4484-a965-72ff0aea93ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.516s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:05:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:56 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692043541.4414444, ca7d1bf8-168b-4484-a965-72ff0aea93ef => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:05:56 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] VM Stopped (Lifecycle Event)
Aug 14 20:05:56 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fbc7e607-8d89-423d-b57f-abb1f35e7bf2 None None] [instance: ca7d1bf8-168b-4484-a965-72ff0aea93ef] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:05:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:05:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:05:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:05:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:05:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:05:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:06:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "97e433e6-da66-4095-b9c3-67a32c90c2c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:06:01 user nova-compute[72782]: INFO nova.compute.claims [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Claim successful on node user
Aug 14 20:06:01 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG nova.network.neutron [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:06:01 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:06:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG nova.policy [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b05d2dbed8be48fb811a0acf350d9765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074449bc387c4ae4b0c8325a98a42b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:06:01 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Creating image(s)
Aug 14 20:06:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "/opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "/opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "/opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk 1073741824" returned: 0 in 0.053s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG nova.network.neutron [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Successfully created port: d5db7d03-7af8-4a92-92ac-f6b244683d38 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.191s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Cannot resize image /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG nova.objects.instance [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lazy-loading 'migration_context' on Instance uuid 97e433e6-da66-4095-b9c3-67a32c90c2c6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Ensure instance console log exists: /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG nova.network.neutron [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Successfully updated port: d5db7d03-7af8-4a92-92ac-f6b244683d38 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "refresh_cache-97e433e6-da66-4095-b9c3-67a32c90c2c6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquired lock "refresh_cache-97e433e6-da66-4095-b9c3-67a32c90c2c6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG nova.network.neutron [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG nova.network.neutron [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-d5a49045-66e6-4f70-8940-5dfb42fb29be req-90767422-931d-409f-87b3-65092283d6ce service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Received event network-changed-d5db7d03-7af8-4a92-92ac-f6b244683d38 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-d5a49045-66e6-4f70-8940-5dfb42fb29be req-90767422-931d-409f-87b3-65092283d6ce service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Refreshing instance network info cache due to event network-changed-d5db7d03-7af8-4a92-92ac-f6b244683d38. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:06:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d5a49045-66e6-4f70-8940-5dfb42fb29be req-90767422-931d-409f-87b3-65092283d6ce service nova] Acquiring lock "refresh_cache-97e433e6-da66-4095-b9c3-67a32c90c2c6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Updating instance_info_cache with network_info: [{"id": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "address": "fa:16:3e:a6:79:aa", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5db7d03-7a", "ovs_interfaceid": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Releasing lock "refresh_cache-97e433e6-da66-4095-b9c3-67a32c90c2c6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.compute.manager [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Instance network_info: |[{"id": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "address": "fa:16:3e:a6:79:aa", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5db7d03-7a", "ovs_interfaceid": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d5a49045-66e6-4f70-8940-5dfb42fb29be req-90767422-931d-409f-87b3-65092283d6ce service nova] Acquired lock "refresh_cache-97e433e6-da66-4095-b9c3-67a32c90c2c6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.network.neutron [req-d5a49045-66e6-4f70-8940-5dfb42fb29be req-90767422-931d-409f-87b3-65092283d6ce service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Refreshing network info cache for port d5db7d03-7af8-4a92-92ac-f6b244683d38 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Start _get_guest_xml network_info=[{"id": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "address": "fa:16:3e:a6:79:aa", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5db7d03-7a", "ovs_interfaceid": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:06:03 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:06:03 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1235784613',display_name='tempest-VolumesSnapshotTestJSON-instance-1235784613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1235784613',id=35,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUgeH+NS2oJyzKReXsgAaXUcSl5uXJPmR3kkgrnlWa5Yl4SbEt+eVE9oTCkwwe1ZYyKIH0FaxqLee4mBUf3lI+mK7EQcPtaJTKhlHyeYueNbhTAd4PbKXKLLiY2ZWOaSA==',key_name='tempest-keypair-1687860797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='074449bc387c4ae4b0c8325a98a42b85',ramdisk_id='',reservation_id='r-vh47rdqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-738905962',owner_user_name='tempest-VolumesSnapshotTestJSON-738905962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:06:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b05d2dbed8be48fb811a0acf350d9765',uuid=97e433e6-da66-4095-b9c3-67a32c90c2c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "address": "fa:16:3e:a6:79:aa", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5db7d03-7a", "ovs_interfaceid": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Converting VIF {"id": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "address": "fa:16:3e:a6:79:aa", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5db7d03-7a", "ovs_interfaceid": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:79:aa,bridge_name='br-int',has_traffic_filtering=True,id=d5db7d03-7af8-4a92-92ac-f6b244683d38,network=Network(2aca477c-9ad7-4708-8466-7934911f13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5db7d03-7a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.objects.instance [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lazy-loading 'pci_devices' on Instance uuid 97e433e6-da66-4095-b9c3-67a32c90c2c6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:06:03 user nova-compute[72782]:   <uuid>97e433e6-da66-4095-b9c3-67a32c90c2c6</uuid>
Aug 14 20:06:03 user nova-compute[72782]:   <name>instance-00000023</name>
Aug 14 20:06:03 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:06:03 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:06:03 user nova-compute[72782]:   <metadata>
Aug 14 20:06:03 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:06:03 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:06:03 user nova-compute[72782]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1235784613</nova:name>
Aug 14 20:06:03 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:06:03</nova:creationTime>
Aug 14 20:06:03 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:06:03 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:06:03 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:06:03 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:06:03 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:06:03 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:06:03 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:06:03 user nova-compute[72782]:       <nova:owner>
Aug 14 20:06:03 user nova-compute[72782]:         <nova:user uuid="b05d2dbed8be48fb811a0acf350d9765">tempest-VolumesSnapshotTestJSON-738905962-project-member</nova:user>
Aug 14 20:06:03 user nova-compute[72782]:         <nova:project uuid="074449bc387c4ae4b0c8325a98a42b85">tempest-VolumesSnapshotTestJSON-738905962</nova:project>
Aug 14 20:06:03 user nova-compute[72782]:       </nova:owner>
Aug 14 20:06:03 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 20:06:03 user nova-compute[72782]:       <nova:ports>
Aug 14 20:06:03 user nova-compute[72782]:         <nova:port uuid="d5db7d03-7af8-4a92-92ac-f6b244683d38">
Aug 14 20:06:03 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 20:06:03 user nova-compute[72782]:         </nova:port>
Aug 14 20:06:03 user nova-compute[72782]:       </nova:ports>
Aug 14 20:06:03 user nova-compute[72782]:     </nova:instance>
Aug 14 20:06:03 user nova-compute[72782]:   </metadata>
Aug 14 20:06:03 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:06:03 user nova-compute[72782]:     <system>
Aug 14 20:06:03 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:06:03 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:06:03 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:06:03 user nova-compute[72782]:       <entry name="serial">97e433e6-da66-4095-b9c3-67a32c90c2c6</entry>
Aug 14 20:06:03 user nova-compute[72782]:       <entry name="uuid">97e433e6-da66-4095-b9c3-67a32c90c2c6</entry>
Aug 14 20:06:03 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:06:03 user nova-compute[72782]:     </system>
Aug 14 20:06:03 user nova-compute[72782]:   </sysinfo>
Aug 14 20:06:03 user nova-compute[72782]:   <os>
Aug 14 20:06:03 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:06:03 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:06:03 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:06:03 user nova-compute[72782]:   </os>
Aug 14 20:06:03 user nova-compute[72782]:   <features>
Aug 14 20:06:03 user nova-compute[72782]:     <acpi/>
Aug 14 20:06:03 user nova-compute[72782]:     <apic/>
Aug 14 20:06:03 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:06:03 user nova-compute[72782]:   </features>
Aug 14 20:06:03 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:06:03 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:06:03 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:06:03 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:06:03 user nova-compute[72782]:   </clock>
Aug 14 20:06:03 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:06:03 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:06:03 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:06:03 user nova-compute[72782]:   </cpu>
Aug 14 20:06:03 user nova-compute[72782]:   <devices>
Aug 14 20:06:03 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:06:03 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:06:03 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk"/>
Aug 14 20:06:03 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:06:03 user nova-compute[72782]:     </disk>
Aug 14 20:06:03 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:06:03 user nova-compute[72782]:       <mac address="fa:16:3e:a6:79:aa"/>
Aug 14 20:06:03 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:06:03 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:06:03 user nova-compute[72782]:       <target dev="tapd5db7d03-7a"/>
Aug 14 20:06:03 user nova-compute[72782]:     </interface>
Aug 14 20:06:03 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:06:03 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/console.log" append="off"/>
Aug 14 20:06:03 user nova-compute[72782]:     </serial>
Aug 14 20:06:03 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:06:03 user nova-compute[72782]:     <video>
Aug 14 20:06:03 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:06:03 user nova-compute[72782]:     </video>
Aug 14 20:06:03 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:06:03 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:06:03 user nova-compute[72782]:     </rng>
Aug 14 20:06:03 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:06:03 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:06:03 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:06:03 user nova-compute[72782]:     </memballoon>
Aug 14 20:06:03 user nova-compute[72782]:   </devices>
Aug 14 20:06:03 user nova-compute[72782]: </domain>
Aug 14 20:06:03 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1235784613',display_name='tempest-VolumesSnapshotTestJSON-instance-1235784613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1235784613',id=35,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUgeH+NS2oJyzKReXsgAaXUcSl5uXJPmR3kkgrnlWa5Yl4SbEt+eVE9oTCkwwe1ZYyKIH0FaxqLee4mBUf3lI+mK7EQcPtaJTKhlHyeYueNbhTAd4PbKXKLLiY2ZWOaSA==',key_name='tempest-keypair-1687860797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='074449bc387c4ae4b0c8325a98a42b85',ramdisk_id='',reservation_id='r-vh47rdqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-738905962',owner_user_name='tempest-VolumesSnapshotTestJSON-738905962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:06:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b05d2dbed8be48fb811a0acf350d9765',uuid=97e433e6-da66-4095-b9c3-67a32c90c2c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "address": "fa:16:3e:a6:79:aa", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5db7d03-7a", "ovs_interfaceid": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Converting VIF {"id": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "address": "fa:16:3e:a6:79:aa", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5db7d03-7a", "ovs_interfaceid": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:79:aa,bridge_name='br-int',has_traffic_filtering=True,id=d5db7d03-7af8-4a92-92ac-f6b244683d38,network=Network(2aca477c-9ad7-4708-8466-7934911f13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5db7d03-7a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG os_vif [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:79:aa,bridge_name='br-int',has_traffic_filtering=True,id=d5db7d03-7af8-4a92-92ac-f6b244683d38,network=Network(2aca477c-9ad7-4708-8466-7934911f13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5db7d03-7a') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5db7d03-7a, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5db7d03-7a, col_values=(('external_ids', {'iface-id': 'd5db7d03-7af8-4a92-92ac-f6b244683d38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:79:aa', 'vm-uuid': '97e433e6-da66-4095-b9c3-67a32c90c2c6'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:03 user nova-compute[72782]: INFO os_vif [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:79:aa,bridge_name='br-int',has_traffic_filtering=True,id=d5db7d03-7af8-4a92-92ac-f6b244683d38,network=Network(2aca477c-9ad7-4708-8466-7934911f13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5db7d03-7a')
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:06:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] No VIF found with MAC fa:16:3e:a6:79:aa, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:06:04 user nova-compute[72782]: DEBUG nova.network.neutron [req-d5a49045-66e6-4f70-8940-5dfb42fb29be req-90767422-931d-409f-87b3-65092283d6ce service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Updated VIF entry in instance network info cache for port d5db7d03-7af8-4a92-92ac-f6b244683d38. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:06:04 user nova-compute[72782]: DEBUG nova.network.neutron [req-d5a49045-66e6-4f70-8940-5dfb42fb29be req-90767422-931d-409f-87b3-65092283d6ce service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Updating instance_info_cache with network_info: [{"id": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "address": "fa:16:3e:a6:79:aa", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5db7d03-7a", "ovs_interfaceid": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:06:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d5a49045-66e6-4f70-8940-5dfb42fb29be req-90767422-931d-409f-87b3-65092283d6ce service nova] Releasing lock "refresh_cache-97e433e6-da66-4095-b9c3-67a32c90c2c6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:06:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-298509dc-6660-4394-91ac-1bc8b00fc65c req-07abd710-9c24-4404-b31c-6165715fd139 service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Received event network-vif-plugged-d5db7d03-7af8-4a92-92ac-f6b244683d38 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:06:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-298509dc-6660-4394-91ac-1bc8b00fc65c req-07abd710-9c24-4404-b31c-6165715fd139 service nova] Acquiring lock "97e433e6-da66-4095-b9c3-67a32c90c2c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-298509dc-6660-4394-91ac-1bc8b00fc65c req-07abd710-9c24-4404-b31c-6165715fd139 service nova] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-298509dc-6660-4394-91ac-1bc8b00fc65c req-07abd710-9c24-4404-b31c-6165715fd139 service nova] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-298509dc-6660-4394-91ac-1bc8b00fc65c req-07abd710-9c24-4404-b31c-6165715fd139 service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] No waiting events found dispatching network-vif-plugged-d5db7d03-7af8-4a92-92ac-f6b244683d38 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:06:05 user nova-compute[72782]: WARNING nova.compute.manager [req-298509dc-6660-4394-91ac-1bc8b00fc65c req-07abd710-9c24-4404-b31c-6165715fd139 service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Received unexpected event network-vif-plugged-d5db7d03-7af8-4a92-92ac-f6b244683d38 for instance with vm_state building and task_state spawning.
Aug 14 20:06:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:06:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:06:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043567.098342, 97e433e6-da66-4095-b9c3-67a32c90c2c6 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:06:07 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] VM Resumed (Lifecycle Event)
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-2c924d52-aa8a-47ed-857c-b863efe95258" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-2c924d52-aa8a-47ed-857c-b863efe95258" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:06:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Instance spawned successfully.
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:06:07 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043567.0997698, 97e433e6-da66-4095-b9c3-67a32c90c2c6 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:06:07 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] VM Started (Lifecycle Event)
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.compute.manager [req-567f8153-fd2a-4689-8ea3-30ea42ed04f2 req-153b52ac-594c-42c6-abc2-cf1d67b1c756 service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Received event network-vif-plugged-d5db7d03-7af8-4a92-92ac-f6b244683d38 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-567f8153-fd2a-4689-8ea3-30ea42ed04f2 req-153b52ac-594c-42c6-abc2-cf1d67b1c756 service nova] Acquiring lock "97e433e6-da66-4095-b9c3-67a32c90c2c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-567f8153-fd2a-4689-8ea3-30ea42ed04f2 req-153b52ac-594c-42c6-abc2-cf1d67b1c756 service nova] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-567f8153-fd2a-4689-8ea3-30ea42ed04f2 req-153b52ac-594c-42c6-abc2-cf1d67b1c756 service nova] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.compute.manager [req-567f8153-fd2a-4689-8ea3-30ea42ed04f2 req-153b52ac-594c-42c6-abc2-cf1d67b1c756 service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] No waiting events found dispatching network-vif-plugged-d5db7d03-7af8-4a92-92ac-f6b244683d38 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:06:07 user nova-compute[72782]: WARNING nova.compute.manager [req-567f8153-fd2a-4689-8ea3-30ea42ed04f2 req-153b52ac-594c-42c6-abc2-cf1d67b1c756 service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Received unexpected event network-vif-plugged-d5db7d03-7af8-4a92-92ac-f6b244683d38 for instance with vm_state building and task_state spawning.
Aug 14 20:06:07 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:06:07 user nova-compute[72782]: INFO nova.compute.manager [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Took 5.69 seconds to spawn the instance on the hypervisor.
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:06:07 user nova-compute[72782]: INFO nova.compute.manager [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Took 6.36 seconds to build instance.
Aug 14 20:06:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e35dd49d-1b8d-40cf-82ab-3b81f8a796a8 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.464s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Updating instance_info_cache with network_info: [{"id": "8b971464-be37-4d45-a3c6-05d413e65cb2", "address": "fa:16:3e:a0:14:ff", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b971464-be", "ovs_interfaceid": "8b971464-be37-4d45-a3c6-05d413e65cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-2c924d52-aa8a-47ed-857c-b863efe95258" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:06:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:06:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:06:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:06:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:09 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:06:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:09 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:06:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:06:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:06:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:12 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:06:12 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8031MB free_disk=25.33404541015625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ad4011a9-ab9f-4647-b677-a1c6337d2c2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2c924d52-aa8a-47ed-857c-b863efe95258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 13201da3-4908-4724-9759-100190ed16d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance af6fee00-a067-4674-a356-f4f1c8d9f5db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 97e433e6-da66-4095-b9c3-67a32c90c2c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing inventories for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating ProviderTree inventory for provider d26c9e3b-40e6-476e-9664-3119ebf5873b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing aggregate associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, aggregates: None {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing trait associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:06:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.626s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:13 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:06:13 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:06:13 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:06:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 20:06:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] There are 0 instances to clean {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 20:06:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:06:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:06:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:06:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:06:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:14 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:06:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72782) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 20:06:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:28 user nova-compute[72782]: INFO nova.compute.manager [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Rescuing
Aug 14 20:06:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "refresh_cache-af6fee00-a067-4674-a356-f4f1c8d9f5db" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:06:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquired lock "refresh_cache-af6fee00-a067-4674-a356-f4f1c8d9f5db" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:06:28 user nova-compute[72782]: DEBUG nova.network.neutron [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:06:29 user nova-compute[72782]: DEBUG nova.network.neutron [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Updating instance_info_cache with network_info: [{"id": "bd96dc7a-44be-41db-9036-538ca592c701", "address": "fa:16:3e:4a:23:dd", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd96dc7a-44", "ovs_interfaceid": "bd96dc7a-44be-41db-9036-538ca592c701", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:06:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Releasing lock "refresh_cache-af6fee00-a067-4674-a356-f4f1c8d9f5db" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:06:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-3b13c2ee-f251-4b12-94b5-dea6fb55aa2e req-cb15508a-898f-4c12-94da-4c323d965c3d service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received event network-vif-unplugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:06:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3b13c2ee-f251-4b12-94b5-dea6fb55aa2e req-cb15508a-898f-4c12-94da-4c323d965c3d service nova] Acquiring lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3b13c2ee-f251-4b12-94b5-dea6fb55aa2e req-cb15508a-898f-4c12-94da-4c323d965c3d service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3b13c2ee-f251-4b12-94b5-dea6fb55aa2e req-cb15508a-898f-4c12-94da-4c323d965c3d service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-3b13c2ee-f251-4b12-94b5-dea6fb55aa2e req-cb15508a-898f-4c12-94da-4c323d965c3d service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] No waiting events found dispatching network-vif-unplugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:06:29 user nova-compute[72782]: WARNING nova.compute.manager [req-3b13c2ee-f251-4b12-94b5-dea6fb55aa2e req-cb15508a-898f-4c12-94da-4c323d965c3d service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received unexpected event network-vif-unplugged-bd96dc7a-44be-41db-9036-538ca592c701 for instance with vm_state active and task_state rescuing.
Aug 14 20:06:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:29 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Instance destroyed successfully.
Aug 14 20:06:29 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Attempting a stable device rescue
Aug 14 20:06:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72782) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 20:06:29 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Instance directory exists: not creating {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 20:06:29 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Creating image(s)
Aug 14 20:06:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "/opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "/opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "/opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:29 user nova-compute[72782]: DEBUG nova.objects.instance [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'trusted_certs' on Instance uuid af6fee00-a067-4674-a356-f4f1c8d9f5db {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:06:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1.part --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1.part --force-share --output=json" returned: 0 in 0.176s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG nova.virt.images [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] e215aaf8-e7cc-46c1-a41b-8cf13d3458bb was qcow2, converting to raw {{(pid=72782) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG nova.privsep.utils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72782) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1.part /opt/stack/data/nova/instances/_base/e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1.converted {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG nova.compute.manager [req-caf3961a-e37e-4cce-bfae-e8de78636f2a req-2f93c04d-7dd8-4372-9bf9-d625e592af61 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received event network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-caf3961a-e37e-4cce-bfae-e8de78636f2a req-2f93c04d-7dd8-4372-9bf9-d625e592af61 service nova] Acquiring lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-caf3961a-e37e-4cce-bfae-e8de78636f2a req-2f93c04d-7dd8-4372-9bf9-d625e592af61 service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-caf3961a-e37e-4cce-bfae-e8de78636f2a req-2f93c04d-7dd8-4372-9bf9-d625e592af61 service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG nova.compute.manager [req-caf3961a-e37e-4cce-bfae-e8de78636f2a req-2f93c04d-7dd8-4372-9bf9-d625e592af61 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] No waiting events found dispatching network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:06:31 user nova-compute[72782]: WARNING nova.compute.manager [req-caf3961a-e37e-4cce-bfae-e8de78636f2a req-2f93c04d-7dd8-4372-9bf9-d625e592af61 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received unexpected event network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 for instance with vm_state active and task_state rescuing.
Aug 14 20:06:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1.part /opt/stack/data/nova/instances/_base/e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1.converted" returned: 0 in 0.288s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1.converted --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.732s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1 --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1,backing_fmt=raw /opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db/disk.rescue {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1,backing_fmt=raw /opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db/disk.rescue" returned: 0 in 0.051s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:31 user nova-compute[72782]: DEBUG nova.objects.instance [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'migration_context' on Instance uuid af6fee00-a067-4674-a356-f4f1c8d9f5db {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Start _get_guest_xml network_info=[{"id": "bd96dc7a-44be-41db-9036-538ca592c701", "address": "fa:16:3e:4a:23:dd", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "vif_mac": "fa:16:3e:4a:23:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd96dc7a-44", "ovs_interfaceid": "bd96dc7a-44be-41db-9036-538ca592c701", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e215aaf8-e7cc-46c1-a41b-8cf13d3458bb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '26defa04-19e3-4d96-99aa-c840150b7791', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyiolfKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'af6fee00-a067-4674-a356-f4f1c8d9f5db', 'attached_at': '', 'detached_at': '', 'volume_id': '6b2cc395-413e-4cd9-966e-e7cbb9e605ea', 'serial': '6b2cc395-413e-4cd9-966e-e7cbb9e605ea'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.objects.instance [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'resources' on Instance uuid af6fee00-a067-4674-a356-f4f1c8d9f5db {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.objects.instance [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'numa_topology' on Instance uuid af6fee00-a067-4674-a356-f4f1c8d9f5db {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:06:32 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:06:32 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.objects.instance [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'vcpu_model' on Instance uuid af6fee00-a067-4674-a356-f4f1c8d9f5db {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyiolfKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:06:32 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:06:32 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:06:32 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73df8bf-22b5-42be-8c39-fa2c50751427]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = vyiolfKg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 20:06:32 user nova-compute[72782]: node.name = iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea
Aug 14 20:06:32 user nova-compute[72782]: node.tpgt = -1
Aug 14 20:06:32 user nova-compute[72782]: node.startup = automatic
Aug 14 20:06:32 user nova-compute[72782]: node.leading_login = No
Aug 14 20:06:32 user nova-compute[72782]: iface.iscsi_ifacename = default
Aug 14 20:06:32 user nova-compute[72782]: iface.net_ifacename = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.ipaddress = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.prefix_len = 0
Aug 14 20:06:32 user nova-compute[72782]: iface.hwaddress = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.transport_name = tcp
Aug 14 20:06:32 user nova-compute[72782]: iface.initiatorname = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.state = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.vlan_id = 0
Aug 14 20:06:32 user nova-compute[72782]: iface.vlan_priority = 0
Aug 14 20:06:32 user nova-compute[72782]: iface.vlan_state = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.iface_num = 0
Aug 14 20:06:32 user nova-compute[72782]: iface.mtu = 0
Aug 14 20:06:32 user nova-compute[72782]: iface.port = 0
Aug 14 20:06:32 user nova-compute[72782]: iface.bootproto = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.subnet_mask = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.gateway = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.dhcp_alt_client_id = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.dhcp_dns = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.dhcp_learn_iqn = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.dhcp_vendor_id_state = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.dhcp_vendor_id = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.dhcp_slp_da = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.fragmentation = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.gratuitous_arp = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.incoming_forwarding = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.tos_state = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.tos = 0
Aug 14 20:06:32 user nova-compute[72782]: iface.ttl = 0
Aug 14 20:06:32 user nova-compute[72782]: iface.delayed_ack = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.tcp_nagle = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.tcp_wsf_state = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.tcp_wsf = 0
Aug 14 20:06:32 user nova-compute[72782]: iface.tcp_timer_scale = 0
Aug 14 20:06:32 user nova-compute[72782]: iface.tcp_timestamp = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.redirect = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.def_task_mgmt_timeout = 0
Aug 14 20:06:32 user nova-compute[72782]: iface.header_digest = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.data_digest = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.immediate_data = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.initial_r2t = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.data_seq_inorder = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.data_pdu_inorder = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.erl = 0
Aug 14 20:06:32 user nova-compute[72782]: iface.max_receive_data_len = 0
Aug 14 20:06:32 user nova-compute[72782]: iface.first_burst_len = 0
Aug 14 20:06:32 user nova-compute[72782]: iface.max_outstanding_r2t = 0
Aug 14 20:06:32 user nova-compute[72782]: iface.max_burst_len = 0
Aug 14 20:06:32 user nova-compute[72782]: iface.chap_auth = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.bidi_chap = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.strict_login_compliance = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.discovery_auth = <empty>
Aug 14 20:06:32 user nova-compute[72782]: iface.discovery_logout = <empty>
Aug 14 20:06:32 user nova-compute[72782]: node.discovery_address = <empty>
Aug 14 20:06:32 user nova-compute[72782]: node.discovery_port = 0
Aug 14 20:06:32 user nova-compute[72782]: node.discovery_type = static
Aug 14 20:06:32 user nova-compute[72782]: node.session.initial_cmdsn = 0
Aug 14 20:06:32 user nova-compute[72782]: node.session.initial_login_retry_max = 8
Aug 14 20:06:32 user nova-compute[72782]: node.session.xmit_thread_priority = -20
Aug 14 20:06:32 user nova-compute[72782]: node.session.cmds_max = 128
Aug 14 20:06:32 user nova-compute[72782]: node.session.queue_depth = 32
Aug 14 20:06:32 user nova-compute[72782]: node.session.nr_sessions = 1
Aug 14 20:06:32 user nova-compute[72782]: node.session.auth.authmethod = CHAP
Aug 14 20:06:32 user nova-compute[72782]: node.session.auth.username = vyiolfKg
Aug 14 20:06:32 user nova-compute[72782]: node.session.auth.password = ***
Aug 14 20:06:32 user nova-compute[72782]: node.session.auth.username_in = <empty>
Aug 14 20:06:32 user nova-compute[72782]: node.session.auth.password_in = <empty>
Aug 14 20:06:32 user nova-compute[72782]: node.session.auth.chap_algs = MD5
Aug 14 20:06:32 user nova-compute[72782]: node.session.timeo.replacement_timeout = 120
Aug 14 20:06:32 user nova-compute[72782]: node.session.err_timeo.abort_timeout = 15
Aug 14 20:06:32 user nova-compute[72782]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 20:06:32 user nova-compute[72782]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 20:06:32 user nova-compute[72782]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 20:06:32 user nova-compute[72782]: node.session.iscsi.FastAbort = Yes
Aug 14 20:06:32 user nova-compute[72782]: node.session.iscsi.InitialR2T = No
Aug 14 20:06:32 user nova-compute[72782]: node.session.iscsi.ImmediateData = Yes
Aug 14 20:06:32 user nova-compute[72782]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 20:06:32 user nova-compute[72782]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 20:06:32 user nova-compute[72782]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 20:06:32 user nova-compute[72782]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 20:06:32 user nova-compute[72782]: node.session.iscsi.MaxConnections = 1
Aug 14 20:06:32 user nova-compute[72782]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 20:06:32 user nova-compute[72782]: node.session.iscsi.ERL = 0
Aug 14 20:06:32 user nova-compute[72782]: node.session.scan = manual
Aug 14 20:06:32 user nova-compute[72782]: node.session.reopen_max = 0
Aug 14 20:06:32 user nova-compute[72782]: node.conn[0].address = 172.16.0.220
Aug 14 20:06:32 user nova-compute[72782]: node.conn[0].port = 3260
Aug 14 20:06:32 user nova-compute[72782]: node.conn[0].startup = manual
Aug 14 20:06:32 user nova-compute[72782]: node.conn[0].tcp.window_size = 524288
Aug 14 20:06:32 user nova-compute[72782]: node.conn[0].tcp.type_of_service = 0
Aug 14 20:06:32 user nova-compute[72782]: node.conn[0].timeo.logout_timeout = 15
Aug 14 20:06:32 user nova-compute[72782]: node.conn[0].timeo.login_timeout = 15
Aug 14 20:06:32 user nova-compute[72782]: node.conn[0].timeo.auth_timeout = 45
Aug 14 20:06:32 user nova-compute[72782]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 20:06:32 user nova-compute[72782]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 20:06:32 user nova-compute[72782]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 20:06:32 user nova-compute[72782]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 20:06:32 user nova-compute[72782]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 20:06:32 user nova-compute[72782]: node.conn[0].iscsi.DataDigest = None
Aug 14 20:06:32 user nova-compute[72782]: node.conn[0].iscsi.IFMarker = No
Aug 14 20:06:32 user nova-compute[72782]: node.conn[0].iscsi.OFMarker = No
Aug 14 20:06:32 user nova-compute[72782]: # END RECORD
Aug 14 20:06:32 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[14289bf0-33d1-4d65-8423-a1db8773ac94]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf376f58-8098-4606-847f-778f7c1c48b1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vyiolfKg {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vyiolfKg" returned: 0 in 0.031s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[796f8515-a2ec-4190-83f7-720cdb55b8b5]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vyiolfKg'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4537ac-20a0-4fca-b395-12c70f7baab1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc6dfe8-d96a-46a4-ad20-9b90984e5c99]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:06:32 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:06:32 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:06:32 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:06:32 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.177s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] HCTL ('35', '0', '0', 0) found on session 43 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a5b82e-c36e-4d45-84ce-839b7a3e4ebf]: (4, ('0 0 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Searching for a device in session 43 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyiolfKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.202s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] <== connect_volume: return (203ms) {'type': 'block', 'scsi_wwn': '26531333935373936', 'path': '/dev/sdd'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531333935373936', 'path': '/dev/sdd'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-320971317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-320971317',id=34,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:05:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f9f312ba4414905a8d6eb44933e430e',ramdisk_id='',reservation_id='r-vhqmzwo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:05:03Z,user_data=None,user_id='12fb8b10952b4c6b8dc6823610830241',uuid=af6fee00-a067-4674-a356-f4f1c8d9f5db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd96dc7a-44be-41db-9036-538ca592c701", "address": "fa:16:3e:4a:23:dd", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "vif_mac": "fa:16:3e:4a:23:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd96dc7a-44", "ovs_interfaceid": "bd96dc7a-44be-41db-9036-538ca592c701", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converting VIF {"id": "bd96dc7a-44be-41db-9036-538ca592c701", "address": "fa:16:3e:4a:23:dd", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "vif_mac": "fa:16:3e:4a:23:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd96dc7a-44", "ovs_interfaceid": "bd96dc7a-44be-41db-9036-538ca592c701", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:23:dd,bridge_name='br-int',has_traffic_filtering=True,id=bd96dc7a-44be-41db-9036-538ca592c701,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd96dc7a-44') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.objects.instance [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'pci_devices' on Instance uuid af6fee00-a067-4674-a356-f4f1c8d9f5db {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:06:32 user nova-compute[72782]:   <uuid>af6fee00-a067-4674-a356-f4f1c8d9f5db</uuid>
Aug 14 20:06:32 user nova-compute[72782]:   <name>instance-00000022</name>
Aug 14 20:06:32 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:06:32 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:06:32 user nova-compute[72782]:   <metadata>
Aug 14 20:06:32 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:06:32 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:06:32 user nova-compute[72782]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-320971317</nova:name>
Aug 14 20:06:32 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:06:32</nova:creationTime>
Aug 14 20:06:32 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:06:32 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:06:32 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:06:32 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:06:32 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:06:32 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:06:32 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:06:32 user nova-compute[72782]:       <nova:owner>
Aug 14 20:06:32 user nova-compute[72782]:         <nova:user uuid="12fb8b10952b4c6b8dc6823610830241">tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member</nova:user>
Aug 14 20:06:32 user nova-compute[72782]:         <nova:project uuid="4f9f312ba4414905a8d6eb44933e430e">tempest-ServerBootFromVolumeStableRescueTest-1102073842</nova:project>
Aug 14 20:06:32 user nova-compute[72782]:       </nova:owner>
Aug 14 20:06:32 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 20:06:32 user nova-compute[72782]:       <nova:ports>
Aug 14 20:06:32 user nova-compute[72782]:         <nova:port uuid="bd96dc7a-44be-41db-9036-538ca592c701">
Aug 14 20:06:32 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 20:06:32 user nova-compute[72782]:         </nova:port>
Aug 14 20:06:32 user nova-compute[72782]:       </nova:ports>
Aug 14 20:06:32 user nova-compute[72782]:     </nova:instance>
Aug 14 20:06:32 user nova-compute[72782]:   </metadata>
Aug 14 20:06:32 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:06:32 user nova-compute[72782]:     <system>
Aug 14 20:06:32 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:06:32 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:06:32 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:06:32 user nova-compute[72782]:       <entry name="serial">af6fee00-a067-4674-a356-f4f1c8d9f5db</entry>
Aug 14 20:06:32 user nova-compute[72782]:       <entry name="uuid">af6fee00-a067-4674-a356-f4f1c8d9f5db</entry>
Aug 14 20:06:32 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:06:32 user nova-compute[72782]:     </system>
Aug 14 20:06:32 user nova-compute[72782]:   </sysinfo>
Aug 14 20:06:32 user nova-compute[72782]:   <os>
Aug 14 20:06:32 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:06:32 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:06:32 user nova-compute[72782]:   </os>
Aug 14 20:06:32 user nova-compute[72782]:   <features>
Aug 14 20:06:32 user nova-compute[72782]:     <acpi/>
Aug 14 20:06:32 user nova-compute[72782]:     <apic/>
Aug 14 20:06:32 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:06:32 user nova-compute[72782]:   </features>
Aug 14 20:06:32 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:06:32 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:06:32 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:06:32 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:06:32 user nova-compute[72782]:   </clock>
Aug 14 20:06:32 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:06:32 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:06:32 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:06:32 user nova-compute[72782]:   </cpu>
Aug 14 20:06:32 user nova-compute[72782]:   <devices>
Aug 14 20:06:32 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 20:06:32 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:06:32 user nova-compute[72782]:       <source dev="/dev/sdd"/>
Aug 14 20:06:32 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:06:32 user nova-compute[72782]:       <serial>6b2cc395-413e-4cd9-966e-e7cbb9e605ea</serial>
Aug 14 20:06:32 user nova-compute[72782]:     </disk>
Aug 14 20:06:32 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:06:32 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:06:32 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db/disk.rescue"/>
Aug 14 20:06:32 user nova-compute[72782]:       <target dev="vdb" bus="virtio"/>
Aug 14 20:06:32 user nova-compute[72782]:       <boot order="1"/>
Aug 14 20:06:32 user nova-compute[72782]:     </disk>
Aug 14 20:06:32 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:06:32 user nova-compute[72782]:       <mac address="fa:16:3e:4a:23:dd"/>
Aug 14 20:06:32 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:06:32 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:06:32 user nova-compute[72782]:       <target dev="tapbd96dc7a-44"/>
Aug 14 20:06:32 user nova-compute[72782]:     </interface>
Aug 14 20:06:32 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:06:32 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db/console.log" append="off"/>
Aug 14 20:06:32 user nova-compute[72782]:     </serial>
Aug 14 20:06:32 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:06:32 user nova-compute[72782]:     <video>
Aug 14 20:06:32 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:06:32 user nova-compute[72782]:     </video>
Aug 14 20:06:32 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:06:32 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:06:32 user nova-compute[72782]:     </rng>
Aug 14 20:06:32 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:06:32 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:06:32 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:06:32 user nova-compute[72782]:     </memballoon>
Aug 14 20:06:32 user nova-compute[72782]:   </devices>
Aug 14 20:06:32 user nova-compute[72782]: </domain>
Aug 14 20:06:32 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:06:32 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Instance destroyed successfully.
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:06:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] No VIF found with MAC fa:16:3e:4a:23:dd, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:06:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:33 user nova-compute[72782]: DEBUG nova.compute.manager [req-42a9a2c5-ba74-4f07-90ed-55827730cd13 req-1bdfade3-e0fc-47bd-8df2-cb3bfe8dc6ef service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received event network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:06:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-42a9a2c5-ba74-4f07-90ed-55827730cd13 req-1bdfade3-e0fc-47bd-8df2-cb3bfe8dc6ef service nova] Acquiring lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-42a9a2c5-ba74-4f07-90ed-55827730cd13 req-1bdfade3-e0fc-47bd-8df2-cb3bfe8dc6ef service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-42a9a2c5-ba74-4f07-90ed-55827730cd13 req-1bdfade3-e0fc-47bd-8df2-cb3bfe8dc6ef service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:33 user nova-compute[72782]: DEBUG nova.compute.manager [req-42a9a2c5-ba74-4f07-90ed-55827730cd13 req-1bdfade3-e0fc-47bd-8df2-cb3bfe8dc6ef service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] No waiting events found dispatching network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:06:33 user nova-compute[72782]: WARNING nova.compute.manager [req-42a9a2c5-ba74-4f07-90ed-55827730cd13 req-1bdfade3-e0fc-47bd-8df2-cb3bfe8dc6ef service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received unexpected event network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 for instance with vm_state active and task_state rescuing.
Aug 14 20:06:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Removed pending event for af6fee00-a067-4674-a356-f4f1c8d9f5db due to event {{(pid=72782) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 20:06:35 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043595.838798, af6fee00-a067-4674-a356-f4f1c8d9f5db => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:06:35 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] VM Resumed (Lifecycle Event)
Aug 14 20:06:35 user nova-compute[72782]: DEBUG nova.compute.manager [None req-38b5e7fb-a8f6-4804-a32a-8af83ff37c75 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:06:35 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:06:35 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:06:35 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 20:06:35 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043595.8429973, af6fee00-a067-4674-a356-f4f1c8d9f5db => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:06:35 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] VM Started (Lifecycle Event)
Aug 14 20:06:35 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:06:35 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:06:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-0bb3a050-1815-4598-aec4-b826f4ea2410 req-c2b09f78-d974-464b-ac55-7111623530b1 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received event network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:06:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0bb3a050-1815-4598-aec4-b826f4ea2410 req-c2b09f78-d974-464b-ac55-7111623530b1 service nova] Acquiring lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0bb3a050-1815-4598-aec4-b826f4ea2410 req-c2b09f78-d974-464b-ac55-7111623530b1 service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0bb3a050-1815-4598-aec4-b826f4ea2410 req-c2b09f78-d974-464b-ac55-7111623530b1 service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-0bb3a050-1815-4598-aec4-b826f4ea2410 req-c2b09f78-d974-464b-ac55-7111623530b1 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] No waiting events found dispatching network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:06:35 user nova-compute[72782]: WARNING nova.compute.manager [req-0bb3a050-1815-4598-aec4-b826f4ea2410 req-c2b09f78-d974-464b-ac55-7111623530b1 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received unexpected event network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 for instance with vm_state rescued and task_state None.
Aug 14 20:06:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:36 user nova-compute[72782]: INFO nova.compute.manager [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Terminating instance
Aug 14 20:06:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:06:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:37 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Instance destroyed successfully.
Aug 14 20:06:37 user nova-compute[72782]: DEBUG nova.objects.instance [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lazy-loading 'resources' on Instance uuid 259c51df-ccd6-456e-85f4-7aaf4cba2b69 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:06:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1612055651',display_name='tempest-ServerActionsTestOtherA-server-1612055651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1612055651',id=13,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjPa06vtlcnEwf9WmNngHo77ZQLE/dqlpBjCZ69lCWox+6yOHeDlaru6JozyQO8VPG/SE5WTpKRBcOS1LznFcAxBQR7z97DyBcD1Q9ZGwfJ2pOvn+iIjcliFOke0KJwkg==',key_name='tempest-keypair-525631678',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:48:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6c0483a97574e7794c73fe43e51795e',ramdisk_id='',reservation_id='r-kn6i5sg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-956209876',owner_user_name='tempest-ServerActionsTestOtherA-956209876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a38fa907d804b81903eb97ab88ae181',uuid=259c51df-ccd6-456e-85f4-7aaf4cba2b69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35b9955c-a82a-42b9-a936-5f3429cda375", "address": "fa:16:3e:36:7a:36", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b9955c-a8", "ovs_interfaceid": "35b9955c-a82a-42b9-a936-5f3429cda375", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:06:37 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converting VIF {"id": "35b9955c-a82a-42b9-a936-5f3429cda375", "address": "fa:16:3e:36:7a:36", "network": {"id": "2f8d1ad4-9edf-4afb-958b-9327573c7a7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1328707283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6c0483a97574e7794c73fe43e51795e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35b9955c-a8", "ovs_interfaceid": "35b9955c-a82a-42b9-a936-5f3429cda375", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:06:37 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:7a:36,bridge_name='br-int',has_traffic_filtering=True,id=35b9955c-a82a-42b9-a936-5f3429cda375,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b9955c-a8') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:06:37 user nova-compute[72782]: DEBUG os_vif [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:7a:36,bridge_name='br-int',has_traffic_filtering=True,id=35b9955c-a82a-42b9-a936-5f3429cda375,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b9955c-a8') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:06:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35b9955c-a8, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:06:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:06:37 user nova-compute[72782]: INFO os_vif [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:7a:36,bridge_name='br-int',has_traffic_filtering=True,id=35b9955c-a82a-42b9-a936-5f3429cda375,network=Network(2f8d1ad4-9edf-4afb-958b-9327573c7a7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35b9955c-a8')
Aug 14 20:06:37 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Deleting instance files /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69_del
Aug 14 20:06:37 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Deletion of /opt/stack/data/nova/instances/259c51df-ccd6-456e-85f4-7aaf4cba2b69_del complete
Aug 14 20:06:37 user nova-compute[72782]: INFO nova.compute.manager [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 20:06:37 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:06:37 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:06:37 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:06:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-53f06e9f-f0f1-4df5-b40f-8c1e17feb2fc req-40ad81ff-5c98-4327-a4e8-2a936459de15 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Received event network-vif-unplugged-35b9955c-a82a-42b9-a936-5f3429cda375 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:06:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-53f06e9f-f0f1-4df5-b40f-8c1e17feb2fc req-40ad81ff-5c98-4327-a4e8-2a936459de15 service nova] Acquiring lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-53f06e9f-f0f1-4df5-b40f-8c1e17feb2fc req-40ad81ff-5c98-4327-a4e8-2a936459de15 service nova] Lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-53f06e9f-f0f1-4df5-b40f-8c1e17feb2fc req-40ad81ff-5c98-4327-a4e8-2a936459de15 service nova] Lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-53f06e9f-f0f1-4df5-b40f-8c1e17feb2fc req-40ad81ff-5c98-4327-a4e8-2a936459de15 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] No waiting events found dispatching network-vif-unplugged-35b9955c-a82a-42b9-a936-5f3429cda375 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:06:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-53f06e9f-f0f1-4df5-b40f-8c1e17feb2fc req-40ad81ff-5c98-4327-a4e8-2a936459de15 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Received event network-vif-unplugged-35b9955c-a82a-42b9-a936-5f3429cda375 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:06:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-53f06e9f-f0f1-4df5-b40f-8c1e17feb2fc req-40ad81ff-5c98-4327-a4e8-2a936459de15 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Received event network-vif-plugged-35b9955c-a82a-42b9-a936-5f3429cda375 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:06:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-53f06e9f-f0f1-4df5-b40f-8c1e17feb2fc req-40ad81ff-5c98-4327-a4e8-2a936459de15 service nova] Acquiring lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-53f06e9f-f0f1-4df5-b40f-8c1e17feb2fc req-40ad81ff-5c98-4327-a4e8-2a936459de15 service nova] Lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-53f06e9f-f0f1-4df5-b40f-8c1e17feb2fc req-40ad81ff-5c98-4327-a4e8-2a936459de15 service nova] Lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-53f06e9f-f0f1-4df5-b40f-8c1e17feb2fc req-40ad81ff-5c98-4327-a4e8-2a936459de15 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] No waiting events found dispatching network-vif-plugged-35b9955c-a82a-42b9-a936-5f3429cda375 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:06:38 user nova-compute[72782]: WARNING nova.compute.manager [req-53f06e9f-f0f1-4df5-b40f-8c1e17feb2fc req-40ad81ff-5c98-4327-a4e8-2a936459de15 service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Received unexpected event network-vif-plugged-35b9955c-a82a-42b9-a936-5f3429cda375 for instance with vm_state active and task_state deleting.
Aug 14 20:06:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-b9777ec7-bd02-4cc6-8b35-c06f525686fa req-0712ca30-0a1a-4d54-9d26-b5afdfc113ac service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Received event network-vif-deleted-35b9955c-a82a-42b9-a936-5f3429cda375 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:06:38 user nova-compute[72782]: INFO nova.compute.manager [req-b9777ec7-bd02-4cc6-8b35-c06f525686fa req-0712ca30-0a1a-4d54-9d26-b5afdfc113ac service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Neutron deleted interface 35b9955c-a82a-42b9-a936-5f3429cda375; detaching it from the instance and deleting it from the info cache
Aug 14 20:06:38 user nova-compute[72782]: DEBUG nova.network.neutron [req-b9777ec7-bd02-4cc6-8b35-c06f525686fa req-0712ca30-0a1a-4d54-9d26-b5afdfc113ac service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:06:38 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:06:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-b9777ec7-bd02-4cc6-8b35-c06f525686fa req-0712ca30-0a1a-4d54-9d26-b5afdfc113ac service nova] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Detach interface failed, port_id=35b9955c-a82a-42b9-a936-5f3429cda375, reason: Instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69 could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 20:06:38 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Took 0.71 seconds to deallocate network for instance.
Aug 14 20:06:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:06:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:06:38 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:06:38 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:06:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:38 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Deleted allocations for instance 259c51df-ccd6-456e-85f4-7aaf4cba2b69
Aug 14 20:06:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f48d8905-8737-4c50-9f77-30c8709fd640 tempest-ServerActionsTestOtherA-956209876 tempest-ServerActionsTestOtherA-956209876-project-member] Lock "259c51df-ccd6-456e-85f4-7aaf4cba2b69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.090s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:06:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:06:52 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692043597.7804682, 259c51df-ccd6-456e-85f4-7aaf4cba2b69 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:06:52 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] VM Stopped (Lifecycle Event)
Aug 14 20:06:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-34670508-6be8-480e-9637-b117ceee3893 None None] [instance: 259c51df-ccd6-456e-85f4-7aaf4cba2b69] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:06:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:06:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:06:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:06:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:06:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:06:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:07:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:03 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:07:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "30923083-4653-4765-a462-4037325fa001" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:07:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "30923083-4653-4765-a462-4037325fa001" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:07:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:07:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:07:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:07:05 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:07:05 user nova-compute[72782]: INFO nova.compute.claims [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Claim successful on node user
Aug 14 20:07:05 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:07:05 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:07:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:07:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:07:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:07:05 user nova-compute[72782]: DEBUG nova.network.neutron [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:07:05 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:07:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG nova.policy [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2d39528bc994a25b9e6fea9f6b8b34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14952037d1dc44e7b64d0663c7a033c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:07:06 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Creating image(s)
Aug 14 20:07:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "/opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "/opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "/opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.209s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.202s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk 1073741824" returned: 0 in 0.067s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:06 user nova-compute[72782]: DEBUG nova.network.neutron [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Successfully created port: 11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:07:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:07 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Cannot resize image /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 20:07:07 user nova-compute[72782]: DEBUG nova.objects.instance [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'migration_context' on Instance uuid 30923083-4653-4765-a462-4037325fa001 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:07:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:07:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:07:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Ensure instance console log exists: /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:07:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:07:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:07:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:07:07 user nova-compute[72782]: DEBUG nova.network.neutron [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Successfully updated port: 11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:07:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:07:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquired lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:07:07 user nova-compute[72782]: DEBUG nova.network.neutron [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:07:07 user nova-compute[72782]: DEBUG nova.compute.manager [req-16b94e3b-2dc0-42bf-8a0b-3d31b8209752 req-062c4492-2fa2-4265-8606-1193a8c6a447 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-changed-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:07:07 user nova-compute[72782]: DEBUG nova.compute.manager [req-16b94e3b-2dc0-42bf-8a0b-3d31b8209752 req-062c4492-2fa2-4265-8606-1193a8c6a447 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Refreshing instance network info cache due to event network-changed-11c9663c-f497-486e-b56b-020a2fd52c7c. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:07:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-16b94e3b-2dc0-42bf-8a0b-3d31b8209752 req-062c4492-2fa2-4265-8606-1193a8c6a447 service nova] Acquiring lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:07:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:07 user nova-compute[72782]: DEBUG nova.network.neutron [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.network.neutron [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Updating instance_info_cache with network_info: [{"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Releasing lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Instance network_info: |[{"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-16b94e3b-2dc0-42bf-8a0b-3d31b8209752 req-062c4492-2fa2-4265-8606-1193a8c6a447 service nova] Acquired lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.network.neutron [req-16b94e3b-2dc0-42bf-8a0b-3d31b8209752 req-062c4492-2fa2-4265-8606-1193a8c6a447 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Refreshing network info cache for port 11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Start _get_guest_xml network_info=[{"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:07:08 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:07:08 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-795552024',display_name='tempest-ServerRescueNegativeTestJSON-server-795552024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-795552024',id=36,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0yiT3zmo5sbJrskDDUxxyeV2VbJzCC2El/Wjm1lTyYi81OHOFnxFqeipFhtycgKjN0MNr9muEG5d15oXDQCVTcCdiqVAjoavh52Vv74S2H6TcEcZ+gnfSFbbJQuyLqAg==',key_name='tempest-keypair-600129027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14952037d1dc44e7b64d0663c7a033c8',ramdisk_id='',reservation_id='r-w9x8ccbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1321611883',owner_user_name='tempest-ServerRescueNegativeTestJSON-1321611883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:07:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2d39528bc994a25b9e6fea9f6b8b34c',uuid=30923083-4653-4765-a462-4037325fa001,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converting VIF {"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:1f:99,bridge_name='br-int',has_traffic_filtering=True,id=11c9663c-f497-486e-b56b-020a2fd52c7c,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c9663c-f4') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.objects.instance [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'pci_devices' on Instance uuid 30923083-4653-4765-a462-4037325fa001 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:07:08 user nova-compute[72782]:   <uuid>30923083-4653-4765-a462-4037325fa001</uuid>
Aug 14 20:07:08 user nova-compute[72782]:   <name>instance-00000024</name>
Aug 14 20:07:08 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:07:08 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:07:08 user nova-compute[72782]:   <metadata>
Aug 14 20:07:08 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:07:08 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:07:08 user nova-compute[72782]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-795552024</nova:name>
Aug 14 20:07:08 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:07:08</nova:creationTime>
Aug 14 20:07:08 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:07:08 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:07:08 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:07:08 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:07:08 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:07:08 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:07:08 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:07:08 user nova-compute[72782]:       <nova:owner>
Aug 14 20:07:08 user nova-compute[72782]:         <nova:user uuid="d2d39528bc994a25b9e6fea9f6b8b34c">tempest-ServerRescueNegativeTestJSON-1321611883-project-member</nova:user>
Aug 14 20:07:08 user nova-compute[72782]:         <nova:project uuid="14952037d1dc44e7b64d0663c7a033c8">tempest-ServerRescueNegativeTestJSON-1321611883</nova:project>
Aug 14 20:07:08 user nova-compute[72782]:       </nova:owner>
Aug 14 20:07:08 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 20:07:08 user nova-compute[72782]:       <nova:ports>
Aug 14 20:07:08 user nova-compute[72782]:         <nova:port uuid="11c9663c-f497-486e-b56b-020a2fd52c7c">
Aug 14 20:07:08 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 20:07:08 user nova-compute[72782]:         </nova:port>
Aug 14 20:07:08 user nova-compute[72782]:       </nova:ports>
Aug 14 20:07:08 user nova-compute[72782]:     </nova:instance>
Aug 14 20:07:08 user nova-compute[72782]:   </metadata>
Aug 14 20:07:08 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:07:08 user nova-compute[72782]:     <system>
Aug 14 20:07:08 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:07:08 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:07:08 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:07:08 user nova-compute[72782]:       <entry name="serial">30923083-4653-4765-a462-4037325fa001</entry>
Aug 14 20:07:08 user nova-compute[72782]:       <entry name="uuid">30923083-4653-4765-a462-4037325fa001</entry>
Aug 14 20:07:08 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:07:08 user nova-compute[72782]:     </system>
Aug 14 20:07:08 user nova-compute[72782]:   </sysinfo>
Aug 14 20:07:08 user nova-compute[72782]:   <os>
Aug 14 20:07:08 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:07:08 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:07:08 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:07:08 user nova-compute[72782]:   </os>
Aug 14 20:07:08 user nova-compute[72782]:   <features>
Aug 14 20:07:08 user nova-compute[72782]:     <acpi/>
Aug 14 20:07:08 user nova-compute[72782]:     <apic/>
Aug 14 20:07:08 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:07:08 user nova-compute[72782]:   </features>
Aug 14 20:07:08 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:07:08 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:07:08 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:07:08 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:07:08 user nova-compute[72782]:   </clock>
Aug 14 20:07:08 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:07:08 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:07:08 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:07:08 user nova-compute[72782]:   </cpu>
Aug 14 20:07:08 user nova-compute[72782]:   <devices>
Aug 14 20:07:08 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:07:08 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:07:08 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk"/>
Aug 14 20:07:08 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:07:08 user nova-compute[72782]:     </disk>
Aug 14 20:07:08 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:07:08 user nova-compute[72782]:       <mac address="fa:16:3e:8e:1f:99"/>
Aug 14 20:07:08 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:07:08 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:07:08 user nova-compute[72782]:       <target dev="tap11c9663c-f4"/>
Aug 14 20:07:08 user nova-compute[72782]:     </interface>
Aug 14 20:07:08 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:07:08 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/console.log" append="off"/>
Aug 14 20:07:08 user nova-compute[72782]:     </serial>
Aug 14 20:07:08 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:07:08 user nova-compute[72782]:     <video>
Aug 14 20:07:08 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:07:08 user nova-compute[72782]:     </video>
Aug 14 20:07:08 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:07:08 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:07:08 user nova-compute[72782]:     </rng>
Aug 14 20:07:08 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:07:08 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:07:08 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:07:08 user nova-compute[72782]:     </memballoon>
Aug 14 20:07:08 user nova-compute[72782]:   </devices>
Aug 14 20:07:08 user nova-compute[72782]: </domain>
Aug 14 20:07:08 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-795552024',display_name='tempest-ServerRescueNegativeTestJSON-server-795552024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-795552024',id=36,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0yiT3zmo5sbJrskDDUxxyeV2VbJzCC2El/Wjm1lTyYi81OHOFnxFqeipFhtycgKjN0MNr9muEG5d15oXDQCVTcCdiqVAjoavh52Vv74S2H6TcEcZ+gnfSFbbJQuyLqAg==',key_name='tempest-keypair-600129027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14952037d1dc44e7b64d0663c7a033c8',ramdisk_id='',reservation_id='r-w9x8ccbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1321611883',owner_user_name='tempest-ServerRescueNegativeTestJSON-1321611883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:07:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2d39528bc994a25b9e6fea9f6b8b34c',uuid=30923083-4653-4765-a462-4037325fa001,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converting VIF {"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:1f:99,bridge_name='br-int',has_traffic_filtering=True,id=11c9663c-f497-486e-b56b-020a2fd52c7c,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c9663c-f4') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG os_vif [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:1f:99,bridge_name='br-int',has_traffic_filtering=True,id=11c9663c-f497-486e-b56b-020a2fd52c7c,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c9663c-f4') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11c9663c-f4, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap11c9663c-f4, col_values=(('external_ids', {'iface-id': '11c9663c-f497-486e-b56b-020a2fd52c7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:1f:99', 'vm-uuid': '30923083-4653-4765-a462-4037325fa001'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:08 user nova-compute[72782]: INFO os_vif [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:1f:99,bridge_name='br-int',has_traffic_filtering=True,id=11c9663c-f497-486e-b56b-020a2fd52c7c,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c9663c-f4')
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] No VIF found with MAC fa:16:3e:8e:1f:99, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.network.neutron [req-16b94e3b-2dc0-42bf-8a0b-3d31b8209752 req-062c4492-2fa2-4265-8606-1193a8c6a447 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Updated VIF entry in instance network info cache for port 11c9663c-f497-486e-b56b-020a2fd52c7c. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG nova.network.neutron [req-16b94e3b-2dc0-42bf-8a0b-3d31b8209752 req-062c4492-2fa2-4265-8606-1193a8c6a447 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Updating instance_info_cache with network_info: [{"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:07:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-16b94e3b-2dc0-42bf-8a0b-3d31b8209752 req-062c4492-2fa2-4265-8606-1193a8c6a447 service nova] Releasing lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:07:09 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:07:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:07:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-13201da3-4908-4724-9759-100190ed16d3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:07:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-13201da3-4908-4724-9759-100190ed16d3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:07:09 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 13201da3-4908-4724-9759-100190ed16d3] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:07:09 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 13201da3-4908-4724-9759-100190ed16d3] Updating instance_info_cache with network_info: [{"id": "32808424-a985-4d95-9900-fd909afa9e66", "address": "fa:16:3e:8f:3b:73", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32808424-a9", "ovs_interfaceid": "32808424-a985-4d95-9900-fd909afa9e66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:07:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-13201da3-4908-4724-9759-100190ed16d3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:07:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 13201da3-4908-4724-9759-100190ed16d3] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:07:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:09 user nova-compute[72782]: DEBUG nova.compute.manager [req-e5c1ba54-118c-45c6-ae3b-40eed4826a6c req-35b7a353-634e-454f-af29-9e7def4789f6 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:07:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e5c1ba54-118c-45c6-ae3b-40eed4826a6c req-35b7a353-634e-454f-af29-9e7def4789f6 service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:07:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e5c1ba54-118c-45c6-ae3b-40eed4826a6c req-35b7a353-634e-454f-af29-9e7def4789f6 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:07:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e5c1ba54-118c-45c6-ae3b-40eed4826a6c req-35b7a353-634e-454f-af29-9e7def4789f6 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:07:09 user nova-compute[72782]: DEBUG nova.compute.manager [req-e5c1ba54-118c-45c6-ae3b-40eed4826a6c req-35b7a353-634e-454f-af29-9e7def4789f6 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:07:09 user nova-compute[72782]: WARNING nova.compute.manager [req-e5c1ba54-118c-45c6-ae3b-40eed4826a6c req-35b7a353-634e-454f-af29-9e7def4789f6 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state building and task_state spawning.
Aug 14 20:07:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:07:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:07:10 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043631.7421825, 30923083-4653-4765-a462-4037325fa001 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:07:11 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] VM Resumed (Lifecycle Event)
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:07:11 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 30923083-4653-4765-a462-4037325fa001] Instance spawned successfully.
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:07:11 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043631.7431638, 30923083-4653-4765-a462-4037325fa001 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:07:11 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] VM Started (Lifecycle Event)
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:07:11 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:07:11 user nova-compute[72782]: INFO nova.compute.manager [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Took 5.76 seconds to spawn the instance on the hypervisor.
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-f2d4ea00-df14-4408-b6df-ff339828532f req-d5130b79-1fb1-4eab-8a68-8b3bba1e0618 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f2d4ea00-df14-4408-b6df-ff339828532f req-d5130b79-1fb1-4eab-8a68-8b3bba1e0618 service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f2d4ea00-df14-4408-b6df-ff339828532f req-d5130b79-1fb1-4eab-8a68-8b3bba1e0618 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f2d4ea00-df14-4408-b6df-ff339828532f req-d5130b79-1fb1-4eab-8a68-8b3bba1e0618 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-f2d4ea00-df14-4408-b6df-ff339828532f req-d5130b79-1fb1-4eab-8a68-8b3bba1e0618 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:07:11 user nova-compute[72782]: WARNING nova.compute.manager [req-f2d4ea00-df14-4408-b6df-ff339828532f req-d5130b79-1fb1-4eab-8a68-8b3bba1e0618 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state building and task_state spawning.
Aug 14 20:07:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:11 user nova-compute[72782]: INFO nova.compute.manager [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Took 6.53 seconds to build instance.
Aug 14 20:07:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ca279c-a3a6-4e0d-adf5-d96f50c0a429 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "30923083-4653-4765-a462-4037325fa001" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.649s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:07:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:07:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:13 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:07:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:14 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:07:14 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:07:14 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8028MB free_disk=25.22805404663086GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:07:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:07:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:07:14 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:07:14 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ad4011a9-ab9f-4647-b677-a1c6337d2c2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:07:14 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:07:14 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2c924d52-aa8a-47ed-857c-b863efe95258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:07:14 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 13201da3-4908-4724-9759-100190ed16d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:07:14 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance af6fee00-a067-4674-a356-f4f1c8d9f5db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:07:14 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 97e433e6-da66-4095-b9c3-67a32c90c2c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:07:14 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 30923083-4653-4765-a462-4037325fa001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:07:14 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:07:14 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:07:14 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:07:14 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:07:15 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:07:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.389s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:07:16 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:07:16 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:07:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:07:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:07:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:07:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:07:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:07:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:07:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:07:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:07:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:07:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:07:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:07:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:07:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-8b5fbf65-3d35-4df4-a8ab-b7ddae9ea209 req-d5e1443f-a032-456d-b20c-004f83114696 service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Received event network-changed-d5db7d03-7af8-4a92-92ac-f6b244683d38 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-8b5fbf65-3d35-4df4-a8ab-b7ddae9ea209 req-d5e1443f-a032-456d-b20c-004f83114696 service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Refreshing instance network info cache due to event network-changed-d5db7d03-7af8-4a92-92ac-f6b244683d38. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8b5fbf65-3d35-4df4-a8ab-b7ddae9ea209 req-d5e1443f-a032-456d-b20c-004f83114696 service nova] Acquiring lock "refresh_cache-97e433e6-da66-4095-b9c3-67a32c90c2c6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8b5fbf65-3d35-4df4-a8ab-b7ddae9ea209 req-d5e1443f-a032-456d-b20c-004f83114696 service nova] Acquired lock "refresh_cache-97e433e6-da66-4095-b9c3-67a32c90c2c6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG nova.network.neutron [req-8b5fbf65-3d35-4df4-a8ab-b7ddae9ea209 req-d5e1443f-a032-456d-b20c-004f83114696 service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Refreshing network info cache for port d5db7d03-7af8-4a92-92ac-f6b244683d38 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "97e433e6-da66-4095-b9c3-67a32c90c2c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG nova.objects.instance [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lazy-loading 'flavor' on Instance uuid 97e433e6-da66-4095-b9c3-67a32c90c2c6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:07:52 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Ignoring supplied device name: /dev/vdb
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "97e433e6-da66-4095-b9c3-67a32c90c2c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:07:52 user nova-compute[72782]: INFO nova.compute.manager [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Attaching volume 7eee9112-2f4e-43ef-8e64-b298b7458b98 to /dev/vdb
Aug 14 20:07:52 user nova-compute[72782]: DEBUG nova.network.neutron [req-8b5fbf65-3d35-4df4-a8ab-b7ddae9ea209 req-d5e1443f-a032-456d-b20c-004f83114696 service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Updated VIF entry in instance network info cache for port d5db7d03-7af8-4a92-92ac-f6b244683d38. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG nova.network.neutron [req-8b5fbf65-3d35-4df4-a8ab-b7ddae9ea209 req-d5e1443f-a032-456d-b20c-004f83114696 service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Updating instance_info_cache with network_info: [{"id": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "address": "fa:16:3e:a6:79:aa", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5db7d03-7a", "ovs_interfaceid": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8b5fbf65-3d35-4df4-a8ab-b7ddae9ea209 req-d5e1443f-a032-456d-b20c-004f83114696 service nova] Releasing lock "refresh_cache-97e433e6-da66-4095-b9c3-67a32c90c2c6" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG os_brick.utils [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a611cf3-4dab-450a-b3aa-d1f776fdf839]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e983fa-4a7d-4ae9-835d-3a3eab3b9cd1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b410b131-8d76-45d2-a929-a803d7868f1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[552c9124-dd03-4722-8bf3-e3216f46f72d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:07:52 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:07:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[42be1040-01ca-4df0-a198-b6fa460cbbff]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG os_brick.utils [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:07:52 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Updating existing volume attachment record: f2ad6885-c8b9-4655-8e72-6833fe2a3022 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:07:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:07:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gSlpmurq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:08:01 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:08:01 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:08:01 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73a9ba1-18b2-45b9-b8ed-f2977d8cc78c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:08:01 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a23eef9-deb0-4eb4-b11a-88cf65c931c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98] added
Aug 14 20:08:01 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a6b6f8-2014-4f8a-b4d1-beec911acca6]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[89938247-89e1-4ed0-859d-250918e247f7]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gSlpmurq {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gSlpmurq" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85e0019-d230-450a-8e47-e6d8a957b402]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gSlpmurq'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff94cc9f-9792-4a3b-990c-22b7fa6d76bf]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7ce870-22bc-4461-bbe2-d8a885279fc4]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:08:01 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:08:01 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:08:01 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:08:01 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f17aa6-0da4-4f4e-8730-adbdabedbc6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98, portal: 172.16.0.220,3260]
Aug 14 20:08:01 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98, portal: 172.16.0.220,3260] successful.
Aug 14 20:08:01 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b4ff56-1155-41bf-a5df-af035678219f]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ab5121-f459-4cea-b358-792946cc4276]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:08:01 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:08:01 user nova-compute[72782]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 (non-flash)
Aug 14 20:08:01 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:08:01 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:08:01 user nova-compute[72782]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 (non-flash)
Aug 14 20:08:01 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c311d4-badd-4b0e-9576-aab63e2a17e0]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:08:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gSlpmurq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:08:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:08:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23036646534333164', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:08:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036646534333164', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:08:02 user nova-compute[72782]: DEBUG nova.objects.instance [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lazy-loading 'flavor' on Instance uuid 97e433e6-da66-4095-b9c3-67a32c90c2c6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:08:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 20:08:02 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:08:02 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:08:02 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:08:02 user nova-compute[72782]:   <serial>7eee9112-2f4e-43ef-8e64-b298b7458b98</serial>
Aug 14 20:08:02 user nova-compute[72782]: </disk>
Aug 14 20:08:02 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 20:08:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:08:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:08:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] No VIF found with MAC fa:16:3e:a6:79:aa, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:08:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a5ee722d-37c4-4e1e-aa5c-50abca74fc3a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.582s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:08:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:05 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:08:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:08:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:08:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:08:10 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:08:11 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:08:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:08:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:08:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-3c2df162-332c-4391-95b8-223e07546d74" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:08:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-3c2df162-332c-4391-95b8-223e07546d74" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:08:11 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:08:11 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 3c2df162-332c-4391-95b8-223e07546d74 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:08:11 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Updating instance_info_cache with network_info: [{"id": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "address": "fa:16:3e:fe:b9:74", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb361406-de", "ovs_interfaceid": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:08:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-3c2df162-332c-4391-95b8-223e07546d74" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:08:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:08:13 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:08:13 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:08:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:08:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:08:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:08:13 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:08:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:08:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:08:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:08:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:08:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:16 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:08:16 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:08:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=7936MB free_disk=25.197612762451172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:08:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:08:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:08:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:08:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ad4011a9-ab9f-4647-b677-a1c6337d2c2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:08:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:08:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2c924d52-aa8a-47ed-857c-b863efe95258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:08:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 13201da3-4908-4724-9759-100190ed16d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:08:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance af6fee00-a067-4674-a356-f4f1c8d9f5db actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:08:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 97e433e6-da66-4095-b9c3-67a32c90c2c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:08:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 30923083-4653-4765-a462-4037325fa001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:08:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:08:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:08:17 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:08:17 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:08:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:08:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:08:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:08:19 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:08:19 user nova-compute[72782]: INFO nova.compute.manager [None req-3b129ffc-f2f3-4345-9e6e-0f856f3e8df1 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Unrescuing
Aug 14 20:08:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3b129ffc-f2f3-4345-9e6e-0f856f3e8df1 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "refresh_cache-af6fee00-a067-4674-a356-f4f1c8d9f5db" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:08:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3b129ffc-f2f3-4345-9e6e-0f856f3e8df1 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquired lock "refresh_cache-af6fee00-a067-4674-a356-f4f1c8d9f5db" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:08:19 user nova-compute[72782]: DEBUG nova.network.neutron [None req-3b129ffc-f2f3-4345-9e6e-0f856f3e8df1 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:08:19 user nova-compute[72782]: DEBUG nova.network.neutron [None req-3b129ffc-f2f3-4345-9e6e-0f856f3e8df1 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Updating instance_info_cache with network_info: [{"id": "bd96dc7a-44be-41db-9036-538ca592c701", "address": "fa:16:3e:4a:23:dd", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd96dc7a-44", "ovs_interfaceid": "bd96dc7a-44be-41db-9036-538ca592c701", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:08:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3b129ffc-f2f3-4345-9e6e-0f856f3e8df1 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Releasing lock "refresh_cache-af6fee00-a067-4674-a356-f4f1c8d9f5db" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:08:19 user nova-compute[72782]: DEBUG nova.objects.instance [None req-3b129ffc-f2f3-4345-9e6e-0f856f3e8df1 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'flavor' on Instance uuid af6fee00-a067-4674-a356-f4f1c8d9f5db {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:08:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-eb247f8a-a571-43c7-852b-15cd588c504e req-dc350055-e591-478d-ba34-1666c853b1af service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received event network-vif-unplugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:08:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eb247f8a-a571-43c7-852b-15cd588c504e req-dc350055-e591-478d-ba34-1666c853b1af service nova] Acquiring lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:08:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eb247f8a-a571-43c7-852b-15cd588c504e req-dc350055-e591-478d-ba34-1666c853b1af service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:08:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eb247f8a-a571-43c7-852b-15cd588c504e req-dc350055-e591-478d-ba34-1666c853b1af service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:08:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-eb247f8a-a571-43c7-852b-15cd588c504e req-dc350055-e591-478d-ba34-1666c853b1af service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] No waiting events found dispatching network-vif-unplugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:08:20 user nova-compute[72782]: WARNING nova.compute.manager [req-eb247f8a-a571-43c7-852b-15cd588c504e req-dc350055-e591-478d-ba34-1666c853b1af service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received unexpected event network-vif-unplugged-bd96dc7a-44be-41db-9036-538ca592c701 for instance with vm_state rescued and task_state unrescuing.
Aug 14 20:08:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:20 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Instance destroyed successfully.
Aug 14 20:08:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:22 user nova-compute[72782]: DEBUG nova.compute.manager [req-eb10a58a-059a-4d27-a08f-7053cc188871 req-9d40ed40-5ffb-407d-98b5-f0d3a250a4d4 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received event network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:08:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eb10a58a-059a-4d27-a08f-7053cc188871 req-9d40ed40-5ffb-407d-98b5-f0d3a250a4d4 service nova] Acquiring lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:08:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eb10a58a-059a-4d27-a08f-7053cc188871 req-9d40ed40-5ffb-407d-98b5-f0d3a250a4d4 service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:08:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eb10a58a-059a-4d27-a08f-7053cc188871 req-9d40ed40-5ffb-407d-98b5-f0d3a250a4d4 service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:08:22 user nova-compute[72782]: DEBUG nova.compute.manager [req-eb10a58a-059a-4d27-a08f-7053cc188871 req-9d40ed40-5ffb-407d-98b5-f0d3a250a4d4 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] No waiting events found dispatching network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:08:22 user nova-compute[72782]: WARNING nova.compute.manager [req-eb10a58a-059a-4d27-a08f-7053cc188871 req-9d40ed40-5ffb-407d-98b5-f0d3a250a4d4 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received unexpected event network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 for instance with vm_state rescued and task_state unrescuing.
Aug 14 20:08:22 user nova-compute[72782]: DEBUG nova.compute.manager [req-eb10a58a-059a-4d27-a08f-7053cc188871 req-9d40ed40-5ffb-407d-98b5-f0d3a250a4d4 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received event network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:08:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eb10a58a-059a-4d27-a08f-7053cc188871 req-9d40ed40-5ffb-407d-98b5-f0d3a250a4d4 service nova] Acquiring lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:08:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eb10a58a-059a-4d27-a08f-7053cc188871 req-9d40ed40-5ffb-407d-98b5-f0d3a250a4d4 service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:08:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eb10a58a-059a-4d27-a08f-7053cc188871 req-9d40ed40-5ffb-407d-98b5-f0d3a250a4d4 service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:08:22 user nova-compute[72782]: DEBUG nova.compute.manager [req-eb10a58a-059a-4d27-a08f-7053cc188871 req-9d40ed40-5ffb-407d-98b5-f0d3a250a4d4 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] No waiting events found dispatching network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:08:22 user nova-compute[72782]: WARNING nova.compute.manager [req-eb10a58a-059a-4d27-a08f-7053cc188871 req-9d40ed40-5ffb-407d-98b5-f0d3a250a4d4 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received unexpected event network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 for instance with vm_state rescued and task_state unrescuing.
Aug 14 20:08:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Removed pending event for af6fee00-a067-4674-a356-f4f1c8d9f5db due to event {{(pid=72782) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 20:08:24 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043704.048684, af6fee00-a067-4674-a356-f4f1c8d9f5db => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:08:24 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] VM Resumed (Lifecycle Event)
Aug 14 20:08:24 user nova-compute[72782]: DEBUG nova.compute.manager [None req-3b129ffc-f2f3-4345-9e6e-0f856f3e8df1 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:08:24 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:08:24 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:08:24 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 20:08:24 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043704.0499313, af6fee00-a067-4674-a356-f4f1c8d9f5db => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:08:24 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] VM Started (Lifecycle Event)
Aug 14 20:08:24 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:08:24 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:08:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-5cf8223f-92af-4eba-b788-a97c8631b2e6 req-de911746-1378-49a9-99ff-a3176f1ed3b8 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received event network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:08:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5cf8223f-92af-4eba-b788-a97c8631b2e6 req-de911746-1378-49a9-99ff-a3176f1ed3b8 service nova] Acquiring lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:08:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5cf8223f-92af-4eba-b788-a97c8631b2e6 req-de911746-1378-49a9-99ff-a3176f1ed3b8 service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:08:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5cf8223f-92af-4eba-b788-a97c8631b2e6 req-de911746-1378-49a9-99ff-a3176f1ed3b8 service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:08:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-5cf8223f-92af-4eba-b788-a97c8631b2e6 req-de911746-1378-49a9-99ff-a3176f1ed3b8 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] No waiting events found dispatching network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:08:24 user nova-compute[72782]: WARNING nova.compute.manager [req-5cf8223f-92af-4eba-b788-a97c8631b2e6 req-de911746-1378-49a9-99ff-a3176f1ed3b8 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received unexpected event network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 for instance with vm_state active and task_state None.
Aug 14 20:08:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:08:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:08:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:08:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:08:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:08:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "97e433e6-da66-4095-b9c3-67a32c90c2c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:08:38 user nova-compute[72782]: INFO nova.compute.manager [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Detaching volume 7eee9112-2f4e-43ef-8e64-b298b7458b98
Aug 14 20:08:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:38 user nova-compute[72782]: INFO nova.virt.block_device [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Attempting to driver detach volume 7eee9112-2f4e-43ef-8e64-b298b7458b98 from mountpoint /dev/vdb
Aug 14 20:08:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Attempting to detach device vdb from instance 97e433e6-da66-4095-b9c3-67a32c90c2c6 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:08:38 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:08:38 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:08:38 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:08:38 user nova-compute[72782]:   <serial>7eee9112-2f4e-43ef-8e64-b298b7458b98</serial>
Aug 14 20:08:38 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 20:08:38 user nova-compute[72782]: </disk>
Aug 14 20:08:38 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:08:38 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Successfully detached device vdb from instance 97e433e6-da66-4095-b9c3-67a32c90c2c6 from the persistent domain config.
Aug 14 20:08:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97e433e6-da66-4095-b9c3-67a32c90c2c6 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:08:38 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:08:38 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:08:38 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:08:38 user nova-compute[72782]:   <serial>7eee9112-2f4e-43ef-8e64-b298b7458b98</serial>
Aug 14 20:08:38 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 20:08:38 user nova-compute[72782]: </disk>
Aug 14 20:08:38 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "97e433e6-da66-4095-b9c3-67a32c90c2c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692043718.8081007, 97e433e6-da66-4095-b9c3-67a32c90c2c6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97e433e6-da66-4095-b9c3-67a32c90c2c6 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 20:08:38 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Successfully detached device vdb from instance 97e433e6-da66-4095-b9c3-67a32c90c2c6 from the live domain config.
Aug 14 20:08:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gSlpmurq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:08:38 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:08:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c391be19-2002-4382-8199-04b649a09078]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e801ea26-b927-44fb-805e-76e253653d29]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:08:38 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:08:38 user nova-compute[72782]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 (non-flash)
Aug 14 20:08:38 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:08:38 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:08:38 user nova-compute[72782]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 (non-flash)
Aug 14 20:08:38 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6419922290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4fa2e0-fe28-44d5-852e-159aa75e7233]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa05df0-7d0a-476f-8baf-32058e72dc7f]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[badb1fe3-2b20-4d5e-8875-a40c1829d937]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[00198e7b-eef4-4229-91db-84730576f817]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:08:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0a1c32-0649-4f69-a317-4d5da9a42c28]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff34a471-340b-487d-ae0c-d13f25f80959]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98, portal: 172.16.0.220,3260]
Aug 14 20:08:39 user nova-compute[72782]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98, portal: 172.16.0.220,3260] successful.
Aug 14 20:08:39 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da74277-59bd-461d-9551-b509a14cc3df]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] <== disconnect_volume: return (275ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG nova.objects.instance [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lazy-loading 'flavor' on Instance uuid 97e433e6-da66-4095-b9c3-67a32c90c2c6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c4ab61c1-bc17-463f-9b6a-bc7a37b2aea0 tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.695s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.579s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "97e433e6-da66-4095-b9c3-67a32c90c2c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:08:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:08:39 user nova-compute[72782]: INFO nova.compute.manager [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Terminating instance
Aug 14 20:08:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG nova.compute.manager [req-ea088ffe-a5fa-44c6-8a8b-5c92d992b186 req-58249591-6364-4d7e-bec4-feb246db37a2 service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Received event network-vif-unplugged-d5db7d03-7af8-4a92-92ac-f6b244683d38 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ea088ffe-a5fa-44c6-8a8b-5c92d992b186 req-58249591-6364-4d7e-bec4-feb246db37a2 service nova] Acquiring lock "97e433e6-da66-4095-b9c3-67a32c90c2c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ea088ffe-a5fa-44c6-8a8b-5c92d992b186 req-58249591-6364-4d7e-bec4-feb246db37a2 service nova] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ea088ffe-a5fa-44c6-8a8b-5c92d992b186 req-58249591-6364-4d7e-bec4-feb246db37a2 service nova] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG nova.compute.manager [req-ea088ffe-a5fa-44c6-8a8b-5c92d992b186 req-58249591-6364-4d7e-bec4-feb246db37a2 service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] No waiting events found dispatching network-vif-unplugged-d5db7d03-7af8-4a92-92ac-f6b244683d38 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG nova.compute.manager [req-ea088ffe-a5fa-44c6-8a8b-5c92d992b186 req-58249591-6364-4d7e-bec4-feb246db37a2 service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Received event network-vif-unplugged-d5db7d03-7af8-4a92-92ac-f6b244683d38 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:40 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Instance destroyed successfully.
Aug 14 20:08:40 user nova-compute[72782]: DEBUG nova.objects.instance [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lazy-loading 'resources' on Instance uuid 97e433e6-da66-4095-b9c3-67a32c90c2c6 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1235784613',display_name='tempest-VolumesSnapshotTestJSON-instance-1235784613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1235784613',id=35,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUgeH+NS2oJyzKReXsgAaXUcSl5uXJPmR3kkgrnlWa5Yl4SbEt+eVE9oTCkwwe1ZYyKIH0FaxqLee4mBUf3lI+mK7EQcPtaJTKhlHyeYueNbhTAd4PbKXKLLiY2ZWOaSA==',key_name='tempest-keypair-1687860797',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:06:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='074449bc387c4ae4b0c8325a98a42b85',ramdisk_id='',reservation_id='r-vh47rdqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-738905962',owner_user_name='tempest-VolumesSnapshotTestJSON-738905962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:06:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b05d2dbed8be48fb811a0acf350d9765',uuid=97e433e6-da66-4095-b9c3-67a32c90c2c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "address": "fa:16:3e:a6:79:aa", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5db7d03-7a", "ovs_interfaceid": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Converting VIF {"id": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "address": "fa:16:3e:a6:79:aa", "network": {"id": "2aca477c-9ad7-4708-8466-7934911f13d3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-45530356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "074449bc387c4ae4b0c8325a98a42b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5db7d03-7a", "ovs_interfaceid": "d5db7d03-7af8-4a92-92ac-f6b244683d38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:79:aa,bridge_name='br-int',has_traffic_filtering=True,id=d5db7d03-7af8-4a92-92ac-f6b244683d38,network=Network(2aca477c-9ad7-4708-8466-7934911f13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5db7d03-7a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG os_vif [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:79:aa,bridge_name='br-int',has_traffic_filtering=True,id=d5db7d03-7af8-4a92-92ac-f6b244683d38,network=Network(2aca477c-9ad7-4708-8466-7934911f13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5db7d03-7a') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5db7d03-7a, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:08:40 user nova-compute[72782]: INFO os_vif [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:79:aa,bridge_name='br-int',has_traffic_filtering=True,id=d5db7d03-7af8-4a92-92ac-f6b244683d38,network=Network(2aca477c-9ad7-4708-8466-7934911f13d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5db7d03-7a')
Aug 14 20:08:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gSlpmurq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:08:40 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:08:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eee9112-2f4e-43ef-8e64-b298b7458b98', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[057f87c4-55c1-4d36-94d8-3a089c31c663]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95113d0-5a95-4172-a746-a13a375af4c9]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:08:40 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:08:40 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:08:40 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:08:40 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e85ab400>, {}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Disconnecting from: [] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] <== disconnect_volume: return (53ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:08:40 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Deleting instance files /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6_del
Aug 14 20:08:40 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Deletion of /opt/stack/data/nova/instances/97e433e6-da66-4095-b9c3-67a32c90c2c6_del complete
Aug 14 20:08:40 user nova-compute[72782]: INFO nova.compute.manager [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 14 20:08:40 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:08:40 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:08:41 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:08:41 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Took 0.91 seconds to deallocate network for instance.
Aug 14 20:08:41 user nova-compute[72782]: DEBUG nova.compute.manager [req-05e081a0-bc32-4357-8e7c-2dfea7326658 req-65a51fde-86c8-452e-837f-4565b072af2d service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Received event network-vif-deleted-d5db7d03-7af8-4a92-92ac-f6b244683d38 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:08:41 user nova-compute[72782]: WARNING nova.volume.cinder [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Attachment f2ad6885-c8b9-4655-8e72-6833fe2a3022 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = f2ad6885-c8b9-4655-8e72-6833fe2a3022. (HTTP 404) (Request-ID: req-56cbfb7d-9fdc-4e86-bd04-ad003c9030be)
Aug 14 20:08:41 user nova-compute[72782]: INFO nova.compute.manager [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Took 0.03 seconds to detach 1 volumes for instance.
Aug 14 20:08:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:08:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:08:42 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:08:42 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:08:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:08:42 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Deleted allocations for instance 97e433e6-da66-4095-b9c3-67a32c90c2c6
Aug 14 20:08:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-9b5fe6a2-2dd9-4e32-bd94-f1982e78de5a tempest-VolumesSnapshotTestJSON-738905962 tempest-VolumesSnapshotTestJSON-738905962-project-member] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.312s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:08:42 user nova-compute[72782]: DEBUG nova.compute.manager [req-504705af-f39b-4184-906b-35bc45958147 req-30838470-6477-4922-85d7-219deb2bb0a3 service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Received event network-vif-plugged-d5db7d03-7af8-4a92-92ac-f6b244683d38 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:08:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-504705af-f39b-4184-906b-35bc45958147 req-30838470-6477-4922-85d7-219deb2bb0a3 service nova] Acquiring lock "97e433e6-da66-4095-b9c3-67a32c90c2c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:08:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-504705af-f39b-4184-906b-35bc45958147 req-30838470-6477-4922-85d7-219deb2bb0a3 service nova] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:08:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-504705af-f39b-4184-906b-35bc45958147 req-30838470-6477-4922-85d7-219deb2bb0a3 service nova] Lock "97e433e6-da66-4095-b9c3-67a32c90c2c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:08:42 user nova-compute[72782]: DEBUG nova.compute.manager [req-504705af-f39b-4184-906b-35bc45958147 req-30838470-6477-4922-85d7-219deb2bb0a3 service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] No waiting events found dispatching network-vif-plugged-d5db7d03-7af8-4a92-92ac-f6b244683d38 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:08:42 user nova-compute[72782]: WARNING nova.compute.manager [req-504705af-f39b-4184-906b-35bc45958147 req-30838470-6477-4922-85d7-219deb2bb0a3 service nova] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Received unexpected event network-vif-plugged-d5db7d03-7af8-4a92-92ac-f6b244683d38 for instance with vm_state deleted and task_state None.
Aug 14 20:08:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:55 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692043720.7325962, 97e433e6-da66-4095-b9c3-67a32c90c2c6 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:08:55 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] VM Stopped (Lifecycle Event)
Aug 14 20:08:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-c0177070-87b8-418d-a114-5e801a07f604 None None] [instance: 97e433e6-da66-4095-b9c3-67a32c90c2c6] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:08:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG nova.compute.manager [req-27fcf81e-754a-49b0-bbc8-9dbdfebf9f50 req-b193a6ee-23cb-4878-9c3a-fba22293724a service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-changed-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG nova.compute.manager [req-27fcf81e-754a-49b0-bbc8-9dbdfebf9f50 req-b193a6ee-23cb-4878-9c3a-fba22293724a service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Refreshing instance network info cache due to event network-changed-11c9663c-f497-486e-b56b-020a2fd52c7c. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-27fcf81e-754a-49b0-bbc8-9dbdfebf9f50 req-b193a6ee-23cb-4878-9c3a-fba22293724a service nova] Acquiring lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-27fcf81e-754a-49b0-bbc8-9dbdfebf9f50 req-b193a6ee-23cb-4878-9c3a-fba22293724a service nova] Acquired lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG nova.network.neutron [req-27fcf81e-754a-49b0-bbc8-9dbdfebf9f50 req-b193a6ee-23cb-4878-9c3a-fba22293724a service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Refreshing network info cache for port 11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "30923083-4653-4765-a462-4037325fa001" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "30923083-4653-4765-a462-4037325fa001" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG nova.objects.instance [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'flavor' on Instance uuid 30923083-4653-4765-a462-4037325fa001 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "30923083-4653-4765-a462-4037325fa001" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "30923083-4653-4765-a462-4037325fa001" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "30923083-4653-4765-a462-4037325fa001" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:08:56 user nova-compute[72782]: INFO nova.compute.manager [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Attaching volume 01e84039-b08a-4e91-bac2-a408df3e1bba to /dev/vdb
Aug 14 20:08:56 user nova-compute[72782]: DEBUG os_brick.utils [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[307732f5-8f8e-49b5-97ef-6c990cc4cc7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2996aa-7514-4bc0-a5c6-ec7edde3247d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da706c0-65a1-4645-8569-bcc676dfa5b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5603017-5405-4997-a1c3-c4ffbb51247d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:08:56 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:08:56 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ef54d4-33fb-449b-8997-d4afa6c7efc5]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG os_brick.utils [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:08:56 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Updating existing volume attachment record: fd3678e3-bc36-41ae-867a-e0a2e7f1fb49 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:08:57 user nova-compute[72782]: DEBUG nova.network.neutron [req-27fcf81e-754a-49b0-bbc8-9dbdfebf9f50 req-b193a6ee-23cb-4878-9c3a-fba22293724a service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Updated VIF entry in instance network info cache for port 11c9663c-f497-486e-b56b-020a2fd52c7c. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:08:57 user nova-compute[72782]: DEBUG nova.network.neutron [req-27fcf81e-754a-49b0-bbc8-9dbdfebf9f50 req-b193a6ee-23cb-4878-9c3a-fba22293724a service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Updating instance_info_cache with network_info: [{"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:08:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-27fcf81e-754a-49b0-bbc8-9dbdfebf9f50 req-b193a6ee-23cb-4878-9c3a-fba22293724a service nova] Releasing lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:08:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:09:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:05 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:09:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:09:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:09:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:09:10 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:09:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:09:11 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:09:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:09:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-ad4011a9-ab9f-4647-b677-a1c6337d2c2c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:09:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-ad4011a9-ab9f-4647-b677-a1c6337d2c2c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:09:11 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:09:11 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Updating instance_info_cache with network_info: [{"id": "2858462d-1715-4c67-aee3-a0c15eac235b", "address": "fa:16:3e:f1:85:57", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2858462d-17", "ovs_interfaceid": "2858462d-1715-4c67-aee3-a0c15eac235b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:09:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-ad4011a9-ab9f-4647-b677-a1c6337d2c2c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:09:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:09:13 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:09:13 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:09:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:09:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:09:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:09:13 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:09:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:09:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgTLbzHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:09:15 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:09:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:09:15 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:09:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:09:15 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[953407b7-2f99-4a88-9b46-52abc441a7f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:09:15 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e929f9d-156f-4240-a81d-56c4d0bb010d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba] added
Aug 14 20:09:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4921690b-3054-467e-89a0-6369660d093a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[299ba0e6-ec1e-4d06-ab9f-a6eb8bb9b429]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgTLbzHI {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgTLbzHI" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8c1b5f-676f-40ba-ad7a-5a0edeb7b4b5]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VgTLbzHI'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[875e380a-0e83-463e-a58f-c5780ee7d56b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bc0bd3-d016-40fb-a4f9-fabf81b03c54]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:09:15 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:09:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:09:15 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:09:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:15 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:09:15 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:09:15 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8113MB free_disk=25.21636199951172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f10b91-63f3-4327-9200-f23d86c29020]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba, portal: 172.16.0.220,3260]
Aug 14 20:09:15 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba, portal: 172.16.0.220,3260] successful.
Aug 14 20:09:15 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:09:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[83841d57-11e8-447f-ba15-f3e70fcac6dc]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f069ee6-ab64-4111-abd4-e8c4f9971bbe]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:09:16 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:09:16 user nova-compute[72782]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba (non-flash)
Aug 14 20:09:16 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:09:16 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:09:16 user nova-compute[72782]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba (non-flash)
Aug 14 20:09:16 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.678s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be8eb65-8c5d-4270-a650-f6d2485c7aaf]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ad4011a9-ab9f-4647-b677-a1c6337d2c2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2c924d52-aa8a-47ed-857c-b863efe95258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 13201da3-4908-4724-9759-100190ed16d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance af6fee00-a067-4674-a356-f4f1c8d9f5db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 30923083-4653-4765-a462-4037325fa001 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:09:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:09:17 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:09:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgTLbzHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:09:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.705s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:09:17 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] <== connect_volume: return (1707ms) {'type': 'block', 'scsi_wwn': '26238393365613231', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:09:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238393365613231', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:09:17 user nova-compute[72782]: DEBUG nova.objects.instance [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'flavor' on Instance uuid 30923083-4653-4765-a462-4037325fa001 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:09:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 20:09:17 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:09:17 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:09:17 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:09:17 user nova-compute[72782]:   <serial>01e84039-b08a-4e91-bac2-a408df3e1bba</serial>
Aug 14 20:09:17 user nova-compute[72782]: </disk>
Aug 14 20:09:17 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 20:09:17 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:09:17 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:09:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:09:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:09:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] No VIF found with MAC fa:16:3e:8e:1f:99, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:09:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a35c460e-b4e9-4fcd-9289-9fa076b32005 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "30923083-4653-4765-a462-4037325fa001" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.017s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:09:18 user nova-compute[72782]: INFO nova.compute.manager [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Rescuing
Aug 14 20:09:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:09:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquired lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:09:18 user nova-compute[72782]: DEBUG nova.network.neutron [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:09:18 user nova-compute[72782]: DEBUG nova.network.neutron [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Updating instance_info_cache with network_info: [{"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:09:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Releasing lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:09:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-d4361ae0-51d8-4239-bdd0-b1ff27321f3d req-6113af1b-83e2-4ced-9f77-d9465b744438 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-unplugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d4361ae0-51d8-4239-bdd0-b1ff27321f3d req-6113af1b-83e2-4ced-9f77-d9465b744438 service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d4361ae0-51d8-4239-bdd0-b1ff27321f3d req-6113af1b-83e2-4ced-9f77-d9465b744438 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d4361ae0-51d8-4239-bdd0-b1ff27321f3d req-6113af1b-83e2-4ced-9f77-d9465b744438 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-d4361ae0-51d8-4239-bdd0-b1ff27321f3d req-6113af1b-83e2-4ced-9f77-d9465b744438 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-unplugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:09:19 user nova-compute[72782]: WARNING nova.compute.manager [req-d4361ae0-51d8-4239-bdd0-b1ff27321f3d req-6113af1b-83e2-4ced-9f77-d9465b744438 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-unplugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state active and task_state rescuing.
Aug 14 20:09:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:19 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 30923083-4653-4765-a462-4037325fa001] Instance destroyed successfully.
Aug 14 20:09:19 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Attempting rescue
Aug 14 20:09:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72782) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Instance directory exists: not creating {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 20:09:19 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Creating image(s)
Aug 14 20:09:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "/opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "/opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "/opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG nova.objects.instance [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'trusted_certs' on Instance uuid 30923083-4653-4765-a462-4037325fa001 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk.rescue {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk.rescue" returned: 0 in 0.051s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG nova.objects.instance [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'migration_context' on Instance uuid 30923083-4653-4765-a462-4037325fa001 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Start _get_guest_xml network_info=[{"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "vif_mac": "fa:16:3e:8e:1f:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG nova.objects.instance [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'resources' on Instance uuid 30923083-4653-4765-a462-4037325fa001 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:09:19 user nova-compute[72782]: DEBUG nova.objects.instance [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'numa_topology' on Instance uuid 30923083-4653-4765-a462-4037325fa001 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:09:20 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:09:20 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.objects.instance [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'vcpu_model' on Instance uuid 30923083-4653-4765-a462-4037325fa001 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-795552024',display_name='tempest-ServerRescueNegativeTestJSON-server-795552024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-795552024',id=36,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0yiT3zmo5sbJrskDDUxxyeV2VbJzCC2El/Wjm1lTyYi81OHOFnxFqeipFhtycgKjN0MNr9muEG5d15oXDQCVTcCdiqVAjoavh52Vv74S2H6TcEcZ+gnfSFbbJQuyLqAg==',key_name='tempest-keypair-600129027',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:07:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14952037d1dc44e7b64d0663c7a033c8',ramdisk_id='',reservation_id='r-w9x8ccbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1321611883',owner_user_name='tempest-ServerRescueNegativeTestJSON-1321611883-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:07:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2d39528bc994a25b9e6fea9f6b8b34c',uuid=30923083-4653-4765-a462-4037325fa001,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "vif_mac": "fa:16:3e:8e:1f:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converting VIF {"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "vif_mac": "fa:16:3e:8e:1f:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:1f:99,bridge_name='br-int',has_traffic_filtering=True,id=11c9663c-f497-486e-b56b-020a2fd52c7c,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c9663c-f4') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.objects.instance [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'pci_devices' on Instance uuid 30923083-4653-4765-a462-4037325fa001 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:09:20 user nova-compute[72782]:   <uuid>30923083-4653-4765-a462-4037325fa001</uuid>
Aug 14 20:09:20 user nova-compute[72782]:   <name>instance-00000024</name>
Aug 14 20:09:20 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:09:20 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:09:20 user nova-compute[72782]:   <metadata>
Aug 14 20:09:20 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:09:20 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:09:20 user nova-compute[72782]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-795552024</nova:name>
Aug 14 20:09:20 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:09:20</nova:creationTime>
Aug 14 20:09:20 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:09:20 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:09:20 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:09:20 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:09:20 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:09:20 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:09:20 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:09:20 user nova-compute[72782]:       <nova:owner>
Aug 14 20:09:20 user nova-compute[72782]:         <nova:user uuid="d2d39528bc994a25b9e6fea9f6b8b34c">tempest-ServerRescueNegativeTestJSON-1321611883-project-member</nova:user>
Aug 14 20:09:20 user nova-compute[72782]:         <nova:project uuid="14952037d1dc44e7b64d0663c7a033c8">tempest-ServerRescueNegativeTestJSON-1321611883</nova:project>
Aug 14 20:09:20 user nova-compute[72782]:       </nova:owner>
Aug 14 20:09:20 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 20:09:20 user nova-compute[72782]:       <nova:ports>
Aug 14 20:09:20 user nova-compute[72782]:         <nova:port uuid="11c9663c-f497-486e-b56b-020a2fd52c7c">
Aug 14 20:09:20 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 20:09:20 user nova-compute[72782]:         </nova:port>
Aug 14 20:09:20 user nova-compute[72782]:       </nova:ports>
Aug 14 20:09:20 user nova-compute[72782]:     </nova:instance>
Aug 14 20:09:20 user nova-compute[72782]:   </metadata>
Aug 14 20:09:20 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:09:20 user nova-compute[72782]:     <system>
Aug 14 20:09:20 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:09:20 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:09:20 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:09:20 user nova-compute[72782]:       <entry name="serial">30923083-4653-4765-a462-4037325fa001</entry>
Aug 14 20:09:20 user nova-compute[72782]:       <entry name="uuid">30923083-4653-4765-a462-4037325fa001</entry>
Aug 14 20:09:20 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:09:20 user nova-compute[72782]:     </system>
Aug 14 20:09:20 user nova-compute[72782]:   </sysinfo>
Aug 14 20:09:20 user nova-compute[72782]:   <os>
Aug 14 20:09:20 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:09:20 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:09:20 user nova-compute[72782]:   </os>
Aug 14 20:09:20 user nova-compute[72782]:   <features>
Aug 14 20:09:20 user nova-compute[72782]:     <acpi/>
Aug 14 20:09:20 user nova-compute[72782]:     <apic/>
Aug 14 20:09:20 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:09:20 user nova-compute[72782]:   </features>
Aug 14 20:09:20 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:09:20 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:09:20 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:09:20 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:09:20 user nova-compute[72782]:   </clock>
Aug 14 20:09:20 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:09:20 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:09:20 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:09:20 user nova-compute[72782]:   </cpu>
Aug 14 20:09:20 user nova-compute[72782]:   <devices>
Aug 14 20:09:20 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:09:20 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:09:20 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk.rescue"/>
Aug 14 20:09:20 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:09:20 user nova-compute[72782]:     </disk>
Aug 14 20:09:20 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:09:20 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:09:20 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk"/>
Aug 14 20:09:20 user nova-compute[72782]:       <target dev="vdb" bus="virtio"/>
Aug 14 20:09:20 user nova-compute[72782]:     </disk>
Aug 14 20:09:20 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:09:20 user nova-compute[72782]:       <mac address="fa:16:3e:8e:1f:99"/>
Aug 14 20:09:20 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:09:20 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:09:20 user nova-compute[72782]:       <target dev="tap11c9663c-f4"/>
Aug 14 20:09:20 user nova-compute[72782]:     </interface>
Aug 14 20:09:20 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:09:20 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/console.log" append="off"/>
Aug 14 20:09:20 user nova-compute[72782]:     </serial>
Aug 14 20:09:20 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:09:20 user nova-compute[72782]:     <video>
Aug 14 20:09:20 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:09:20 user nova-compute[72782]:     </video>
Aug 14 20:09:20 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:09:20 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:09:20 user nova-compute[72782]:     </rng>
Aug 14 20:09:20 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:09:20 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:09:20 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:09:20 user nova-compute[72782]:     </memballoon>
Aug 14 20:09:20 user nova-compute[72782]:   </devices>
Aug 14 20:09:20 user nova-compute[72782]: </domain>
Aug 14 20:09:20 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:09:20 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 30923083-4653-4765-a462-4037325fa001] Instance destroyed successfully.
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] No VIF found with MAC fa:16:3e:8e:1f:99, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:09:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-2bca0d35-071f-4bd5-bc77-a90e42315988 req-bb93d8c3-79d5-452b-bdfa-62dd2bce0eb7 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:09:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2bca0d35-071f-4bd5-bc77-a90e42315988 req-bb93d8c3-79d5-452b-bdfa-62dd2bce0eb7 service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:09:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2bca0d35-071f-4bd5-bc77-a90e42315988 req-bb93d8c3-79d5-452b-bdfa-62dd2bce0eb7 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:09:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2bca0d35-071f-4bd5-bc77-a90e42315988 req-bb93d8c3-79d5-452b-bdfa-62dd2bce0eb7 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:09:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-2bca0d35-071f-4bd5-bc77-a90e42315988 req-bb93d8c3-79d5-452b-bdfa-62dd2bce0eb7 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:09:21 user nova-compute[72782]: WARNING nova.compute.manager [req-2bca0d35-071f-4bd5-bc77-a90e42315988 req-bb93d8c3-79d5-452b-bdfa-62dd2bce0eb7 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state active and task_state rescuing.
Aug 14 20:09:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-b8ed63ac-eca2-40cc-bf25-71cf6a16513e req-99dd1ffa-df46-4952-bb94-01b55da6e022 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:09:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b8ed63ac-eca2-40cc-bf25-71cf6a16513e req-99dd1ffa-df46-4952-bb94-01b55da6e022 service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:09:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b8ed63ac-eca2-40cc-bf25-71cf6a16513e req-99dd1ffa-df46-4952-bb94-01b55da6e022 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:09:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b8ed63ac-eca2-40cc-bf25-71cf6a16513e req-99dd1ffa-df46-4952-bb94-01b55da6e022 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:09:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-b8ed63ac-eca2-40cc-bf25-71cf6a16513e req-99dd1ffa-df46-4952-bb94-01b55da6e022 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:09:23 user nova-compute[72782]: WARNING nova.compute.manager [req-b8ed63ac-eca2-40cc-bf25-71cf6a16513e req-99dd1ffa-df46-4952-bb94-01b55da6e022 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state active and task_state rescuing.
Aug 14 20:09:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-b8ed63ac-eca2-40cc-bf25-71cf6a16513e req-99dd1ffa-df46-4952-bb94-01b55da6e022 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:09:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b8ed63ac-eca2-40cc-bf25-71cf6a16513e req-99dd1ffa-df46-4952-bb94-01b55da6e022 service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:09:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b8ed63ac-eca2-40cc-bf25-71cf6a16513e req-99dd1ffa-df46-4952-bb94-01b55da6e022 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:09:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b8ed63ac-eca2-40cc-bf25-71cf6a16513e req-99dd1ffa-df46-4952-bb94-01b55da6e022 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:09:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-b8ed63ac-eca2-40cc-bf25-71cf6a16513e req-99dd1ffa-df46-4952-bb94-01b55da6e022 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:09:23 user nova-compute[72782]: WARNING nova.compute.manager [req-b8ed63ac-eca2-40cc-bf25-71cf6a16513e req-99dd1ffa-df46-4952-bb94-01b55da6e022 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state active and task_state rescuing.
Aug 14 20:09:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Removed pending event for 30923083-4653-4765-a462-4037325fa001 due to event {{(pid=72782) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 20:09:23 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043763.618231, 30923083-4653-4765-a462-4037325fa001 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:09:23 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] VM Resumed (Lifecycle Event)
Aug 14 20:09:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-39d3b02d-6f26-4443-9082-85f5208a6eb3 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:09:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:09:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:09:23 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 20:09:23 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043763.6199627, 30923083-4653-4765-a462-4037325fa001 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:09:23 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] VM Started (Lifecycle Event)
Aug 14 20:09:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:09:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:09:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:09:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:10:05 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:10:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:10:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:10:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:10:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:10:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:09 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:10:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "af6fee00-a067-4674-a356-f4f1c8d9f5db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:10:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:10:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:10:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:10:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:10:10 user nova-compute[72782]: INFO nova.compute.manager [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Terminating instance
Aug 14 20:10:10 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:10:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-ecd1924c-676a-41d7-8457-ebed19149d8c req-1b71b05f-72ec-4961-bfd8-690d8e5ce90b service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received event network-vif-unplugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:10:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd1924c-676a-41d7-8457-ebed19149d8c req-1b71b05f-72ec-4961-bfd8-690d8e5ce90b service nova] Acquiring lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:10:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd1924c-676a-41d7-8457-ebed19149d8c req-1b71b05f-72ec-4961-bfd8-690d8e5ce90b service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:10:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ecd1924c-676a-41d7-8457-ebed19149d8c req-1b71b05f-72ec-4961-bfd8-690d8e5ce90b service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:10:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-ecd1924c-676a-41d7-8457-ebed19149d8c req-1b71b05f-72ec-4961-bfd8-690d8e5ce90b service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] No waiting events found dispatching network-vif-unplugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:10:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-ecd1924c-676a-41d7-8457-ebed19149d8c req-1b71b05f-72ec-4961-bfd8-690d8e5ce90b service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received event network-vif-unplugged-bd96dc7a-44be-41db-9036-538ca592c701 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:10:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:10:11 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Instance destroyed successfully.
Aug 14 20:10:11 user nova-compute[72782]: DEBUG nova.objects.instance [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'resources' on Instance uuid af6fee00-a067-4674-a356-f4f1c8d9f5db {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-320971317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-320971317',id=34,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:06:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f9f312ba4414905a8d6eb44933e430e',ramdisk_id='',reservation_id='r-vhqmzwo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:08:24Z,user_data=None,user_id='12fb8b10952b4c6b8dc6823610830241',uuid=af6fee00-a067-4674-a356-f4f1c8d9f5db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd96dc7a-44be-41db-9036-538ca592c701", "address": "fa:16:3e:4a:23:dd", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd96dc7a-44", "ovs_interfaceid": "bd96dc7a-44be-41db-9036-538ca592c701", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converting VIF {"id": "bd96dc7a-44be-41db-9036-538ca592c701", "address": "fa:16:3e:4a:23:dd", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd96dc7a-44", "ovs_interfaceid": "bd96dc7a-44be-41db-9036-538ca592c701", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:23:dd,bridge_name='br-int',has_traffic_filtering=True,id=bd96dc7a-44be-41db-9036-538ca592c701,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd96dc7a-44') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_vif [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:23:dd,bridge_name='br-int',has_traffic_filtering=True,id=bd96dc7a-44be-41db-9036-538ca592c701,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd96dc7a-44') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd96dc7a-44, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:10:11 user nova-compute[72782]: INFO os_vif [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:23:dd,bridge_name='br-int',has_traffic_filtering=True,id=bd96dc7a-44be-41db-9036-538ca592c701,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd96dc7a-44')
Aug 14 20:10:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyiolfKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:10:11 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7d0e1d-7459-4dbb-b180-58ae5da54788]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3a9aa8-0d8f-40d5-95ba-5d083555b45d]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:10:11 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:10:11 user nova-compute[72782]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba (non-flash)
Aug 14 20:10:11 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:10:11 user nova-compute[72782]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea (non-flash)
Aug 14 20:10:11 user nova-compute[72782]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba (non-flash)
Aug 14 20:10:11 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e8693370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea'): ({'sdd'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Removing single pathed devices sdd {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0318168d-4a68-470a-be5e-1de3955cb328]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0474a6c7-1da7-4ef4-990e-bd4c1a396793]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Flushing IO for device /dev/sdd {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b95ac8b-c1b5-4655-aa74-d3b9c014acea]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cb47cc-4943-4804-a22e-b507b164d887]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55527f4-574c-4d86-b152-7f22eb875f21]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e142c9-a2ed-4d5c-b00a-da9ec57581dd]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea, portal: 172.16.0.220,3260]
Aug 14 20:10:11 user nova-compute[72782]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea, portal: 172.16.0.220,3260] successful.
Aug 14 20:10:11 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2cc395-413e-4cd9-966e-e7cbb9e605ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7493ba2-6535-4a04-9184-6901e4ebe0cb]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] <== disconnect_volume: return (298ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:10:11 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Deleting instance files /opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db_del
Aug 14 20:10:11 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Deletion of /opt/stack/data/nova/instances/af6fee00-a067-4674-a356-f4f1c8d9f5db_del complete
Aug 14 20:10:11 user nova-compute[72782]: INFO nova.compute.manager [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 14 20:10:11 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:10:11 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:10:12 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:10:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:10:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:10:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:10:12 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:10:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:12 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:10:12 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Took 0.64 seconds to deallocate network for instance.
Aug 14 20:10:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-47810134-9ea5-4b2f-b343-f8381bf16222 req-e49f99ea-3239-43dc-b994-44c0a2529aaf service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received event network-vif-deleted-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:10:12 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Updating instance_info_cache with network_info: [{"id": "325817ed-4de8-4d31-afb7-d338d9391c55", "address": "fa:16:3e:83:cb:20", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325817ed-4d", "ovs_interfaceid": "325817ed-4de8-4d31-afb7-d338d9391c55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:10:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:10:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:10:12 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:10:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:10:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-d155d640-2549-47df-9a2a-77780cbcb45e req-55537132-eef3-4dcd-b2a9-ec97eab9fab6 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received event network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:10:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d155d640-2549-47df-9a2a-77780cbcb45e req-55537132-eef3-4dcd-b2a9-ec97eab9fab6 service nova] Acquiring lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:10:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d155d640-2549-47df-9a2a-77780cbcb45e req-55537132-eef3-4dcd-b2a9-ec97eab9fab6 service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:10:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d155d640-2549-47df-9a2a-77780cbcb45e req-55537132-eef3-4dcd-b2a9-ec97eab9fab6 service nova] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:10:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-d155d640-2549-47df-9a2a-77780cbcb45e req-55537132-eef3-4dcd-b2a9-ec97eab9fab6 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] No waiting events found dispatching network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:10:12 user nova-compute[72782]: WARNING nova.compute.manager [req-d155d640-2549-47df-9a2a-77780cbcb45e req-55537132-eef3-4dcd-b2a9-ec97eab9fab6 service nova] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Received unexpected event network-vif-plugged-bd96dc7a-44be-41db-9036-538ca592c701 for instance with vm_state active and task_state deleting.
Aug 14 20:10:13 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:10:13 user nova-compute[72782]: INFO nova.compute.manager [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Took 0.86 seconds to detach 1 volumes for instance.
Aug 14 20:10:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:10:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:10:13 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:10:13 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:10:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:10:13 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Deleted allocations for instance af6fee00-a067-4674-a356-f4f1c8d9f5db
Aug 14 20:10:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a7e9fd34-1090-4be2-a8e1-acc628dc616e tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "af6fee00-a067-4674-a356-f4f1c8d9f5db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.122s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:10:14 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:10:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:10:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:10:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:10:14 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:10:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:10:14 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:10:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:10:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:10:16 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:10:16 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:10:16 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8171MB free_disk=25.212398529052734GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:10:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:10:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:10:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:10:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ad4011a9-ab9f-4647-b677-a1c6337d2c2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:10:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:10:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2c924d52-aa8a-47ed-857c-b863efe95258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:10:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 13201da3-4908-4724-9759-100190ed16d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:10:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 30923083-4653-4765-a462-4037325fa001 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:10:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:10:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:10:17 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:10:17 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:10:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:10:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:10:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:10:21 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:10:26 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692043811.1426568, af6fee00-a067-4674-a356-f4f1c8d9f5db => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:10:26 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] VM Stopped (Lifecycle Event)
Aug 14 20:10:26 user nova-compute[72782]: DEBUG nova.compute.manager [None req-452f2963-8ad6-4a59-a470-3047ed6512a6 None None] [instance: af6fee00-a067-4674-a356-f4f1c8d9f5db] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:10:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:10:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:10:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:10:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "13201da3-4908-4724-9759-100190ed16d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "13201da3-4908-4724-9759-100190ed16d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "13201da3-4908-4724-9759-100190ed16d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "13201da3-4908-4724-9759-100190ed16d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "13201da3-4908-4724-9759-100190ed16d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:01 user nova-compute[72782]: INFO nova.compute.manager [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Terminating instance
Aug 14 20:11:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-4b21c590-0bd7-4a07-ac3a-df98a5523218 req-903513c2-15eb-46e1-af37-8d0f8b8082be service nova] [instance: 13201da3-4908-4724-9759-100190ed16d3] Received event network-vif-unplugged-32808424-a985-4d95-9900-fd909afa9e66 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4b21c590-0bd7-4a07-ac3a-df98a5523218 req-903513c2-15eb-46e1-af37-8d0f8b8082be service nova] Acquiring lock "13201da3-4908-4724-9759-100190ed16d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4b21c590-0bd7-4a07-ac3a-df98a5523218 req-903513c2-15eb-46e1-af37-8d0f8b8082be service nova] Lock "13201da3-4908-4724-9759-100190ed16d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4b21c590-0bd7-4a07-ac3a-df98a5523218 req-903513c2-15eb-46e1-af37-8d0f8b8082be service nova] Lock "13201da3-4908-4724-9759-100190ed16d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-4b21c590-0bd7-4a07-ac3a-df98a5523218 req-903513c2-15eb-46e1-af37-8d0f8b8082be service nova] [instance: 13201da3-4908-4724-9759-100190ed16d3] No waiting events found dispatching network-vif-unplugged-32808424-a985-4d95-9900-fd909afa9e66 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-4b21c590-0bd7-4a07-ac3a-df98a5523218 req-903513c2-15eb-46e1-af37-8d0f8b8082be service nova] [instance: 13201da3-4908-4724-9759-100190ed16d3] Received event network-vif-unplugged-32808424-a985-4d95-9900-fd909afa9e66 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:01 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 13201da3-4908-4724-9759-100190ed16d3] Instance destroyed successfully.
Aug 14 20:11:01 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'resources' on Instance uuid 13201da3-4908-4724-9759-100190ed16d3 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1989629223',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1989629223',id=32,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:01:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f9f312ba4414905a8d6eb44933e430e',ramdisk_id='',reservation_id='r-rt9aj60i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:03:36Z,user_data=None,user_id='12fb8b10952b4c6b8dc6823610830241',uuid=13201da3-4908-4724-9759-100190ed16d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32808424-a985-4d95-9900-fd909afa9e66", "address": "fa:16:3e:8f:3b:73", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32808424-a9", "ovs_interfaceid": "32808424-a985-4d95-9900-fd909afa9e66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converting VIF {"id": "32808424-a985-4d95-9900-fd909afa9e66", "address": "fa:16:3e:8f:3b:73", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32808424-a9", "ovs_interfaceid": "32808424-a985-4d95-9900-fd909afa9e66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:3b:73,bridge_name='br-int',has_traffic_filtering=True,id=32808424-a985-4d95-9900-fd909afa9e66,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32808424-a9') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG os_vif [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:3b:73,bridge_name='br-int',has_traffic_filtering=True,id=32808424-a985-4d95-9900-fd909afa9e66,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32808424-a9') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32808424-a9, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:11:01 user nova-compute[72782]: INFO os_vif [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:3b:73,bridge_name='br-int',has_traffic_filtering=True,id=32808424-a985-4d95-9900-fd909afa9e66,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32808424-a9')
Aug 14 20:11:01 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Deleting instance files /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3_del
Aug 14 20:11:01 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Deletion of /opt/stack/data/nova/instances/13201da3-4908-4724-9759-100190ed16d3_del complete
Aug 14 20:11:01 user nova-compute[72782]: INFO nova.compute.manager [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 13201da3-4908-4724-9759-100190ed16d3] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 14 20:11:01 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 13201da3-4908-4724-9759-100190ed16d3] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:11:01 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 13201da3-4908-4724-9759-100190ed16d3] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:11:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:11:02 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 13201da3-4908-4724-9759-100190ed16d3] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:11:02 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 13201da3-4908-4724-9759-100190ed16d3] Took 0.94 seconds to deallocate network for instance.
Aug 14 20:11:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-548f846b-fc96-4914-a83d-23f6ba8f2acf req-d57ebb82-3b31-449b-aadb-f80611e0908d service nova] [instance: 13201da3-4908-4724-9759-100190ed16d3] Received event network-vif-deleted-32808424-a985-4d95-9900-fd909afa9e66 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:11:03 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:11:03 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:11:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:03 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Deleted allocations for instance 13201da3-4908-4724-9759-100190ed16d3
Aug 14 20:11:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4aeb69f8-705a-46bb-b102-a593723f06ea tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "13201da3-4908-4724-9759-100190ed16d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.141s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-8a16cd5b-c481-43d6-8ef0-0784d8810562 req-509e621d-1e16-4b15-b03c-248aa1784128 service nova] [instance: 13201da3-4908-4724-9759-100190ed16d3] Received event network-vif-plugged-32808424-a985-4d95-9900-fd909afa9e66 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:11:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8a16cd5b-c481-43d6-8ef0-0784d8810562 req-509e621d-1e16-4b15-b03c-248aa1784128 service nova] Acquiring lock "13201da3-4908-4724-9759-100190ed16d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8a16cd5b-c481-43d6-8ef0-0784d8810562 req-509e621d-1e16-4b15-b03c-248aa1784128 service nova] Lock "13201da3-4908-4724-9759-100190ed16d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8a16cd5b-c481-43d6-8ef0-0784d8810562 req-509e621d-1e16-4b15-b03c-248aa1784128 service nova] Lock "13201da3-4908-4724-9759-100190ed16d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-8a16cd5b-c481-43d6-8ef0-0784d8810562 req-509e621d-1e16-4b15-b03c-248aa1784128 service nova] [instance: 13201da3-4908-4724-9759-100190ed16d3] No waiting events found dispatching network-vif-plugged-32808424-a985-4d95-9900-fd909afa9e66 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:11:03 user nova-compute[72782]: WARNING nova.compute.manager [req-8a16cd5b-c481-43d6-8ef0-0784d8810562 req-509e621d-1e16-4b15-b03c-248aa1784128 service nova] [instance: 13201da3-4908-4724-9759-100190ed16d3] Received unexpected event network-vif-plugged-32808424-a985-4d95-9900-fd909afa9e66 for instance with vm_state deleted and task_state None.
Aug 14 20:11:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:11:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:11:09 user nova-compute[72782]: INFO nova.compute.manager [None req-67d580ac-045b-4fcc-8c7a-3ae3c90e81f0 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Unrescuing
Aug 14 20:11:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-67d580ac-045b-4fcc-8c7a-3ae3c90e81f0 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:11:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-67d580ac-045b-4fcc-8c7a-3ae3c90e81f0 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquired lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:11:09 user nova-compute[72782]: DEBUG nova.network.neutron [None req-67d580ac-045b-4fcc-8c7a-3ae3c90e81f0 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:11:09 user nova-compute[72782]: DEBUG nova.network.neutron [None req-67d580ac-045b-4fcc-8c7a-3ae3c90e81f0 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Updating instance_info_cache with network_info: [{"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:11:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-67d580ac-045b-4fcc-8c7a-3ae3c90e81f0 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Releasing lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:11:09 user nova-compute[72782]: DEBUG nova.objects.instance [None req-67d580ac-045b-4fcc-8c7a-3ae3c90e81f0 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'flavor' on Instance uuid 30923083-4653-4765-a462-4037325fa001 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:11:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:11:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-7f711442-7bfe-4837-bf56-5443d5848c83 req-90278f84-3107-4583-b9c1-410c733930da service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-unplugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:11:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7f711442-7bfe-4837-bf56-5443d5848c83 req-90278f84-3107-4583-b9c1-410c733930da service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7f711442-7bfe-4837-bf56-5443d5848c83 req-90278f84-3107-4583-b9c1-410c733930da service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7f711442-7bfe-4837-bf56-5443d5848c83 req-90278f84-3107-4583-b9c1-410c733930da service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-7f711442-7bfe-4837-bf56-5443d5848c83 req-90278f84-3107-4583-b9c1-410c733930da service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-unplugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:11:10 user nova-compute[72782]: WARNING nova.compute.manager [req-7f711442-7bfe-4837-bf56-5443d5848c83 req-90278f84-3107-4583-b9c1-410c733930da service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-unplugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state rescued and task_state unrescuing.
Aug 14 20:11:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:10 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 30923083-4653-4765-a462-4037325fa001] Instance destroyed successfully.
Aug 14 20:11:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:11:12 user nova-compute[72782]: WARNING nova.compute.manager [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state rescued and task_state unrescuing.
Aug 14 20:11:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:11:12 user nova-compute[72782]: WARNING nova.compute.manager [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state rescued and task_state unrescuing.
Aug 14 20:11:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:11:12 user nova-compute[72782]: WARNING nova.compute.manager [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state rescued and task_state unrescuing.
Aug 14 20:11:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-unplugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-unplugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:11:12 user nova-compute[72782]: WARNING nova.compute.manager [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-unplugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state rescued and task_state unrescuing.
Aug 14 20:11:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:11:12 user nova-compute[72782]: WARNING nova.compute.manager [req-04e2dfd9-651f-43ff-a07a-39e5f59de006 req-de469335-32d2-4df3-bc82-2897d6a9d94f service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state rescued and task_state unrescuing.
Aug 14 20:11:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:13 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:11:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:11:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-2c924d52-aa8a-47ed-857c-b863efe95258" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:11:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-2c924d52-aa8a-47ed-857c-b863efe95258" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:11:13 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:11:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:13 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Updating instance_info_cache with network_info: [{"id": "8b971464-be37-4d45-a3c6-05d413e65cb2", "address": "fa:16:3e:a0:14:ff", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b971464-be", "ovs_interfaceid": "8b971464-be37-4d45-a3c6-05d413e65cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:11:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-2c924d52-aa8a-47ed-857c-b863efe95258" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:11:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:11:13 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:11:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:11:14 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:11:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Removed pending event for 30923083-4653-4765-a462-4037325fa001 due to event {{(pid=72782) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 20:11:14 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043874.1026702, 30923083-4653-4765-a462-4037325fa001 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:11:14 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] VM Resumed (Lifecycle Event)
Aug 14 20:11:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-67d580ac-045b-4fcc-8c7a-3ae3c90e81f0 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:11:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:11:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:11:14 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 20:11:14 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043874.1040263, 30923083-4653-4765-a462-4037325fa001 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:11:14 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] VM Started (Lifecycle Event)
Aug 14 20:11:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:11:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 30923083-4653-4765-a462-4037325fa001] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:11:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-eb0bc69a-65a0-4aa4-a3b2-3f3e740a8301 req-6d03648f-a379-4d68-8412-f5166cde69ba service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:11:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eb0bc69a-65a0-4aa4-a3b2-3f3e740a8301 req-6d03648f-a379-4d68-8412-f5166cde69ba service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eb0bc69a-65a0-4aa4-a3b2-3f3e740a8301 req-6d03648f-a379-4d68-8412-f5166cde69ba service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eb0bc69a-65a0-4aa4-a3b2-3f3e740a8301 req-6d03648f-a379-4d68-8412-f5166cde69ba service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-eb0bc69a-65a0-4aa4-a3b2-3f3e740a8301 req-6d03648f-a379-4d68-8412-f5166cde69ba service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:11:14 user nova-compute[72782]: WARNING nova.compute.manager [req-eb0bc69a-65a0-4aa4-a3b2-3f3e740a8301 req-6d03648f-a379-4d68-8412-f5166cde69ba service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state active and task_state None.
Aug 14 20:11:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-eb0bc69a-65a0-4aa4-a3b2-3f3e740a8301 req-6d03648f-a379-4d68-8412-f5166cde69ba service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:11:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eb0bc69a-65a0-4aa4-a3b2-3f3e740a8301 req-6d03648f-a379-4d68-8412-f5166cde69ba service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eb0bc69a-65a0-4aa4-a3b2-3f3e740a8301 req-6d03648f-a379-4d68-8412-f5166cde69ba service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eb0bc69a-65a0-4aa4-a3b2-3f3e740a8301 req-6d03648f-a379-4d68-8412-f5166cde69ba service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-eb0bc69a-65a0-4aa4-a3b2-3f3e740a8301 req-6d03648f-a379-4d68-8412-f5166cde69ba service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:11:14 user nova-compute[72782]: WARNING nova.compute.manager [req-eb0bc69a-65a0-4aa4-a3b2-3f3e740a8301 req-6d03648f-a379-4d68-8412-f5166cde69ba service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state active and task_state None.
Aug 14 20:11:15 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:11:15 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:11:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:15 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:11:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:11:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:11:15 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:16 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692043861.7059171, 13201da3-4908-4724-9759-100190ed16d3 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:11:16 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 13201da3-4908-4724-9759-100190ed16d3] VM Stopped (Lifecycle Event)
Aug 14 20:11:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:16 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f35003fb-f221-4468-83d1-08c98df2f862 None None] [instance: 13201da3-4908-4724-9759-100190ed16d3] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:11:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:17 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:11:17 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:11:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8371MB free_disk=25.333694458007812GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:11:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:11:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance ad4011a9-ab9f-4647-b677-a1c6337d2c2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:11:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:11:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2c924d52-aa8a-47ed-857c-b863efe95258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:11:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 30923083-4653-4765-a462-4037325fa001 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:11:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:11:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:11:17 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing inventories for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 20:11:18 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating ProviderTree inventory for provider d26c9e3b-40e6-476e-9664-3119ebf5873b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 20:11:18 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 20:11:18 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing aggregate associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, aggregates: None {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 20:11:18 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing trait associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 20:11:18 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:11:18 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:11:18 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:11:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.731s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:22 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:11:22 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:11:22 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 20:11:22 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] There are 0 instances to clean {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 20:11:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:25 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:11:25 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72782) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 20:11:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:28 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:11:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "a9a07178-5051-4ecb-850f-113402dfa682" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "a9a07178-5051-4ecb-850f-113402dfa682" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:11:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:41 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:11:41 user nova-compute[72782]: INFO nova.compute.claims [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Claim successful on node user
Aug 14 20:11:41 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:11:41 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:11:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.296s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:11:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:11:41 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:11:41 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:11:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:11:41 user nova-compute[72782]: INFO nova.virt.block_device [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Booting with volume b1f19ce5-e794-4bd1-b546-4a8bb1365f36 at /dev/vda
Aug 14 20:11:41 user nova-compute[72782]: DEBUG nova.policy [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd98849817bd8443d8d332bd044833a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a05a5fa43b4d7fbcc888cbd03384af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG os_brick.utils [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca5b071-58da-4bf0-8502-f58ac2f9183f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3be943-bf76-44b3-bcb5-b84317bbe80a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51d3af3-fa90-46c3-b61c-7290587dc43f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d93c2c-f0e0-4bb3-8516-27349d522a6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:11:42 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:11:42 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[772e1354-7e63-424b-916c-78f27260c5ee]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG os_brick.utils [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Updating existing volume attachment record: 1f672322-428e-410e-a5d7-cbcbf5ba6f1d {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:11:42 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Successfully created port: 76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:11:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:43 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Successfully updated port: 76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:11:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:11:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquired lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:11:43 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:11:43 user nova-compute[72782]: DEBUG nova.compute.manager [req-124dd678-fef8-4490-aab3-2662e1874ce4 req-c87ff766-e4d4-4950-81e2-47b55e0b9fc9 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received event network-changed-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:11:43 user nova-compute[72782]: DEBUG nova.compute.manager [req-124dd678-fef8-4490-aab3-2662e1874ce4 req-c87ff766-e4d4-4950-81e2-47b55e0b9fc9 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Refreshing instance network info cache due to event network-changed-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:11:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-124dd678-fef8-4490-aab3-2662e1874ce4 req-c87ff766-e4d4-4950-81e2-47b55e0b9fc9 service nova] Acquiring lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:11:43 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:11:43 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Updating instance_info_cache with network_info: [{"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:11:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Releasing lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:11:44 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Instance network_info: |[{"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:11:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-124dd678-fef8-4490-aab3-2662e1874ce4 req-c87ff766-e4d4-4950-81e2-47b55e0b9fc9 service nova] Acquired lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:11:44 user nova-compute[72782]: DEBUG nova.network.neutron [req-124dd678-fef8-4490-aab3-2662e1874ce4 req-c87ff766-e4d4-4950-81e2-47b55e0b9fc9 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Refreshing network info cache for port 76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:11:44 user nova-compute[72782]: DEBUG nova.network.neutron [req-124dd678-fef8-4490-aab3-2662e1874ce4 req-c87ff766-e4d4-4950-81e2-47b55e0b9fc9 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Updated VIF entry in instance network info cache for port 76ee2f39-b22b-4c07-9aa6-9bdbbc52393e. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:11:44 user nova-compute[72782]: DEBUG nova.network.neutron [req-124dd678-fef8-4490-aab3-2662e1874ce4 req-c87ff766-e4d4-4950-81e2-47b55e0b9fc9 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Updating instance_info_cache with network_info: [{"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:11:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-124dd678-fef8-4490-aab3-2662e1874ce4 req-c87ff766-e4d4-4950-81e2-47b55e0b9fc9 service nova] Releasing lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:11:45 user nova-compute[72782]: WARNING nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] While synchronizing instance power states, found 6 instances in the database and 5 instances on the hypervisor.
Aug 14 20:11:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid 3c2df162-332c-4391-95b8-223e07546d74 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid ad4011a9-ab9f-4647-b677-a1c6337d2c2c {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid 2c924d52-aa8a-47ed-857c-b863efe95258 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid 30923083-4653-4765-a462-4037325fa001 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid a9a07178-5051-4ecb-850f-113402dfa682 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "3c2df162-332c-4391-95b8-223e07546d74" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "3c2df162-332c-4391-95b8-223e07546d74" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "2c924d52-aa8a-47ed-857c-b863efe95258" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "2c924d52-aa8a-47ed-857c-b863efe95258" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "30923083-4653-4765-a462-4037325fa001" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "30923083-4653-4765-a462-4037325fa001" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "a9a07178-5051-4ecb-850f-113402dfa682" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "3c2df162-332c-4391-95b8-223e07546d74" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "30923083-4653-4765-a462-4037325fa001" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "2c924d52-aa8a-47ed-857c-b863efe95258" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:11:51 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Creating image(s)
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Did not create local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Ensure instance console log exists: /opt/stack/data/nova/instances/a9a07178-5051-4ecb-850f-113402dfa682/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Start _get_guest_xml network_info=[{"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '1f672322-428e-410e-a5d7-cbcbf5ba6f1d', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tslePvrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9a07178-5051-4ecb-850f-113402dfa682', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1f19ce5-e794-4bd1-b546-4a8bb1365f36', 'serial': 'b1f19ce5-e794-4bd1-b546-4a8bb1365f36'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:11:51 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:11:51 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tslePvrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:11:51 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:11:51 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:11:51 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58ab834-8459-4cfb-b27f-a8d1015c9c68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:11:51 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f8f429-2df9-4adf-8654-2613a2ad07ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36] added
Aug 14 20:11:51 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7570872d-4322-41ce-89b1-9efbe1f46280]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d4bc20-0bdc-4f80-9207-74932a8ab59c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tslePvrc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tslePvrc" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[529e7c90-e139-43ca-9bad-5dd2af2e88cc]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tslePvrc'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c615000-af4b-46cd-9bd1-fbc550ce5ec3]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[907f9785-93c5-4607-94af-e5aff10f3d83]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:11:51 user nova-compute[72782]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba (non-flash)
Aug 14 20:11:51 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:11:51 user nova-compute[72782]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba (non-flash)
Aug 14 20:11:51 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efb435d-9982-47d1-96a6-8d976e71921d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36, portal: 172.16.0.220,3260]
Aug 14 20:11:51 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36, portal: 172.16.0.220,3260] successful.
Aug 14 20:11:51 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee817aee-b11a-4801-a6bf-2fb4de75fd2e]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2808c971-5522-4095-980e-d689ab260b3e]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:11:51 user nova-compute[72782]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba (non-flash)
Aug 14 20:11:51 user nova-compute[72782]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 (non-flash)
Aug 14 20:11:51 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:11:51 user nova-compute[72782]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba (non-flash)
Aug 14 20:11:51 user nova-compute[72782]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 (non-flash)
Aug 14 20:11:51 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3745fc1e-8666-42f4-bab5-86521faf9e5a]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:51 user nova-compute[72782]: INFO nova.compute.manager [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Terminating instance
Aug 14 20:11:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-8c40d7c4-4785-47be-8457-f338c10d54d6 req-9e3dd587-63d4-4837-a6b0-03ee4949a795 service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received event network-vif-unplugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8c40d7c4-4785-47be-8457-f338c10d54d6 req-9e3dd587-63d4-4837-a6b0-03ee4949a795 service nova] Acquiring lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8c40d7c4-4785-47be-8457-f338c10d54d6 req-9e3dd587-63d4-4837-a6b0-03ee4949a795 service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8c40d7c4-4785-47be-8457-f338c10d54d6 req-9e3dd587-63d4-4837-a6b0-03ee4949a795 service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-8c40d7c4-4785-47be-8457-f338c10d54d6 req-9e3dd587-63d4-4837-a6b0-03ee4949a795 service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] No waiting events found dispatching network-vif-unplugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-8c40d7c4-4785-47be-8457-f338c10d54d6 req-9e3dd587-63d4-4837-a6b0-03ee4949a795 service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received event network-vif-unplugged-2858462d-1715-4c67-aee3-a0c15eac235b for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tslePvrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23935356337636639', 'path': '/dev/sdd'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935356337636639', 'path': '/dev/sdd'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1943938335',display_name='tempest-TestShelveInstance-server-1943938335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1943938335',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkXzREVSXh3D8FqrMcNT1eaqAV2O3PHytdmYLqeEKhgHFXcrt2opcbmZgjUvXZuzqSCG5IGsiLjbmbLSWTFnMeyB9kzRqUjQuU8JN2tblBNVpbHSf9B07JWbp9O03FEJQ==',key_name='tempest-TestShelveInstance-114729578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0a05a5fa43b4d7fbcc888cbd03384af',ramdisk_id='',reservation_id='r-h47r0r7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2109215903',owner_user_name='tempest-TestShelveInstance-2109215903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:11:42Z,user_data=None,user_id='d98849817bd8443d8d332bd044833a66',uuid=a9a07178-5051-4ecb-850f-113402dfa682,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Converting VIF {"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=76ee2f39-b22b-4c07-9aa6-9bdbbc52393e,network=Network(5c8ea35b-08e7-49d8-8fbe-0d6603bb281c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ee2f39-b2') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lazy-loading 'pci_devices' on Instance uuid a9a07178-5051-4ecb-850f-113402dfa682 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:11:52 user nova-compute[72782]:   <uuid>a9a07178-5051-4ecb-850f-113402dfa682</uuid>
Aug 14 20:11:52 user nova-compute[72782]:   <name>instance-00000025</name>
Aug 14 20:11:52 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:11:52 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:11:52 user nova-compute[72782]:   <metadata>
Aug 14 20:11:52 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:11:52 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:11:52 user nova-compute[72782]:       <nova:name>tempest-TestShelveInstance-server-1943938335</nova:name>
Aug 14 20:11:52 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:11:51</nova:creationTime>
Aug 14 20:11:52 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:11:52 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:11:52 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:11:52 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:11:52 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:11:52 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:11:52 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:11:52 user nova-compute[72782]:       <nova:owner>
Aug 14 20:11:52 user nova-compute[72782]:         <nova:user uuid="d98849817bd8443d8d332bd044833a66">tempest-TestShelveInstance-2109215903-project-member</nova:user>
Aug 14 20:11:52 user nova-compute[72782]:         <nova:project uuid="b0a05a5fa43b4d7fbcc888cbd03384af">tempest-TestShelveInstance-2109215903</nova:project>
Aug 14 20:11:52 user nova-compute[72782]:       </nova:owner>
Aug 14 20:11:52 user nova-compute[72782]:       <nova:ports>
Aug 14 20:11:52 user nova-compute[72782]:         <nova:port uuid="76ee2f39-b22b-4c07-9aa6-9bdbbc52393e">
Aug 14 20:11:52 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 20:11:52 user nova-compute[72782]:         </nova:port>
Aug 14 20:11:52 user nova-compute[72782]:       </nova:ports>
Aug 14 20:11:52 user nova-compute[72782]:     </nova:instance>
Aug 14 20:11:52 user nova-compute[72782]:   </metadata>
Aug 14 20:11:52 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:11:52 user nova-compute[72782]:     <system>
Aug 14 20:11:52 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:11:52 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:11:52 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:11:52 user nova-compute[72782]:       <entry name="serial">a9a07178-5051-4ecb-850f-113402dfa682</entry>
Aug 14 20:11:52 user nova-compute[72782]:       <entry name="uuid">a9a07178-5051-4ecb-850f-113402dfa682</entry>
Aug 14 20:11:52 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:11:52 user nova-compute[72782]:     </system>
Aug 14 20:11:52 user nova-compute[72782]:   </sysinfo>
Aug 14 20:11:52 user nova-compute[72782]:   <os>
Aug 14 20:11:52 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:11:52 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:11:52 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:11:52 user nova-compute[72782]:   </os>
Aug 14 20:11:52 user nova-compute[72782]:   <features>
Aug 14 20:11:52 user nova-compute[72782]:     <acpi/>
Aug 14 20:11:52 user nova-compute[72782]:     <apic/>
Aug 14 20:11:52 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:11:52 user nova-compute[72782]:   </features>
Aug 14 20:11:52 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:11:52 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:11:52 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:11:52 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:11:52 user nova-compute[72782]:   </clock>
Aug 14 20:11:52 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:11:52 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:11:52 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:11:52 user nova-compute[72782]:   </cpu>
Aug 14 20:11:52 user nova-compute[72782]:   <devices>
Aug 14 20:11:52 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 20:11:52 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:11:52 user nova-compute[72782]:       <source dev="/dev/sdd"/>
Aug 14 20:11:52 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:11:52 user nova-compute[72782]:       <serial>b1f19ce5-e794-4bd1-b546-4a8bb1365f36</serial>
Aug 14 20:11:52 user nova-compute[72782]:     </disk>
Aug 14 20:11:52 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:11:52 user nova-compute[72782]:       <mac address="fa:16:3e:df:32:2b"/>
Aug 14 20:11:52 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:11:52 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:11:52 user nova-compute[72782]:       <target dev="tap76ee2f39-b2"/>
Aug 14 20:11:52 user nova-compute[72782]:     </interface>
Aug 14 20:11:52 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:11:52 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/a9a07178-5051-4ecb-850f-113402dfa682/console.log" append="off"/>
Aug 14 20:11:52 user nova-compute[72782]:     </serial>
Aug 14 20:11:52 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:11:52 user nova-compute[72782]:     <video>
Aug 14 20:11:52 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:11:52 user nova-compute[72782]:     </video>
Aug 14 20:11:52 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:11:52 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:11:52 user nova-compute[72782]:     </rng>
Aug 14 20:11:52 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:11:52 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:11:52 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:11:52 user nova-compute[72782]:     </memballoon>
Aug 14 20:11:52 user nova-compute[72782]:   </devices>
Aug 14 20:11:52 user nova-compute[72782]: </domain>
Aug 14 20:11:52 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1943938335',display_name='tempest-TestShelveInstance-server-1943938335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1943938335',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkXzREVSXh3D8FqrMcNT1eaqAV2O3PHytdmYLqeEKhgHFXcrt2opcbmZgjUvXZuzqSCG5IGsiLjbmbLSWTFnMeyB9kzRqUjQuU8JN2tblBNVpbHSf9B07JWbp9O03FEJQ==',key_name='tempest-TestShelveInstance-114729578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0a05a5fa43b4d7fbcc888cbd03384af',ramdisk_id='',reservation_id='r-h47r0r7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2109215903',owner_user_name='tempest-TestShelveInstance-2109215903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:11:42Z,user_data=None,user_id='d98849817bd8443d8d332bd044833a66',uuid=a9a07178-5051-4ecb-850f-113402dfa682,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Converting VIF {"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=76ee2f39-b22b-4c07-9aa6-9bdbbc52393e,network=Network(5c8ea35b-08e7-49d8-8fbe-0d6603bb281c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ee2f39-b2') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG os_vif [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=76ee2f39-b22b-4c07-9aa6-9bdbbc52393e,network=Network(5c8ea35b-08e7-49d8-8fbe-0d6603bb281c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ee2f39-b2') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76ee2f39-b2, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap76ee2f39-b2, col_values=(('external_ids', {'iface-id': '76ee2f39-b22b-4c07-9aa6-9bdbbc52393e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:32:2b', 'vm-uuid': 'a9a07178-5051-4ecb-850f-113402dfa682'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:52 user nova-compute[72782]: INFO os_vif [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=76ee2f39-b22b-4c07-9aa6-9bdbbc52393e,network=Network(5c8ea35b-08e7-49d8-8fbe-0d6603bb281c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ee2f39-b2')
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] No VIF found with MAC fa:16:3e:df:32:2b, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:11:52 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Instance destroyed successfully.
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.objects.instance [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'resources' on Instance uuid ad4011a9-ab9f-4647-b677-a1c6337d2c2c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:56:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1616735295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1616735295',id=26,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:58:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f9f312ba4414905a8d6eb44933e430e',ramdisk_id='',reservation_id='r-tabsp0yl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:59:53Z,user_data=None,user_id='12fb8b10952b4c6b8dc6823610830241',uuid=ad4011a9-ab9f-4647-b677-a1c6337d2c2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2858462d-1715-4c67-aee3-a0c15eac235b", "address": "fa:16:3e:f1:85:57", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2858462d-17", "ovs_interfaceid": "2858462d-1715-4c67-aee3-a0c15eac235b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converting VIF {"id": "2858462d-1715-4c67-aee3-a0c15eac235b", "address": "fa:16:3e:f1:85:57", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2858462d-17", "ovs_interfaceid": "2858462d-1715-4c67-aee3-a0c15eac235b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:85:57,bridge_name='br-int',has_traffic_filtering=True,id=2858462d-1715-4c67-aee3-a0c15eac235b,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2858462d-17') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG os_vif [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:85:57,bridge_name='br-int',has_traffic_filtering=True,id=2858462d-1715-4c67-aee3-a0c15eac235b,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2858462d-17') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2858462d-17, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:52 user nova-compute[72782]: INFO os_vif [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:85:57,bridge_name='br-int',has_traffic_filtering=True,id=2858462d-1715-4c67-aee3-a0c15eac235b,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2858462d-17')
Aug 14 20:11:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAyaHErp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:11:52 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:11:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf6d563-f8ef-4101-baf7-ed6ffa8e4f11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f27e21-4fb3-47ce-a5bd-d258840d895c]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:11:52 user nova-compute[72782]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba (non-flash)
Aug 14 20:11:52 user nova-compute[72782]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 (non-flash)
Aug 14 20:11:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 (non-flash)
Aug 14 20:11:52 user nova-compute[72782]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba (non-flash)
Aug 14 20:11:52 user nova-compute[72782]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 (non-flash)
Aug 14 20:11:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f64084e1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801'): ({'sdc'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Removing single pathed devices sdc {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f215485-ef88-46e8-8618-ee34a74dfa12]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[529aaefa-00ae-4826-93aa-5f9d1deaf61e]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Flushing IO for device /dev/sdc {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3761f9-dcf1-487c-a9e2-f1201178f32a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d60b9cc-e3e2-4a75-bc7f-dd34bf8465d8]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] SCSI volumes sdc have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[233addc8-f530-4e0e-aace-b0c24f563d40]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f4be77-e6ee-4872-9c5d-de06eef5a4b1]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801, portal: 172.16.0.220,3260]
Aug 14 20:11:53 user nova-compute[72782]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801, portal: 172.16.0.220,3260] successful.
Aug 14 20:11:53 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29d8d5e8-35a6-4a5b-86f8-bb40c3282801 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee5990e-f2c5-4436-a690-76d5593e4ac7]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] <== disconnect_volume: return (283ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:11:53 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Deleting instance files /opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c_del
Aug 14 20:11:53 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Deletion of /opt/stack/data/nova/instances/ad4011a9-ab9f-4647-b677-a1c6337d2c2c_del complete
Aug 14 20:11:53 user nova-compute[72782]: INFO nova.compute.manager [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Took 1.42 seconds to destroy the instance on the hypervisor.
Aug 14 20:11:53 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-6582568a-5d06-4a4c-b72e-03220963d121 req-f41bbd74-205f-41bb-9602-296bfb87f807 service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received event network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:11:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6582568a-5d06-4a4c-b72e-03220963d121 req-f41bbd74-205f-41bb-9602-296bfb87f807 service nova] Acquiring lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6582568a-5d06-4a4c-b72e-03220963d121 req-f41bbd74-205f-41bb-9602-296bfb87f807 service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6582568a-5d06-4a4c-b72e-03220963d121 req-f41bbd74-205f-41bb-9602-296bfb87f807 service nova] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-6582568a-5d06-4a4c-b72e-03220963d121 req-f41bbd74-205f-41bb-9602-296bfb87f807 service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] No waiting events found dispatching network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:11:54 user nova-compute[72782]: WARNING nova.compute.manager [req-6582568a-5d06-4a4c-b72e-03220963d121 req-f41bbd74-205f-41bb-9602-296bfb87f807 service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received unexpected event network-vif-plugged-2858462d-1715-4c67-aee3-a0c15eac235b for instance with vm_state active and task_state deleting.
Aug 14 20:11:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-d6cd4c55-cef9-46db-8023-d2b45b7418c6 req-f0af9d86-885f-495b-ac6e-6475ece99d51 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received event network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:11:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d6cd4c55-cef9-46db-8023-d2b45b7418c6 req-f0af9d86-885f-495b-ac6e-6475ece99d51 service nova] Acquiring lock "a9a07178-5051-4ecb-850f-113402dfa682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d6cd4c55-cef9-46db-8023-d2b45b7418c6 req-f0af9d86-885f-495b-ac6e-6475ece99d51 service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d6cd4c55-cef9-46db-8023-d2b45b7418c6 req-f0af9d86-885f-495b-ac6e-6475ece99d51 service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-d6cd4c55-cef9-46db-8023-d2b45b7418c6 req-f0af9d86-885f-495b-ac6e-6475ece99d51 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] No waiting events found dispatching network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:11:54 user nova-compute[72782]: WARNING nova.compute.manager [req-d6cd4c55-cef9-46db-8023-d2b45b7418c6 req-f0af9d86-885f-495b-ac6e-6475ece99d51 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received unexpected event network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e for instance with vm_state building and task_state spawning.
Aug 14 20:11:54 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:11:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:54 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Took 1.12 seconds to deallocate network for instance.
Aug 14 20:11:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:55 user nova-compute[72782]: INFO nova.compute.manager [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Took 0.72 seconds to detach 1 volumes for instance.
Aug 14 20:11:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:55 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:11:55 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:11:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:55 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Deleted allocations for instance ad4011a9-ab9f-4647-b677-a1c6337d2c2c
Aug 14 20:11:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-76085231-f9fa-4061-ba3e-0e2bd3227f89 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "ad4011a9-ab9f-4647-b677-a1c6337d2c2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.694s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:55 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043915.8600752, a9a07178-5051-4ecb-850f-113402dfa682 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:11:55 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] VM Resumed (Lifecycle Event)
Aug 14 20:11:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:11:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:11:55 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Instance spawned successfully.
Aug 14 20:11:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:11:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:11:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:11:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:11:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:11:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:11:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:11:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:11:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:11:55 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:11:55 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692043915.863532, a9a07178-5051-4ecb-850f-113402dfa682 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:11:55 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] VM Started (Lifecycle Event)
Aug 14 20:11:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:11:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:11:56 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:11:56 user nova-compute[72782]: INFO nova.compute.manager [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Took 5.02 seconds to spawn the instance on the hypervisor.
Aug 14 20:11:56 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:11:56 user nova-compute[72782]: INFO nova.compute.manager [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Took 14.66 seconds to build instance.
Aug 14 20:11:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5153ced9-5cc5-4838-b6c9-c0d72fdf164f tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "a9a07178-5051-4ecb-850f-113402dfa682" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.752s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "a9a07178-5051-4ecb-850f-113402dfa682" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.639s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:56 user nova-compute[72782]: INFO nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 14 20:11:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "a9a07178-5051-4ecb-850f-113402dfa682" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:56 user nova-compute[72782]: DEBUG nova.compute.manager [req-18823530-b1c9-4c7c-92e3-f6b0796fbc2c req-53986042-2ead-4cf0-99cc-250ea1aa223b service nova] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Received event network-vif-deleted-2858462d-1715-4c67-aee3-a0c15eac235b {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:11:56 user nova-compute[72782]: DEBUG nova.compute.manager [req-18823530-b1c9-4c7c-92e3-f6b0796fbc2c req-53986042-2ead-4cf0-99cc-250ea1aa223b service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received event network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:11:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-18823530-b1c9-4c7c-92e3-f6b0796fbc2c req-53986042-2ead-4cf0-99cc-250ea1aa223b service nova] Acquiring lock "a9a07178-5051-4ecb-850f-113402dfa682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:11:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-18823530-b1c9-4c7c-92e3-f6b0796fbc2c req-53986042-2ead-4cf0-99cc-250ea1aa223b service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:11:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-18823530-b1c9-4c7c-92e3-f6b0796fbc2c req-53986042-2ead-4cf0-99cc-250ea1aa223b service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:11:56 user nova-compute[72782]: DEBUG nova.compute.manager [req-18823530-b1c9-4c7c-92e3-f6b0796fbc2c req-53986042-2ead-4cf0-99cc-250ea1aa223b service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] No waiting events found dispatching network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:11:56 user nova-compute[72782]: WARNING nova.compute.manager [req-18823530-b1c9-4c7c-92e3-f6b0796fbc2c req-53986042-2ead-4cf0-99cc-250ea1aa223b service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received unexpected event network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e for instance with vm_state active and task_state None.
Aug 14 20:11:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:11:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:04 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:12:07 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692043912.8512855, ad4011a9-ab9f-4647-b677-a1c6337d2c2c => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:12:07 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] VM Stopped (Lifecycle Event)
Aug 14 20:12:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-ed54583d-42d5-41d7-acac-c06ba62d18bb None None] [instance: ad4011a9-ab9f-4647-b677-a1c6337d2c2c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:12:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:12:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:12:12 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:12:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:12:13 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:12:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:12:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:12:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:12:13 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 30923083-4653-4765-a462-4037325fa001] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:12:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:13 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 30923083-4653-4765-a462-4037325fa001] Updating instance_info_cache with network_info: [{"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:12:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:12:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 30923083-4653-4765-a462-4037325fa001] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:12:15 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:12:15 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:12:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:12:17 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:12:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:12:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:12:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:12:17 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:12:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:12:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:12:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:12:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:12:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:12:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:12:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:12:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:12:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:12:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:12:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:12:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:12:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:12:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:12:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:12:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:12:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:12:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:12:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:12:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:12:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:12:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:12:19 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:12:19 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:12:19 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8189MB free_disk=25.322093963623047GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:12:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:12:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:12:19 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3c2df162-332c-4391-95b8-223e07546d74 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:12:19 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:12:19 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2c924d52-aa8a-47ed-857c-b863efe95258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:12:19 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 30923083-4653-4765-a462-4037325fa001 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:12:19 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance a9a07178-5051-4ecb-850f-113402dfa682 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:12:19 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:12:19 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:12:19 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:12:19 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:12:19 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:12:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:12:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:23 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:12:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:12:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "3c2df162-332c-4391-95b8-223e07546d74" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:12:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "3c2df162-332c-4391-95b8-223e07546d74" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:12:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "3c2df162-332c-4391-95b8-223e07546d74-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:12:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "3c2df162-332c-4391-95b8-223e07546d74-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:12:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "3c2df162-332c-4391-95b8-223e07546d74-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:12:42 user nova-compute[72782]: INFO nova.compute.manager [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Terminating instance
Aug 14 20:12:42 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:12:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:42 user nova-compute[72782]: DEBUG nova.compute.manager [req-36193932-22de-45f5-ab6b-d3adfc482ccf req-88376f26-afc2-409b-b1b2-e102fd78ec65 service nova] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Received event network-vif-unplugged-cb361406-de4a-4ea5-a8ac-ba025104ee70 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:12:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-36193932-22de-45f5-ab6b-d3adfc482ccf req-88376f26-afc2-409b-b1b2-e102fd78ec65 service nova] Acquiring lock "3c2df162-332c-4391-95b8-223e07546d74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:12:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-36193932-22de-45f5-ab6b-d3adfc482ccf req-88376f26-afc2-409b-b1b2-e102fd78ec65 service nova] Lock "3c2df162-332c-4391-95b8-223e07546d74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:12:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-36193932-22de-45f5-ab6b-d3adfc482ccf req-88376f26-afc2-409b-b1b2-e102fd78ec65 service nova] Lock "3c2df162-332c-4391-95b8-223e07546d74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:12:42 user nova-compute[72782]: DEBUG nova.compute.manager [req-36193932-22de-45f5-ab6b-d3adfc482ccf req-88376f26-afc2-409b-b1b2-e102fd78ec65 service nova] [instance: 3c2df162-332c-4391-95b8-223e07546d74] No waiting events found dispatching network-vif-unplugged-cb361406-de4a-4ea5-a8ac-ba025104ee70 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:12:42 user nova-compute[72782]: DEBUG nova.compute.manager [req-36193932-22de-45f5-ab6b-d3adfc482ccf req-88376f26-afc2-409b-b1b2-e102fd78ec65 service nova] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Received event network-vif-unplugged-cb361406-de4a-4ea5-a8ac-ba025104ee70 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:12:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:43 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Instance destroyed successfully.
Aug 14 20:12:43 user nova-compute[72782]: DEBUG nova.objects.instance [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lazy-loading 'resources' on Instance uuid 3c2df162-332c-4391-95b8-223e07546d74 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:12:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:53:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1008009503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1008009503',id=23,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:53:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f9f312ba4414905a8d6eb44933e430e',ramdisk_id='',reservation_id='r-cqw1t00m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:55:04Z,user_data=None,user_id='12fb8b10952b4c6b8dc6823610830241',uuid=3c2df162-332c-4391-95b8-223e07546d74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "address": "fa:16:3e:fe:b9:74", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb361406-de", "ovs_interfaceid": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:12:43 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converting VIF {"id": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "address": "fa:16:3e:fe:b9:74", "network": {"id": "c59ed795-048c-4b8d-8ea4-71c765bb0ce7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-556290814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f9f312ba4414905a8d6eb44933e430e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb361406-de", "ovs_interfaceid": "cb361406-de4a-4ea5-a8ac-ba025104ee70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:12:43 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:b9:74,bridge_name='br-int',has_traffic_filtering=True,id=cb361406-de4a-4ea5-a8ac-ba025104ee70,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb361406-de') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:12:43 user nova-compute[72782]: DEBUG os_vif [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:b9:74,bridge_name='br-int',has_traffic_filtering=True,id=cb361406-de4a-4ea5-a8ac-ba025104ee70,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb361406-de') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:12:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb361406-de, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:12:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:12:43 user nova-compute[72782]: INFO os_vif [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:b9:74,bridge_name='br-int',has_traffic_filtering=True,id=cb361406-de4a-4ea5-a8ac-ba025104ee70,network=Network(c59ed795-048c-4b8d-8ea4-71c765bb0ce7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb361406-de')
Aug 14 20:12:43 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Deleting instance files /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74_del
Aug 14 20:12:43 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Deletion of /opt/stack/data/nova/instances/3c2df162-332c-4391-95b8-223e07546d74_del complete
Aug 14 20:12:43 user nova-compute[72782]: INFO nova.compute.manager [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 20:12:43 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:12:43 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:12:43 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 3c2df162-332c-4391-95b8-223e07546d74] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:12:43 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:12:43 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Took 0.48 seconds to deallocate network for instance.
Aug 14 20:12:43 user nova-compute[72782]: DEBUG nova.compute.manager [req-70cbd022-7d90-4564-a6d8-adceb5765cf9 req-defb29b0-b2c1-4164-8890-dee8b4a608da service nova] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Received event network-vif-deleted-cb361406-de4a-4ea5-a8ac-ba025104ee70 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:12:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:12:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:12:44 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:12:44 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:12:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:12:44 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Deleted allocations for instance 3c2df162-332c-4391-95b8-223e07546d74
Aug 14 20:12:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a2c29f26-b9d6-4867-ba0a-193eff910e02 tempest-ServerBootFromVolumeStableRescueTest-1102073842 tempest-ServerBootFromVolumeStableRescueTest-1102073842-project-member] Lock "3c2df162-332c-4391-95b8-223e07546d74" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.845s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:12:44 user nova-compute[72782]: DEBUG nova.compute.manager [req-6bbc21b1-1ab2-4f1b-97db-1bfd207b04cf req-5e610ba4-a762-4cd4-9f99-b27bb62d31e0 service nova] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Received event network-vif-plugged-cb361406-de4a-4ea5-a8ac-ba025104ee70 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:12:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6bbc21b1-1ab2-4f1b-97db-1bfd207b04cf req-5e610ba4-a762-4cd4-9f99-b27bb62d31e0 service nova] Acquiring lock "3c2df162-332c-4391-95b8-223e07546d74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:12:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6bbc21b1-1ab2-4f1b-97db-1bfd207b04cf req-5e610ba4-a762-4cd4-9f99-b27bb62d31e0 service nova] Lock "3c2df162-332c-4391-95b8-223e07546d74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:12:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6bbc21b1-1ab2-4f1b-97db-1bfd207b04cf req-5e610ba4-a762-4cd4-9f99-b27bb62d31e0 service nova] Lock "3c2df162-332c-4391-95b8-223e07546d74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:12:44 user nova-compute[72782]: DEBUG nova.compute.manager [req-6bbc21b1-1ab2-4f1b-97db-1bfd207b04cf req-5e610ba4-a762-4cd4-9f99-b27bb62d31e0 service nova] [instance: 3c2df162-332c-4391-95b8-223e07546d74] No waiting events found dispatching network-vif-plugged-cb361406-de4a-4ea5-a8ac-ba025104ee70 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:12:44 user nova-compute[72782]: WARNING nova.compute.manager [req-6bbc21b1-1ab2-4f1b-97db-1bfd207b04cf req-5e610ba4-a762-4cd4-9f99-b27bb62d31e0 service nova] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Received unexpected event network-vif-plugged-cb361406-de4a-4ea5-a8ac-ba025104ee70 for instance with vm_state deleted and task_state None.
Aug 14 20:12:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:12:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:12:58 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692043963.3294704, 3c2df162-332c-4391-95b8-223e07546d74 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:12:58 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 3c2df162-332c-4391-95b8-223e07546d74] VM Stopped (Lifecycle Event)
Aug 14 20:12:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-82f63e95-ef63-4321-a972-c68b5b42aed6 None None] [instance: 3c2df162-332c-4391-95b8-223e07546d74] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:12:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:13:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-e40e740c-3ae2-4aca-a656-9174ea7f1d13 req-4d071188-214b-4591-a46c-9688d356481b service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-changed-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:13:01 user nova-compute[72782]: DEBUG nova.compute.manager [req-e40e740c-3ae2-4aca-a656-9174ea7f1d13 req-4d071188-214b-4591-a46c-9688d356481b service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Refreshing instance network info cache due to event network-changed-11c9663c-f497-486e-b56b-020a2fd52c7c. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:13:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e40e740c-3ae2-4aca-a656-9174ea7f1d13 req-4d071188-214b-4591-a46c-9688d356481b service nova] Acquiring lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:13:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e40e740c-3ae2-4aca-a656-9174ea7f1d13 req-4d071188-214b-4591-a46c-9688d356481b service nova] Acquired lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:13:01 user nova-compute[72782]: DEBUG nova.network.neutron [req-e40e740c-3ae2-4aca-a656-9174ea7f1d13 req-4d071188-214b-4591-a46c-9688d356481b service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Refreshing network info cache for port 11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:13:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "30923083-4653-4765-a462-4037325fa001" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "30923083-4653-4765-a462-4037325fa001" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:01 user nova-compute[72782]: INFO nova.compute.manager [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Detaching volume 01e84039-b08a-4e91-bac2-a408df3e1bba
Aug 14 20:13:01 user nova-compute[72782]: DEBUG nova.network.neutron [req-e40e740c-3ae2-4aca-a656-9174ea7f1d13 req-4d071188-214b-4591-a46c-9688d356481b service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Updated VIF entry in instance network info cache for port 11c9663c-f497-486e-b56b-020a2fd52c7c. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:13:01 user nova-compute[72782]: DEBUG nova.network.neutron [req-e40e740c-3ae2-4aca-a656-9174ea7f1d13 req-4d071188-214b-4591-a46c-9688d356481b service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Updating instance_info_cache with network_info: [{"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:13:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e40e740c-3ae2-4aca-a656-9174ea7f1d13 req-4d071188-214b-4591-a46c-9688d356481b service nova] Releasing lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:13:01 user nova-compute[72782]: INFO nova.virt.block_device [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Attempting to driver detach volume 01e84039-b08a-4e91-bac2-a408df3e1bba from mountpoint /dev/vdb
Aug 14 20:13:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Attempting to detach device vdb from instance 30923083-4653-4765-a462-4037325fa001 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 20:13:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:13:01 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:13:01 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:13:01 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:13:01 user nova-compute[72782]:   <serial>01e84039-b08a-4e91-bac2-a408df3e1bba</serial>
Aug 14 20:13:01 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 20:13:01 user nova-compute[72782]: </disk>
Aug 14 20:13:01 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:13:01 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Successfully detached device vdb from instance 30923083-4653-4765-a462-4037325fa001 from the persistent domain config.
Aug 14 20:13:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 30923083-4653-4765-a462-4037325fa001 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 20:13:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:13:01 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:13:01 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:13:01 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:13:01 user nova-compute[72782]:   <serial>01e84039-b08a-4e91-bac2-a408df3e1bba</serial>
Aug 14 20:13:01 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 20:13:01 user nova-compute[72782]: </disk>
Aug 14 20:13:01 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692043982.1214604, 30923083-4653-4765-a462-4037325fa001 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 30923083-4653-4765-a462-4037325fa001 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 20:13:02 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Successfully detached device vdb from instance 30923083-4653-4765-a462-4037325fa001 from the live domain config.
Aug 14 20:13:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgTLbzHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:13:02 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:13:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d3342d-1078-4cb1-a79d-94cd8edfcda6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a43f2a-02eb-4370-89ad-d39a185f2b05]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba (non-flash)
Aug 14 20:13:02 user nova-compute[72782]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 (non-flash)
Aug 14 20:13:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba (non-flash)
Aug 14 20:13:02 user nova-compute[72782]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 (non-flash)
Aug 14 20:13:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f64085b5000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ab1e04-ed42-46f3-8cc2-484294e524f3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[877fa9f1-5d1c-4390-bd92-5b26f76f6b1c]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57558c2-1932-424c-9068-c35e5839f476]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ed854c-0c57-4055-9023-c95f692a689f]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d859b9-3bcd-43d0-9965-45c427ed76c9]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b31ca0b-9e2a-47f6-94ae-cad6ff082fea]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba, portal: 172.16.0.220,3260]
Aug 14 20:13:02 user nova-compute[72782]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba, portal: 172.16.0.220,3260] successful.
Aug 14 20:13:02 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e84039-b08a-4e91-bac2-a408df3e1bba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b2ce5c-d1f6-4465-bf1e-f7f54a50cb19]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] <== disconnect_volume: return (266ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:13:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:13:03 user nova-compute[72782]: DEBUG nova.objects.instance [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'flavor' on Instance uuid 30923083-4653-4765-a462-4037325fa001 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:13:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-dc725a32-0860-4453-a006-ef6bec7e442b tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "30923083-4653-4765-a462-4037325fa001" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.609s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-b0fd8533-801d-4d53-bc29-788aef76289b req-872611f3-82de-4590-84d0-cd21ba6ef215 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-changed-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:13:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-b0fd8533-801d-4d53-bc29-788aef76289b req-872611f3-82de-4590-84d0-cd21ba6ef215 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Refreshing instance network info cache due to event network-changed-11c9663c-f497-486e-b56b-020a2fd52c7c. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:13:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b0fd8533-801d-4d53-bc29-788aef76289b req-872611f3-82de-4590-84d0-cd21ba6ef215 service nova] Acquiring lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:13:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b0fd8533-801d-4d53-bc29-788aef76289b req-872611f3-82de-4590-84d0-cd21ba6ef215 service nova] Acquired lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:13:03 user nova-compute[72782]: DEBUG nova.network.neutron [req-b0fd8533-801d-4d53-bc29-788aef76289b req-872611f3-82de-4590-84d0-cd21ba6ef215 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Refreshing network info cache for port 11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:13:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:03 user nova-compute[72782]: DEBUG nova.network.neutron [req-b0fd8533-801d-4d53-bc29-788aef76289b req-872611f3-82de-4590-84d0-cd21ba6ef215 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Updated VIF entry in instance network info cache for port 11c9663c-f497-486e-b56b-020a2fd52c7c. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:13:03 user nova-compute[72782]: DEBUG nova.network.neutron [req-b0fd8533-801d-4d53-bc29-788aef76289b req-872611f3-82de-4590-84d0-cd21ba6ef215 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Updating instance_info_cache with network_info: [{"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:13:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b0fd8533-801d-4d53-bc29-788aef76289b req-872611f3-82de-4590-84d0-cd21ba6ef215 service nova] Releasing lock "refresh_cache-30923083-4653-4765-a462-4037325fa001" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:13:04 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:13:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:13:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:13:13 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:13:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:13:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:13:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:13:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:13:13 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:13:13 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:13:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:13 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Updating instance_info_cache with network_info: [{"id": "325817ed-4de8-4d31-afb7-d338d9391c55", "address": "fa:16:3e:83:cb:20", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325817ed-4d", "ovs_interfaceid": "325817ed-4de8-4d31-afb7-d338d9391c55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:13:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-0fa5392c-ea30-4007-bcdc-2802a46ed7a2" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:13:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:13:14 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:13:16 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:13:17 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:13:17 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:13:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:13:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:13:19 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:13:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:19 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:13:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:13:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:21 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:13:21 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:13:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8377MB free_disk=25.446422576904297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:13:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:13:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2c924d52-aa8a-47ed-857c-b863efe95258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:13:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 30923083-4653-4765-a462-4037325fa001 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:13:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance a9a07178-5051-4ecb-850f-113402dfa682 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:13:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:13:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:13:21 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:13:21 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:13:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:13:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:13:24 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:13:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:33 user nova-compute[72782]: DEBUG nova.compute.manager [req-00a9cbb6-8b9b-4f9b-8b16-4c204fc7cc18 req-20ac9b2c-a0ee-403e-81a2-4fd6866becb9 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received event network-changed-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:13:33 user nova-compute[72782]: DEBUG nova.compute.manager [req-00a9cbb6-8b9b-4f9b-8b16-4c204fc7cc18 req-20ac9b2c-a0ee-403e-81a2-4fd6866becb9 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Refreshing instance network info cache due to event network-changed-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:13:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-00a9cbb6-8b9b-4f9b-8b16-4c204fc7cc18 req-20ac9b2c-a0ee-403e-81a2-4fd6866becb9 service nova] Acquiring lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:13:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-00a9cbb6-8b9b-4f9b-8b16-4c204fc7cc18 req-20ac9b2c-a0ee-403e-81a2-4fd6866becb9 service nova] Acquired lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:13:33 user nova-compute[72782]: DEBUG nova.network.neutron [req-00a9cbb6-8b9b-4f9b-8b16-4c204fc7cc18 req-20ac9b2c-a0ee-403e-81a2-4fd6866becb9 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Refreshing network info cache for port 76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:13:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:34 user nova-compute[72782]: DEBUG nova.network.neutron [req-00a9cbb6-8b9b-4f9b-8b16-4c204fc7cc18 req-20ac9b2c-a0ee-403e-81a2-4fd6866becb9 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Updated VIF entry in instance network info cache for port 76ee2f39-b22b-4c07-9aa6-9bdbbc52393e. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:13:34 user nova-compute[72782]: DEBUG nova.network.neutron [req-00a9cbb6-8b9b-4f9b-8b16-4c204fc7cc18 req-20ac9b2c-a0ee-403e-81a2-4fd6866becb9 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Updating instance_info_cache with network_info: [{"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:13:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-00a9cbb6-8b9b-4f9b-8b16-4c204fc7cc18 req-20ac9b2c-a0ee-403e-81a2-4fd6866becb9 service nova] Releasing lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:13:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "a9a07178-5051-4ecb-850f-113402dfa682" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "a9a07178-5051-4ecb-850f-113402dfa682" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:35 user nova-compute[72782]: INFO nova.compute.manager [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Shelve offloading
Aug 14 20:13:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-8033a6d6-eb30-45af-9443-b37d089db342 req-255c0e3b-51eb-459f-9df3-b8c3b585bdea service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received event network-vif-unplugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:13:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8033a6d6-eb30-45af-9443-b37d089db342 req-255c0e3b-51eb-459f-9df3-b8c3b585bdea service nova] Acquiring lock "a9a07178-5051-4ecb-850f-113402dfa682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8033a6d6-eb30-45af-9443-b37d089db342 req-255c0e3b-51eb-459f-9df3-b8c3b585bdea service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8033a6d6-eb30-45af-9443-b37d089db342 req-255c0e3b-51eb-459f-9df3-b8c3b585bdea service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-8033a6d6-eb30-45af-9443-b37d089db342 req-255c0e3b-51eb-459f-9df3-b8c3b585bdea service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] No waiting events found dispatching network-vif-unplugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:13:35 user nova-compute[72782]: WARNING nova.compute.manager [req-8033a6d6-eb30-45af-9443-b37d089db342 req-255c0e3b-51eb-459f-9df3-b8c3b585bdea service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received unexpected event network-vif-unplugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e for instance with vm_state active and task_state shelving.
Aug 14 20:13:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:35 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Instance destroyed successfully.
Aug 14 20:13:35 user nova-compute[72782]: DEBUG nova.compute.manager [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:13:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:13:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquired lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:13:35 user nova-compute[72782]: DEBUG nova.network.neutron [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:13:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:36 user nova-compute[72782]: DEBUG nova.network.neutron [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Updating instance_info_cache with network_info: [{"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:13:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Releasing lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received event network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] Acquiring lock "a9a07178-5051-4ecb-850f-113402dfa682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] No waiting events found dispatching network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:13:37 user nova-compute[72782]: WARNING nova.compute.manager [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received unexpected event network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e for instance with vm_state active and task_state shelving.
Aug 14 20:13:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received event network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] Acquiring lock "a9a07178-5051-4ecb-850f-113402dfa682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] No waiting events found dispatching network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:13:37 user nova-compute[72782]: WARNING nova.compute.manager [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received unexpected event network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e for instance with vm_state active and task_state shelving.
Aug 14 20:13:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received event network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] Acquiring lock "a9a07178-5051-4ecb-850f-113402dfa682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] No waiting events found dispatching network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:13:37 user nova-compute[72782]: WARNING nova.compute.manager [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received unexpected event network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e for instance with vm_state active and task_state shelving.
Aug 14 20:13:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received event network-vif-unplugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] Acquiring lock "a9a07178-5051-4ecb-850f-113402dfa682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] No waiting events found dispatching network-vif-unplugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:13:37 user nova-compute[72782]: WARNING nova.compute.manager [req-91486ce1-8514-45d5-8bb4-a8d21207c62b req-2ca97ba5-d05e-45cb-88cc-bca64bc7e3d8 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received unexpected event network-vif-unplugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e for instance with vm_state active and task_state shelving.
Aug 14 20:13:37 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Instance destroyed successfully.
Aug 14 20:13:37 user nova-compute[72782]: DEBUG nova.objects.instance [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lazy-loading 'resources' on Instance uuid a9a07178-5051-4ecb-850f-113402dfa682 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1943938335',display_name='tempest-TestShelveInstance-server-1943938335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1943938335',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkXzREVSXh3D8FqrMcNT1eaqAV2O3PHytdmYLqeEKhgHFXcrt2opcbmZgjUvXZuzqSCG5IGsiLjbmbLSWTFnMeyB9kzRqUjQuU8JN2tblBNVpbHSf9B07JWbp9O03FEJQ==',key_name='tempest-TestShelveInstance-114729578',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:11:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0a05a5fa43b4d7fbcc888cbd03384af',ramdisk_id='',reservation_id='r-h47r0r7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2109215903',owner_user_name='tempest-TestShelveInstance-2109215903-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:11:56Z,user_data=None,user_id='d98849817bd8443d8d332bd044833a66',uuid=a9a07178-5051-4ecb-850f-113402dfa682,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Converting VIF {"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=76ee2f39-b22b-4c07-9aa6-9bdbbc52393e,network=Network(5c8ea35b-08e7-49d8-8fbe-0d6603bb281c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ee2f39-b2') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG os_vif [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=76ee2f39-b22b-4c07-9aa6-9bdbbc52393e,network=Network(5c8ea35b-08e7-49d8-8fbe-0d6603bb281c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ee2f39-b2') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76ee2f39-b2, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:13:37 user nova-compute[72782]: INFO os_vif [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=76ee2f39-b22b-4c07-9aa6-9bdbbc52393e,network=Network(5c8ea35b-08e7-49d8-8fbe-0d6603bb281c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ee2f39-b2')
Aug 14 20:13:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tslePvrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:13:37 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:13:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:13:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8379b7b6-789c-420d-823e-26467c3cab35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e022128e-95a0-4830-88cc-05f16ef788fe]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 (non-flash)
Aug 14 20:13:38 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 (non-flash)
Aug 14 20:13:38 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e86a5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36'): ({'sdd'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Removing single pathed devices sdd {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe6cf3e-d356-488b-84f7-36907217a954]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[611ebc21-4528-4727-9fb6-6e4e88feb64c]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Flushing IO for device /dev/sdd {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0305a0c-128f-414b-ae97-c8fdc3a93245]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6790b85a-7d22-42ae-8f14-50380f4deb51]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] SCSI volumes sdd have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[28847a2c-2f5c-4ad6-828d-350e88a77d2e]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefb4db3-e513-4b3a-bf7f-50e6e96fae01]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36, portal: 172.16.0.220,3260]
Aug 14 20:13:38 user nova-compute[72782]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36, portal: 172.16.0.220,3260] successful.
Aug 14 20:13:38 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4976f38e-cd62-4633-884a-7baa1b300846]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] <== disconnect_volume: return (280ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:13:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:13:38 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Deleting instance files /opt/stack/data/nova/instances/a9a07178-5051-4ecb-850f-113402dfa682_del
Aug 14 20:13:38 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Deletion of /opt/stack/data/nova/instances/a9a07178-5051-4ecb-850f-113402dfa682_del complete
Aug 14 20:13:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:39 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Deleted allocations for instance a9a07178-5051-4ecb-850f-113402dfa682
Aug 14 20:13:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:39 user nova-compute[72782]: DEBUG nova.objects.instance [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lazy-loading 'numa_topology' on Instance uuid a9a07178-5051-4ecb-850f-113402dfa682 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:13:39 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:13:39 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:13:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-819c425a-b999-4bbc-9dd3-1c88a982c35c tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "a9a07178-5051-4ecb-850f-113402dfa682" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.515s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "be408523-bdab-4ac8-b2ea-65003af6d1d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:47 user nova-compute[72782]: DEBUG nova.compute.manager [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:13:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:13:48 user nova-compute[72782]: INFO nova.compute.claims [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Claim successful on node user
Aug 14 20:13:48 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG nova.network.neutron [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:13:48 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:13:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG nova.policy [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3090a5cb6ba34a7fb007d98a351c8313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8754bbf7f9945fba2bd1ad571f556f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:13:48 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Creating image(s)
Aug 14 20:13:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "/opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "/opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "/opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk 1073741824" returned: 0 in 0.051s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG nova.network.neutron [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Successfully created port: 6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.193s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Cannot resize image /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG nova.objects.instance [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'migration_context' on Instance uuid be408523-bdab-4ac8-b2ea-65003af6d1d7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Ensure instance console log exists: /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG nova.network.neutron [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Successfully updated port: 6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquired lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG nova.network.neutron [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-4fced330-8d65-45c4-854e-d593bab38418 req-75abf8d0-27b8-45b3-83c6-48852cb91031 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received event network-changed-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-4fced330-8d65-45c4-854e-d593bab38418 req-75abf8d0-27b8-45b3-83c6-48852cb91031 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Refreshing instance network info cache due to event network-changed-6f79c61c-2a19-4e1d-9661-6dccabb07572. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4fced330-8d65-45c4-854e-d593bab38418 req-75abf8d0-27b8-45b3-83c6-48852cb91031 service nova] Acquiring lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:13:49 user nova-compute[72782]: DEBUG nova.network.neutron [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.network.neutron [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Updating instance_info_cache with network_info: [{"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Releasing lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Instance network_info: |[{"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4fced330-8d65-45c4-854e-d593bab38418 req-75abf8d0-27b8-45b3-83c6-48852cb91031 service nova] Acquired lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.network.neutron [req-4fced330-8d65-45c4-854e-d593bab38418 req-75abf8d0-27b8-45b3-83c6-48852cb91031 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Refreshing network info cache for port 6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Start _get_guest_xml network_info=[{"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:13:50 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:13:50 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-677276841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-677276841',id=38,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8Uj8zUnrkLTabv1RW3o8Wjjs2cJCkSEF6Sq2fXEMYcLeivZLio4OyDTatGotv181HghXlTiTtSJpCmTIT7gSAT44MCn+0NAkSnkNGXlqDb3Drqo0qiXvUqYDHGzF0JdQ==',key_name='tempest-keypair-1426773445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8754bbf7f9945fba2bd1ad571f556f6',ramdisk_id='',reservation_id='r-y67p6eax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-220778544',owner_user_name='tempest-AttachVolumeShelveTestJSON-220778544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3090a5cb6ba34a7fb007d98a351c8313',uuid=be408523-bdab-4ac8-b2ea-65003af6d1d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converting VIF {"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:98:04,bridge_name='br-int',has_traffic_filtering=True,id=6f79c61c-2a19-4e1d-9661-6dccabb07572,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f79c61c-2a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.objects.instance [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'pci_devices' on Instance uuid be408523-bdab-4ac8-b2ea-65003af6d1d7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:13:50 user nova-compute[72782]:   <uuid>be408523-bdab-4ac8-b2ea-65003af6d1d7</uuid>
Aug 14 20:13:50 user nova-compute[72782]:   <name>instance-00000026</name>
Aug 14 20:13:50 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:13:50 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:13:50 user nova-compute[72782]:   <metadata>
Aug 14 20:13:50 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:13:50 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:13:50 user nova-compute[72782]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-677276841</nova:name>
Aug 14 20:13:50 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:13:50</nova:creationTime>
Aug 14 20:13:50 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:13:50 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:13:50 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:13:50 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:13:50 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:13:50 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:13:50 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:13:50 user nova-compute[72782]:       <nova:owner>
Aug 14 20:13:50 user nova-compute[72782]:         <nova:user uuid="3090a5cb6ba34a7fb007d98a351c8313">tempest-AttachVolumeShelveTestJSON-220778544-project-member</nova:user>
Aug 14 20:13:50 user nova-compute[72782]:         <nova:project uuid="d8754bbf7f9945fba2bd1ad571f556f6">tempest-AttachVolumeShelveTestJSON-220778544</nova:project>
Aug 14 20:13:50 user nova-compute[72782]:       </nova:owner>
Aug 14 20:13:50 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 20:13:50 user nova-compute[72782]:       <nova:ports>
Aug 14 20:13:50 user nova-compute[72782]:         <nova:port uuid="6f79c61c-2a19-4e1d-9661-6dccabb07572">
Aug 14 20:13:50 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 20:13:50 user nova-compute[72782]:         </nova:port>
Aug 14 20:13:50 user nova-compute[72782]:       </nova:ports>
Aug 14 20:13:50 user nova-compute[72782]:     </nova:instance>
Aug 14 20:13:50 user nova-compute[72782]:   </metadata>
Aug 14 20:13:50 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:13:50 user nova-compute[72782]:     <system>
Aug 14 20:13:50 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:13:50 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:13:50 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:13:50 user nova-compute[72782]:       <entry name="serial">be408523-bdab-4ac8-b2ea-65003af6d1d7</entry>
Aug 14 20:13:50 user nova-compute[72782]:       <entry name="uuid">be408523-bdab-4ac8-b2ea-65003af6d1d7</entry>
Aug 14 20:13:50 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:13:50 user nova-compute[72782]:     </system>
Aug 14 20:13:50 user nova-compute[72782]:   </sysinfo>
Aug 14 20:13:50 user nova-compute[72782]:   <os>
Aug 14 20:13:50 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:13:50 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:13:50 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:13:50 user nova-compute[72782]:   </os>
Aug 14 20:13:50 user nova-compute[72782]:   <features>
Aug 14 20:13:50 user nova-compute[72782]:     <acpi/>
Aug 14 20:13:50 user nova-compute[72782]:     <apic/>
Aug 14 20:13:50 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:13:50 user nova-compute[72782]:   </features>
Aug 14 20:13:50 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:13:50 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:13:50 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:13:50 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:13:50 user nova-compute[72782]:   </clock>
Aug 14 20:13:50 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:13:50 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:13:50 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:13:50 user nova-compute[72782]:   </cpu>
Aug 14 20:13:50 user nova-compute[72782]:   <devices>
Aug 14 20:13:50 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:13:50 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:13:50 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk"/>
Aug 14 20:13:50 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:13:50 user nova-compute[72782]:     </disk>
Aug 14 20:13:50 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:13:50 user nova-compute[72782]:       <mac address="fa:16:3e:2d:98:04"/>
Aug 14 20:13:50 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:13:50 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:13:50 user nova-compute[72782]:       <target dev="tap6f79c61c-2a"/>
Aug 14 20:13:50 user nova-compute[72782]:     </interface>
Aug 14 20:13:50 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:13:50 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/console.log" append="off"/>
Aug 14 20:13:50 user nova-compute[72782]:     </serial>
Aug 14 20:13:50 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:13:50 user nova-compute[72782]:     <video>
Aug 14 20:13:50 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:13:50 user nova-compute[72782]:     </video>
Aug 14 20:13:50 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:13:50 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:13:50 user nova-compute[72782]:     </rng>
Aug 14 20:13:50 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:13:50 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:13:50 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:13:50 user nova-compute[72782]:     </memballoon>
Aug 14 20:13:50 user nova-compute[72782]:   </devices>
Aug 14 20:13:50 user nova-compute[72782]: </domain>
Aug 14 20:13:50 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-677276841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-677276841',id=38,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8Uj8zUnrkLTabv1RW3o8Wjjs2cJCkSEF6Sq2fXEMYcLeivZLio4OyDTatGotv181HghXlTiTtSJpCmTIT7gSAT44MCn+0NAkSnkNGXlqDb3Drqo0qiXvUqYDHGzF0JdQ==',key_name='tempest-keypair-1426773445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8754bbf7f9945fba2bd1ad571f556f6',ramdisk_id='',reservation_id='r-y67p6eax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-220778544',owner_user_name='tempest-AttachVolumeShelveTestJSON-220778544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3090a5cb6ba34a7fb007d98a351c8313',uuid=be408523-bdab-4ac8-b2ea-65003af6d1d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converting VIF {"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:98:04,bridge_name='br-int',has_traffic_filtering=True,id=6f79c61c-2a19-4e1d-9661-6dccabb07572,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f79c61c-2a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG os_vif [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:98:04,bridge_name='br-int',has_traffic_filtering=True,id=6f79c61c-2a19-4e1d-9661-6dccabb07572,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f79c61c-2a') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f79c61c-2a, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f79c61c-2a, col_values=(('external_ids', {'iface-id': '6f79c61c-2a19-4e1d-9661-6dccabb07572', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:98:04', 'vm-uuid': 'be408523-bdab-4ac8-b2ea-65003af6d1d7'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:50 user nova-compute[72782]: INFO os_vif [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:98:04,bridge_name='br-int',has_traffic_filtering=True,id=6f79c61c-2a19-4e1d-9661-6dccabb07572,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f79c61c-2a')
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] No VIF found with MAC fa:16:3e:2d:98:04, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692044015.8194516, a9a07178-5051-4ecb-850f-113402dfa682 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:13:50 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: a9a07178-5051-4ecb-850f-113402dfa682] VM Stopped (Lifecycle Event)
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8aff11e6-dfd0-40d0-8058-6b4d163e3d48 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.network.neutron [req-4fced330-8d65-45c4-854e-d593bab38418 req-75abf8d0-27b8-45b3-83c6-48852cb91031 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Updated VIF entry in instance network info cache for port 6f79c61c-2a19-4e1d-9661-6dccabb07572. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG nova.network.neutron [req-4fced330-8d65-45c4-854e-d593bab38418 req-75abf8d0-27b8-45b3-83c6-48852cb91031 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Updating instance_info_cache with network_info: [{"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:13:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4fced330-8d65-45c4-854e-d593bab38418 req-75abf8d0-27b8-45b3-83c6-48852cb91031 service nova] Releasing lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:13:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "30923083-4653-4765-a462-4037325fa001" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "30923083-4653-4765-a462-4037325fa001" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:51 user nova-compute[72782]: INFO nova.compute.manager [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Terminating instance
Aug 14 20:13:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-903e62bb-a546-4247-9faa-2ca88ec23f34 req-b5e1e1fe-0b88-40bf-9e1e-c9b63c264c65 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-unplugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-903e62bb-a546-4247-9faa-2ca88ec23f34 req-b5e1e1fe-0b88-40bf-9e1e-c9b63c264c65 service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-903e62bb-a546-4247-9faa-2ca88ec23f34 req-b5e1e1fe-0b88-40bf-9e1e-c9b63c264c65 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-903e62bb-a546-4247-9faa-2ca88ec23f34 req-b5e1e1fe-0b88-40bf-9e1e-c9b63c264c65 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-903e62bb-a546-4247-9faa-2ca88ec23f34 req-b5e1e1fe-0b88-40bf-9e1e-c9b63c264c65 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-unplugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-903e62bb-a546-4247-9faa-2ca88ec23f34 req-b5e1e1fe-0b88-40bf-9e1e-c9b63c264c65 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-unplugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-8dd94894-cc4c-4fab-9be8-7292197d9052 req-a3fcd411-5780-4ede-9542-03ae009420c4 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received event network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8dd94894-cc4c-4fab-9be8-7292197d9052 req-a3fcd411-5780-4ede-9542-03ae009420c4 service nova] Acquiring lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8dd94894-cc4c-4fab-9be8-7292197d9052 req-a3fcd411-5780-4ede-9542-03ae009420c4 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8dd94894-cc4c-4fab-9be8-7292197d9052 req-a3fcd411-5780-4ede-9542-03ae009420c4 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-8dd94894-cc4c-4fab-9be8-7292197d9052 req-a3fcd411-5780-4ede-9542-03ae009420c4 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] No waiting events found dispatching network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:13:52 user nova-compute[72782]: WARNING nova.compute.manager [req-8dd94894-cc4c-4fab-9be8-7292197d9052 req-a3fcd411-5780-4ede-9542-03ae009420c4 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received unexpected event network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 for instance with vm_state building and task_state spawning.
Aug 14 20:13:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:52 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 30923083-4653-4765-a462-4037325fa001] Instance destroyed successfully.
Aug 14 20:13:52 user nova-compute[72782]: DEBUG nova.objects.instance [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'resources' on Instance uuid 30923083-4653-4765-a462-4037325fa001 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-795552024',display_name='tempest-ServerRescueNegativeTestJSON-server-795552024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-795552024',id=36,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0yiT3zmo5sbJrskDDUxxyeV2VbJzCC2El/Wjm1lTyYi81OHOFnxFqeipFhtycgKjN0MNr9muEG5d15oXDQCVTcCdiqVAjoavh52Vv74S2H6TcEcZ+gnfSFbbJQuyLqAg==',key_name='tempest-keypair-600129027',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:09:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14952037d1dc44e7b64d0663c7a033c8',ramdisk_id='',reservation_id='r-w9x8ccbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1321611883',owner_user_name='tempest-ServerRescueNegativeTestJSON-1321611883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:11:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2d39528bc994a25b9e6fea9f6b8b34c',uuid=30923083-4653-4765-a462-4037325fa001,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converting VIF {"id": "11c9663c-f497-486e-b56b-020a2fd52c7c", "address": "fa:16:3e:8e:1f:99", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11c9663c-f4", "ovs_interfaceid": "11c9663c-f497-486e-b56b-020a2fd52c7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:1f:99,bridge_name='br-int',has_traffic_filtering=True,id=11c9663c-f497-486e-b56b-020a2fd52c7c,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c9663c-f4') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG os_vif [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:1f:99,bridge_name='br-int',has_traffic_filtering=True,id=11c9663c-f497-486e-b56b-020a2fd52c7c,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c9663c-f4') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11c9663c-f4, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:13:52 user nova-compute[72782]: INFO os_vif [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:1f:99,bridge_name='br-int',has_traffic_filtering=True,id=11c9663c-f497-486e-b56b-020a2fd52c7c,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11c9663c-f4')
Aug 14 20:13:52 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Deleting instance files /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001_del
Aug 14 20:13:52 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Deletion of /opt/stack/data/nova/instances/30923083-4653-4765-a462-4037325fa001_del complete
Aug 14 20:13:52 user nova-compute[72782]: INFO nova.compute.manager [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 30923083-4653-4765-a462-4037325fa001] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 14 20:13:52 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 30923083-4653-4765-a462-4037325fa001] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:13:52 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 30923083-4653-4765-a462-4037325fa001] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:13:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:53 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 30923083-4653-4765-a462-4037325fa001] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:13:53 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 30923083-4653-4765-a462-4037325fa001] Took 0.97 seconds to deallocate network for instance.
Aug 14 20:13:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:54 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Deleted allocations for instance 30923083-4653-4765-a462-4037325fa001
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7515e4f9-8b0e-4b00-9d93-7a26394da9ae tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "30923083-4653-4765-a462-4037325fa001" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.412s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:13:54 user nova-compute[72782]: WARNING nova.compute.manager [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state deleted and task_state None.
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:13:54 user nova-compute[72782]: WARNING nova.compute.manager [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state deleted and task_state None.
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:13:54 user nova-compute[72782]: WARNING nova.compute.manager [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state deleted and task_state None.
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-unplugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-unplugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:13:54 user nova-compute[72782]: WARNING nova.compute.manager [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-unplugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state deleted and task_state None.
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] Acquiring lock "30923083-4653-4765-a462-4037325fa001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] Lock "30923083-4653-4765-a462-4037325fa001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] No waiting events found dispatching network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:13:54 user nova-compute[72782]: WARNING nova.compute.manager [req-8593f612-071b-434a-b5a0-b6cd3f3c9d33 req-b2365d83-59ae-4f8a-bf1b-78315493b1e4 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received unexpected event network-vif-plugged-11c9663c-f497-486e-b56b-020a2fd52c7c for instance with vm_state deleted and task_state None.
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-043b00d5-7578-42e8-ad35-560610a448c9 req-aa61e995-1458-4fcd-9574-c0ba30dbd660 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received event network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-043b00d5-7578-42e8-ad35-560610a448c9 req-aa61e995-1458-4fcd-9574-c0ba30dbd660 service nova] Acquiring lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-043b00d5-7578-42e8-ad35-560610a448c9 req-aa61e995-1458-4fcd-9574-c0ba30dbd660 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-043b00d5-7578-42e8-ad35-560610a448c9 req-aa61e995-1458-4fcd-9574-c0ba30dbd660 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-043b00d5-7578-42e8-ad35-560610a448c9 req-aa61e995-1458-4fcd-9574-c0ba30dbd660 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] No waiting events found dispatching network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:13:54 user nova-compute[72782]: WARNING nova.compute.manager [req-043b00d5-7578-42e8-ad35-560610a448c9 req-aa61e995-1458-4fcd-9574-c0ba30dbd660 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received unexpected event network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 for instance with vm_state building and task_state spawning.
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-043b00d5-7578-42e8-ad35-560610a448c9 req-aa61e995-1458-4fcd-9574-c0ba30dbd660 service nova] [instance: 30923083-4653-4765-a462-4037325fa001] Received event network-vif-deleted-11c9663c-f497-486e-b56b-020a2fd52c7c {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044034.6039522, be408523-bdab-4ac8-b2ea-65003af6d1d7 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:13:54 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] VM Resumed (Lifecycle Event)
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:13:54 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Instance spawned successfully.
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:13:54 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044034.6044748, be408523-bdab-4ac8-b2ea-65003af6d1d7 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:13:54 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] VM Started (Lifecycle Event)
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:13:54 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:13:54 user nova-compute[72782]: INFO nova.compute.manager [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Took 6.21 seconds to spawn the instance on the hypervisor.
Aug 14 20:13:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:13:54 user nova-compute[72782]: INFO nova.compute.manager [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Took 6.77 seconds to build instance.
Aug 14 20:13:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-70d14650-76ad-4b9a-8858-c31e0fc37503 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.865s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:13:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:13:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:14:07 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692044032.8569725, 30923083-4653-4765-a462-4037325fa001 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:14:07 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 30923083-4653-4765-a462-4037325fa001] VM Stopped (Lifecycle Event)
Aug 14 20:14:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-e3a58cb8-1d51-4f88-acbb-3d8d6751971e None None] [instance: 30923083-4653-4765-a462-4037325fa001] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:14:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:14:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:14:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:14:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:14:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:11 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:14:12 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:14:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:14 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:14:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:14:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-2c924d52-aa8a-47ed-857c-b863efe95258" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:14:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-2c924d52-aa8a-47ed-857c-b863efe95258" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:14:14 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:14:14 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Updating instance_info_cache with network_info: [{"id": "8b971464-be37-4d45-a3c6-05d413e65cb2", "address": "fa:16:3e:a0:14:ff", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b971464-be", "ovs_interfaceid": "8b971464-be37-4d45-a3c6-05d413e65cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:14:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-2c924d52-aa8a-47ed-857c-b863efe95258" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:14:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:14:15 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:14:16 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:14:17 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:14:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:14:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:19 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:14:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:14:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:14:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:14:19 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:14:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:14:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:14:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:14:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:14:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:14:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:14:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:14:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:14:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:14:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:14:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:14:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:14:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:14:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:14:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:14:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:14:20 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:14:20 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:14:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8439MB free_disk=25.443649291992188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:14:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:14:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:14:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:14:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2c924d52-aa8a-47ed-857c-b863efe95258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:14:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance be408523-bdab-4ac8-b2ea-65003af6d1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:14:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:14:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:14:21 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:14:21 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:14:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:14:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:14:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:24 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:14:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:14:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "2c924d52-aa8a-47ed-857c-b863efe95258" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "2c924d52-aa8a-47ed-857c-b863efe95258" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:14:55 user nova-compute[72782]: INFO nova.compute.manager [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Terminating instance
Aug 14 20:14:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG nova.compute.manager [req-4d6f025b-a2ab-428e-9b16-2bd5de67d800 req-dcd78017-2b02-4211-9b32-5a2b4efe418c service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received event network-vif-unplugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4d6f025b-a2ab-428e-9b16-2bd5de67d800 req-dcd78017-2b02-4211-9b32-5a2b4efe418c service nova] Acquiring lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4d6f025b-a2ab-428e-9b16-2bd5de67d800 req-dcd78017-2b02-4211-9b32-5a2b4efe418c service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4d6f025b-a2ab-428e-9b16-2bd5de67d800 req-dcd78017-2b02-4211-9b32-5a2b4efe418c service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG nova.compute.manager [req-4d6f025b-a2ab-428e-9b16-2bd5de67d800 req-dcd78017-2b02-4211-9b32-5a2b4efe418c service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] No waiting events found dispatching network-vif-unplugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG nova.compute.manager [req-4d6f025b-a2ab-428e-9b16-2bd5de67d800 req-dcd78017-2b02-4211-9b32-5a2b4efe418c service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received event network-vif-unplugged-8b971464-be37-4d45-a3c6-05d413e65cb2 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:55 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Instance destroyed successfully.
Aug 14 20:14:55 user nova-compute[72782]: DEBUG nova.objects.instance [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'resources' on Instance uuid 2c924d52-aa8a-47ed-857c-b863efe95258 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-351871757',display_name='tempest-ServerRescueNegativeTestJSON-server-351871757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-351871757',id=30,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:00:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14952037d1dc44e7b64d0663c7a033c8',ramdisk_id='',reservation_id='r-og2q6lkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1321611883',owner_user_name='tempest-ServerRescueNegativeTestJSON-1321611883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:00:28Z,user_data=None,user_id='d2d39528bc994a25b9e6fea9f6b8b34c',uuid=2c924d52-aa8a-47ed-857c-b863efe95258,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "8b971464-be37-4d45-a3c6-05d413e65cb2", "address": "fa:16:3e:a0:14:ff", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b971464-be", "ovs_interfaceid": "8b971464-be37-4d45-a3c6-05d413e65cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converting VIF {"id": "8b971464-be37-4d45-a3c6-05d413e65cb2", "address": "fa:16:3e:a0:14:ff", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b971464-be", "ovs_interfaceid": "8b971464-be37-4d45-a3c6-05d413e65cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:14:ff,bridge_name='br-int',has_traffic_filtering=True,id=8b971464-be37-4d45-a3c6-05d413e65cb2,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b971464-be') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG os_vif [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:14:ff,bridge_name='br-int',has_traffic_filtering=True,id=8b971464-be37-4d45-a3c6-05d413e65cb2,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b971464-be') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b971464-be, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:14:55 user nova-compute[72782]: INFO os_vif [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:14:ff,bridge_name='br-int',has_traffic_filtering=True,id=8b971464-be37-4d45-a3c6-05d413e65cb2,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b971464-be')
Aug 14 20:14:55 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Deleting instance files /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258_del
Aug 14 20:14:55 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Deletion of /opt/stack/data/nova/instances/2c924d52-aa8a-47ed-857c-b863efe95258_del complete
Aug 14 20:14:55 user nova-compute[72782]: INFO nova.compute.manager [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 14 20:14:55 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:14:55 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:14:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:14:56 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:14:56 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Took 0.60 seconds to deallocate network for instance.
Aug 14 20:14:56 user nova-compute[72782]: DEBUG nova.compute.manager [req-8663ea37-9fd9-407d-8cd5-0b6bfa745c0e req-8a871f68-eb98-4e76-b053-80e57d83cd6a service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received event network-vif-deleted-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:14:56 user nova-compute[72782]: INFO nova.compute.manager [req-8663ea37-9fd9-407d-8cd5-0b6bfa745c0e req-8a871f68-eb98-4e76-b053-80e57d83cd6a service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Neutron deleted interface 8b971464-be37-4d45-a3c6-05d413e65cb2; detaching it from the instance and deleting it from the info cache
Aug 14 20:14:56 user nova-compute[72782]: DEBUG nova.network.neutron [req-8663ea37-9fd9-407d-8cd5-0b6bfa745c0e req-8a871f68-eb98-4e76-b053-80e57d83cd6a service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:14:56 user nova-compute[72782]: DEBUG nova.compute.manager [req-8663ea37-9fd9-407d-8cd5-0b6bfa745c0e req-8a871f68-eb98-4e76-b053-80e57d83cd6a service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Detach interface failed, port_id=8b971464-be37-4d45-a3c6-05d413e65cb2, reason: Instance 2c924d52-aa8a-47ed-857c-b863efe95258 could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 20:14:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:14:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:14:56 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:14:56 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:14:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:14:56 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Deleted allocations for instance 2c924d52-aa8a-47ed-857c-b863efe95258
Aug 14 20:14:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-84b112e5-e668-4a6e-af44-5b2d40b12647 tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "2c924d52-aa8a-47ed-857c-b863efe95258" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.922s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received event network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] Acquiring lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] No waiting events found dispatching network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:14:57 user nova-compute[72782]: WARNING nova.compute.manager [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received unexpected event network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 for instance with vm_state deleted and task_state None.
Aug 14 20:14:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received event network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] Acquiring lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] No waiting events found dispatching network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:14:57 user nova-compute[72782]: WARNING nova.compute.manager [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received unexpected event network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 for instance with vm_state deleted and task_state None.
Aug 14 20:14:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received event network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] Acquiring lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] No waiting events found dispatching network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:14:57 user nova-compute[72782]: WARNING nova.compute.manager [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received unexpected event network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 for instance with vm_state deleted and task_state None.
Aug 14 20:14:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received event network-vif-unplugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] Acquiring lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] No waiting events found dispatching network-vif-unplugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:14:57 user nova-compute[72782]: WARNING nova.compute.manager [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received unexpected event network-vif-unplugged-8b971464-be37-4d45-a3c6-05d413e65cb2 for instance with vm_state deleted and task_state None.
Aug 14 20:14:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received event network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] Acquiring lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] Lock "2c924d52-aa8a-47ed-857c-b863efe95258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:14:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] No waiting events found dispatching network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:14:57 user nova-compute[72782]: WARNING nova.compute.manager [req-1ea2897e-44af-4f49-bea7-7ee0e47dcc40 req-fb76b9bb-1e3c-41e4-af7c-d22f0914f2ae service nova] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Received unexpected event network-vif-plugged-8b971464-be37-4d45-a3c6-05d413e65cb2 for instance with vm_state deleted and task_state None.
Aug 14 20:15:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:15:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:15:10 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692044095.8775358, 2c924d52-aa8a-47ed-857c-b863efe95258 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:15:10 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] VM Stopped (Lifecycle Event)
Aug 14 20:15:10 user nova-compute[72782]: DEBUG nova.compute.manager [None req-44d07a93-1cca-4185-bb4d-a0df34a43d00 None None] [instance: 2c924d52-aa8a-47ed-857c-b863efe95258] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:15:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:15:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:15:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:15:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:15:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:12 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:15:14 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:15:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:15:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Skipping network cache update for instance because it has been migrated to another host. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 14 20:15:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 20:15:14 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:15:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:15:17 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:15:17 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:15:17 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:15:17 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:15:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:15:19 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:15:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:15:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:15:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:15:19 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:15:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:19 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:20 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:15:20 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:15:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8571MB free_disk=25.470626831054688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:15:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:15:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:15:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:15:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance be408523-bdab-4ac8-b2ea-65003af6d1d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:15:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:15:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:15:20 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:15:20 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:15:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:15:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:15:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:23 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:15:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:15:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:15:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:15:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:15:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "a9a07178-5051-4ecb-850f-113402dfa682" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:15:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "a9a07178-5051-4ecb-850f-113402dfa682" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:15:26 user nova-compute[72782]: INFO nova.compute.manager [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Unshelving
Aug 14 20:15:26 user nova-compute[72782]: INFO nova.virt.block_device [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Booting with volume b1f19ce5-e794-4bd1-b546-4a8bb1365f36 at /dev/vda
Aug 14 20:15:27 user nova-compute[72782]: DEBUG os_brick.utils [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b835186-fcaa-4bcd-b9a8-dbba9c8db7d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9092b286-0a14-4f0c-8d57-c029edc3aabd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[780242c1-f1c3-4447-b48a-cae99aec417d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[de86060b-d879-43b5-b063-fb141ff57170]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:15:27 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:15:27 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4940b984-c452-4df7-b86e-bac933d21c59]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG os_brick.utils [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:15:27 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Updating existing volume attachment record: da365c4b-a476-46d3-981d-f9b0f2bf388b {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:15:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:15:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:15:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-630d0040-69ed-4776-ba0c-218adc4d8b74 req-fb204087-de25-4685-b621-96da5aa4ef08 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received event network-changed-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:15:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-630d0040-69ed-4776-ba0c-218adc4d8b74 req-fb204087-de25-4685-b621-96da5aa4ef08 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Refreshing instance network info cache due to event network-changed-6f79c61c-2a19-4e1d-9661-6dccabb07572. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:15:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-630d0040-69ed-4776-ba0c-218adc4d8b74 req-fb204087-de25-4685-b621-96da5aa4ef08 service nova] Acquiring lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:15:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-630d0040-69ed-4776-ba0c-218adc4d8b74 req-fb204087-de25-4685-b621-96da5aa4ef08 service nova] Acquired lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:15:39 user nova-compute[72782]: DEBUG nova.network.neutron [req-630d0040-69ed-4776-ba0c-218adc4d8b74 req-fb204087-de25-4685-b621-96da5aa4ef08 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Refreshing network info cache for port 6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:15:39 user nova-compute[72782]: DEBUG nova.network.neutron [req-630d0040-69ed-4776-ba0c-218adc4d8b74 req-fb204087-de25-4685-b621-96da5aa4ef08 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Updated VIF entry in instance network info cache for port 6f79c61c-2a19-4e1d-9661-6dccabb07572. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:15:39 user nova-compute[72782]: DEBUG nova.network.neutron [req-630d0040-69ed-4776-ba0c-218adc4d8b74 req-fb204087-de25-4685-b621-96da5aa4ef08 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Updating instance_info_cache with network_info: [{"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:15:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-630d0040-69ed-4776-ba0c-218adc4d8b74 req-fb204087-de25-4685-b621-96da5aa4ef08 service nova] Releasing lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:15:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:15:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:15:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:15:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:15:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:15:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:15:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:15:41 user nova-compute[72782]: DEBUG nova.objects.instance [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lazy-loading 'pci_requests' on Instance uuid a9a07178-5051-4ecb-850f-113402dfa682 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:15:41 user nova-compute[72782]: DEBUG nova.objects.instance [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lazy-loading 'numa_topology' on Instance uuid a9a07178-5051-4ecb-850f-113402dfa682 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:15:41 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:15:41 user nova-compute[72782]: INFO nova.compute.claims [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Claim successful on node user
Aug 14 20:15:41 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:15:41 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:15:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:15:41 user nova-compute[72782]: INFO nova.network.neutron [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Updating port 76ee2f39-b22b-4c07-9aa6-9bdbbc52393e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 20:15:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:15:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquired lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:15:42 user nova-compute[72782]: DEBUG nova.network.neutron [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:15:42 user nova-compute[72782]: DEBUG nova.compute.manager [req-49f4fccf-4ff1-4fa8-a777-2b6125e7806d req-d700556f-f9c1-42df-a899-976ee0d2e89d service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received event network-changed-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:15:42 user nova-compute[72782]: DEBUG nova.compute.manager [req-49f4fccf-4ff1-4fa8-a777-2b6125e7806d req-d700556f-f9c1-42df-a899-976ee0d2e89d service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Refreshing instance network info cache due to event network-changed-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:15:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-49f4fccf-4ff1-4fa8-a777-2b6125e7806d req-d700556f-f9c1-42df-a899-976ee0d2e89d service nova] Acquiring lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.network.neutron [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Updating instance_info_cache with network_info: [{"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Releasing lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:15:43 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Creating image(s)
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Did not create local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Ensure instance console log exists: /opt/stack/data/nova/instances/a9a07178-5051-4ecb-850f-113402dfa682/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Start _get_guest_xml network_info=[{"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'da365c4b-a476-46d3-981d-f9b0f2bf388b', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tslePvrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9a07178-5051-4ecb-850f-113402dfa682', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1f19ce5-e794-4bd1-b546-4a8bb1365f36', 'serial': 'b1f19ce5-e794-4bd1-b546-4a8bb1365f36'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-49f4fccf-4ff1-4fa8-a777-2b6125e7806d req-d700556f-f9c1-42df-a899-976ee0d2e89d service nova] Acquired lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.network.neutron [req-49f4fccf-4ff1-4fa8-a777-2b6125e7806d req-d700556f-f9c1-42df-a899-976ee0d2e89d service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Refreshing network info cache for port 76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:15:43 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:15:43 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.objects.instance [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lazy-loading 'vcpu_model' on Instance uuid a9a07178-5051-4ecb-850f-113402dfa682 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tslePvrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:15:43 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:15:43 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:15:43 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f041fb3-ab86-4530-a324-96cf947b6535]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:15:43 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea49e19-951d-4d01-b982-3e0918df7049]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36] added
Aug 14 20:15:43 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caffdc0-b412-4558-bfa1-c1da39803fe6]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c575bac0-10e0-46bb-9557-e7c17e424a39]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tslePvrc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tslePvrc" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[06abbb4c-1924-47d9-8ceb-587761a80a65]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tslePvrc'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb0a9f8-2b9d-4a41-91cd-340c5c0a3e07]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb2a91c-3b4f-4d2a-985f-832b64a1a577]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:15:43 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:15:43 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:15:43 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 20:15:43 user nova-compute[72782]: 
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d7eec3-7abd-43ec-a0c1-3eec498ac8b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36, portal: 172.16.0.220,3260]
Aug 14 20:15:43 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36, portal: 172.16.0.220,3260] successful.
Aug 14 20:15:43 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1118b508-09b3-4619-9ddf-13e8c689f1f1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca4ffbe-fc95-4a12-b731-db0007d2d46a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 (non-flash)
Aug 14 20:15:43 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 (non-flash)
Aug 14 20:15:43 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15969b9-adca-4086-ad51-c0cdd8529e40]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tslePvrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.network.neutron [req-49f4fccf-4ff1-4fa8-a777-2b6125e7806d req-d700556f-f9c1-42df-a899-976ee0d2e89d service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Updated VIF entry in instance network info cache for port 76ee2f39-b22b-4c07-9aa6-9bdbbc52393e. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG nova.network.neutron [req-49f4fccf-4ff1-4fa8-a777-2b6125e7806d req-d700556f-f9c1-42df-a899-976ee0d2e89d service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Updating instance_info_cache with network_info: [{"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:15:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-49f4fccf-4ff1-4fa8-a777-2b6125e7806d req-d700556f-f9c1-42df-a899-976ee0d2e89d service nova] Releasing lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23935356337636639', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935356337636639', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T20:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1943938335',display_name='tempest-TestShelveInstance-server-1943938335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1943938335',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-114729578',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:11:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b0a05a5fa43b4d7fbcc888cbd03384af',ramdisk_id='',reservation_id='r-h47r0r7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2109215903',owner_user_name='tempest-TestShelveInstance-2109215903-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:15:27Z,user_data=None,user_id='d98849817bd8443d8d332bd044833a66',uuid=a9a07178-5051-4ecb-850f-113402dfa682,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Converting VIF {"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=76ee2f39-b22b-4c07-9aa6-9bdbbc52393e,network=Network(5c8ea35b-08e7-49d8-8fbe-0d6603bb281c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ee2f39-b2') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG nova.objects.instance [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lazy-loading 'pci_devices' on Instance uuid a9a07178-5051-4ecb-850f-113402dfa682 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:15:44 user nova-compute[72782]:   <uuid>a9a07178-5051-4ecb-850f-113402dfa682</uuid>
Aug 14 20:15:44 user nova-compute[72782]:   <name>instance-00000025</name>
Aug 14 20:15:44 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:15:44 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:15:44 user nova-compute[72782]:   <metadata>
Aug 14 20:15:44 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:15:44 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:15:44 user nova-compute[72782]:       <nova:name>tempest-TestShelveInstance-server-1943938335</nova:name>
Aug 14 20:15:44 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:15:43</nova:creationTime>
Aug 14 20:15:44 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:15:44 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:15:44 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:15:44 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:15:44 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:15:44 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:15:44 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:15:44 user nova-compute[72782]:       <nova:owner>
Aug 14 20:15:44 user nova-compute[72782]:         <nova:user uuid="d98849817bd8443d8d332bd044833a66">tempest-TestShelveInstance-2109215903-project-member</nova:user>
Aug 14 20:15:44 user nova-compute[72782]:         <nova:project uuid="b0a05a5fa43b4d7fbcc888cbd03384af">tempest-TestShelveInstance-2109215903</nova:project>
Aug 14 20:15:44 user nova-compute[72782]:       </nova:owner>
Aug 14 20:15:44 user nova-compute[72782]:       <nova:ports>
Aug 14 20:15:44 user nova-compute[72782]:         <nova:port uuid="76ee2f39-b22b-4c07-9aa6-9bdbbc52393e">
Aug 14 20:15:44 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 20:15:44 user nova-compute[72782]:         </nova:port>
Aug 14 20:15:44 user nova-compute[72782]:       </nova:ports>
Aug 14 20:15:44 user nova-compute[72782]:     </nova:instance>
Aug 14 20:15:44 user nova-compute[72782]:   </metadata>
Aug 14 20:15:44 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:15:44 user nova-compute[72782]:     <system>
Aug 14 20:15:44 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:15:44 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:15:44 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:15:44 user nova-compute[72782]:       <entry name="serial">a9a07178-5051-4ecb-850f-113402dfa682</entry>
Aug 14 20:15:44 user nova-compute[72782]:       <entry name="uuid">a9a07178-5051-4ecb-850f-113402dfa682</entry>
Aug 14 20:15:44 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:15:44 user nova-compute[72782]:     </system>
Aug 14 20:15:44 user nova-compute[72782]:   </sysinfo>
Aug 14 20:15:44 user nova-compute[72782]:   <os>
Aug 14 20:15:44 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:15:44 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:15:44 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:15:44 user nova-compute[72782]:   </os>
Aug 14 20:15:44 user nova-compute[72782]:   <features>
Aug 14 20:15:44 user nova-compute[72782]:     <acpi/>
Aug 14 20:15:44 user nova-compute[72782]:     <apic/>
Aug 14 20:15:44 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:15:44 user nova-compute[72782]:   </features>
Aug 14 20:15:44 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:15:44 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:15:44 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:15:44 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:15:44 user nova-compute[72782]:   </clock>
Aug 14 20:15:44 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:15:44 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:15:44 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:15:44 user nova-compute[72782]:   </cpu>
Aug 14 20:15:44 user nova-compute[72782]:   <devices>
Aug 14 20:15:44 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 20:15:44 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:15:44 user nova-compute[72782]:       <source dev="/dev/sdb"/>
Aug 14 20:15:44 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:15:44 user nova-compute[72782]:       <serial>b1f19ce5-e794-4bd1-b546-4a8bb1365f36</serial>
Aug 14 20:15:44 user nova-compute[72782]:     </disk>
Aug 14 20:15:44 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:15:44 user nova-compute[72782]:       <mac address="fa:16:3e:df:32:2b"/>
Aug 14 20:15:44 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:15:44 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:15:44 user nova-compute[72782]:       <target dev="tap76ee2f39-b2"/>
Aug 14 20:15:44 user nova-compute[72782]:     </interface>
Aug 14 20:15:44 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:15:44 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/a9a07178-5051-4ecb-850f-113402dfa682/console.log" append="off"/>
Aug 14 20:15:44 user nova-compute[72782]:     </serial>
Aug 14 20:15:44 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:15:44 user nova-compute[72782]:     <video>
Aug 14 20:15:44 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:15:44 user nova-compute[72782]:     </video>
Aug 14 20:15:44 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:15:44 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:15:44 user nova-compute[72782]:     </rng>
Aug 14 20:15:44 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:15:44 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:15:44 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:15:44 user nova-compute[72782]:     </memballoon>
Aug 14 20:15:44 user nova-compute[72782]:   </devices>
Aug 14 20:15:44 user nova-compute[72782]: </domain>
Aug 14 20:15:44 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T20:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1943938335',display_name='tempest-TestShelveInstance-server-1943938335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1943938335',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-114729578',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:11:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b0a05a5fa43b4d7fbcc888cbd03384af',ramdisk_id='',reservation_id='r-h47r0r7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2109215903',owner_user_name='tempest-TestShelveInstance-2109215903-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:15:27Z,user_data=None,user_id='d98849817bd8443d8d332bd044833a66',uuid=a9a07178-5051-4ecb-850f-113402dfa682,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Converting VIF {"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=76ee2f39-b22b-4c07-9aa6-9bdbbc52393e,network=Network(5c8ea35b-08e7-49d8-8fbe-0d6603bb281c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ee2f39-b2') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG os_vif [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=76ee2f39-b22b-4c07-9aa6-9bdbbc52393e,network=Network(5c8ea35b-08e7-49d8-8fbe-0d6603bb281c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ee2f39-b2') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76ee2f39-b2, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap76ee2f39-b2, col_values=(('external_ids', {'iface-id': '76ee2f39-b22b-4c07-9aa6-9bdbbc52393e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:32:2b', 'vm-uuid': 'a9a07178-5051-4ecb-850f-113402dfa682'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:44 user nova-compute[72782]: INFO os_vif [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=76ee2f39-b22b-4c07-9aa6-9bdbbc52393e,network=Network(5c8ea35b-08e7-49d8-8fbe-0d6603bb281c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ee2f39-b2')
Aug 14 20:15:44 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] No VIF found with MAC fa:16:3e:df:32:2b, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "be408523-bdab-4ac8-b2ea-65003af6d1d7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:15:44 user nova-compute[72782]: INFO nova.compute.manager [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Shelving
Aug 14 20:15:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG nova.compute.manager [req-82cd4724-33a2-4369-9ce0-652e74935ebe req-ac165bc8-0f8e-43b4-8afd-ed2dec0df220 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received event network-vif-unplugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-82cd4724-33a2-4369-9ce0-652e74935ebe req-ac165bc8-0f8e-43b4-8afd-ed2dec0df220 service nova] Acquiring lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-82cd4724-33a2-4369-9ce0-652e74935ebe req-ac165bc8-0f8e-43b4-8afd-ed2dec0df220 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-82cd4724-33a2-4369-9ce0-652e74935ebe req-ac165bc8-0f8e-43b4-8afd-ed2dec0df220 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG nova.compute.manager [req-82cd4724-33a2-4369-9ce0-652e74935ebe req-ac165bc8-0f8e-43b4-8afd-ed2dec0df220 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] No waiting events found dispatching network-vif-unplugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:15:45 user nova-compute[72782]: WARNING nova.compute.manager [req-82cd4724-33a2-4369-9ce0-652e74935ebe req-ac165bc8-0f8e-43b4-8afd-ed2dec0df220 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received unexpected event network-vif-unplugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 for instance with vm_state active and task_state shelving.
Aug 14 20:15:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:15:45 user nova-compute[72782]: INFO nova.compute.manager [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Terminating instance
Aug 14 20:15:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG nova.compute.manager [req-d6c39407-6fe7-4b8c-ab60-08df1405057d req-926fa47c-9d24-420c-9ec2-4e1aebf7b6ea service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-vif-unplugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d6c39407-6fe7-4b8c-ab60-08df1405057d req-926fa47c-9d24-420c-9ec2-4e1aebf7b6ea service nova] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d6c39407-6fe7-4b8c-ab60-08df1405057d req-926fa47c-9d24-420c-9ec2-4e1aebf7b6ea service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d6c39407-6fe7-4b8c-ab60-08df1405057d req-926fa47c-9d24-420c-9ec2-4e1aebf7b6ea service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG nova.compute.manager [req-d6c39407-6fe7-4b8c-ab60-08df1405057d req-926fa47c-9d24-420c-9ec2-4e1aebf7b6ea service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] No waiting events found dispatching network-vif-unplugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:15:45 user nova-compute[72782]: DEBUG nova.compute.manager [req-d6c39407-6fe7-4b8c-ab60-08df1405057d req-926fa47c-9d24-420c-9ec2-4e1aebf7b6ea service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-vif-unplugged-325817ed-4de8-4d31-afb7-d338d9391c55 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:15:46 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Instance destroyed successfully.
Aug 14 20:15:46 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Instance destroyed successfully.
Aug 14 20:15:46 user nova-compute[72782]: DEBUG nova.objects.instance [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lazy-loading 'resources' on Instance uuid 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:15:46 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:58:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-352284208',display_name='tempest-ServerRescueNegativeTestJSON-server-352284208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-352284208',id=29,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:03:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14952037d1dc44e7b64d0663c7a033c8',ramdisk_id='',reservation_id='r-j9s00kwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1321611883',owner_user_name='tempest-ServerRescueNegativeTestJSON-1321611883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:05:13Z,user_data=None,user_id='d2d39528bc994a25b9e6fea9f6b8b34c',uuid=0fa5392c-ea30-4007-bcdc-2802a46ed7a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "325817ed-4de8-4d31-afb7-d338d9391c55", "address": "fa:16:3e:83:cb:20", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325817ed-4d", "ovs_interfaceid": "325817ed-4de8-4d31-afb7-d338d9391c55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:15:46 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converting VIF {"id": "325817ed-4de8-4d31-afb7-d338d9391c55", "address": "fa:16:3e:83:cb:20", "network": {"id": "00126532-ad67-4419-bb70-216d9a61d657", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1579716566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14952037d1dc44e7b64d0663c7a033c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325817ed-4d", "ovs_interfaceid": "325817ed-4de8-4d31-afb7-d338d9391c55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:15:46 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:cb:20,bridge_name='br-int',has_traffic_filtering=True,id=325817ed-4de8-4d31-afb7-d338d9391c55,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325817ed-4d') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:15:46 user nova-compute[72782]: DEBUG os_vif [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:cb:20,bridge_name='br-int',has_traffic_filtering=True,id=325817ed-4de8-4d31-afb7-d338d9391c55,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325817ed-4d') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:15:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap325817ed-4d, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:15:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:15:46 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Beginning cold snapshot process
Aug 14 20:15:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:46 user nova-compute[72782]: INFO os_vif [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:cb:20,bridge_name='br-int',has_traffic_filtering=True,id=325817ed-4de8-4d31-afb7-d338d9391c55,network=Network(00126532-ad67-4419-bb70-216d9a61d657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325817ed-4d')
Aug 14 20:15:46 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Deleting instance files /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2_del
Aug 14 20:15:46 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Deletion of /opt/stack/data/nova/instances/0fa5392c-ea30-4007-bcdc-2802a46ed7a2_del complete
Aug 14 20:15:46 user nova-compute[72782]: INFO nova.compute.manager [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Took 0.79 seconds to destroy the instance on the hypervisor.
Aug 14 20:15:46 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:15:46 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:15:46 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:15:46 user nova-compute[72782]: DEBUG nova.privsep.utils [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72782) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 20:15:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk /opt/stack/data/nova/instances/snapshots/tmps5xyljsb/71aec440277844bb88276462a043a169 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:15:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk /opt/stack/data/nova/instances/snapshots/tmps5xyljsb/71aec440277844bb88276462a043a169" returned: 0 in 0.489s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:15:46 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Snapshot extracted, beginning image upload
Aug 14 20:15:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:47 user nova-compute[72782]: DEBUG nova.compute.manager [req-99f2cdfe-16e2-48b7-965e-c24e78b9eb4d req-c5ff1ab0-0d01-4205-9ee1-24743aa0a81c service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received event network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:15:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-99f2cdfe-16e2-48b7-965e-c24e78b9eb4d req-c5ff1ab0-0d01-4205-9ee1-24743aa0a81c service nova] Acquiring lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:15:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-99f2cdfe-16e2-48b7-965e-c24e78b9eb4d req-c5ff1ab0-0d01-4205-9ee1-24743aa0a81c service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:15:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-99f2cdfe-16e2-48b7-965e-c24e78b9eb4d req-c5ff1ab0-0d01-4205-9ee1-24743aa0a81c service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:15:47 user nova-compute[72782]: DEBUG nova.compute.manager [req-99f2cdfe-16e2-48b7-965e-c24e78b9eb4d req-c5ff1ab0-0d01-4205-9ee1-24743aa0a81c service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] No waiting events found dispatching network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:15:47 user nova-compute[72782]: WARNING nova.compute.manager [req-99f2cdfe-16e2-48b7-965e-c24e78b9eb4d req-c5ff1ab0-0d01-4205-9ee1-24743aa0a81c service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received unexpected event network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 for instance with vm_state active and task_state shelving_image_uploading.
Aug 14 20:15:47 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:15:47 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Took 1.51 seconds to deallocate network for instance.
Aug 14 20:15:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:15:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:15:47 user nova-compute[72782]: DEBUG nova.compute.manager [req-28a3e7aa-a2c6-4c9b-8b9d-6ab3d21d6160 req-b7274603-26fb-49ed-82d6-42bc417383e1 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:15:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-28a3e7aa-a2c6-4c9b-8b9d-6ab3d21d6160 req-b7274603-26fb-49ed-82d6-42bc417383e1 service nova] Acquiring lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:15:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-28a3e7aa-a2c6-4c9b-8b9d-6ab3d21d6160 req-b7274603-26fb-49ed-82d6-42bc417383e1 service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:15:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-28a3e7aa-a2c6-4c9b-8b9d-6ab3d21d6160 req-b7274603-26fb-49ed-82d6-42bc417383e1 service nova] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:15:47 user nova-compute[72782]: DEBUG nova.compute.manager [req-28a3e7aa-a2c6-4c9b-8b9d-6ab3d21d6160 req-b7274603-26fb-49ed-82d6-42bc417383e1 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] No waiting events found dispatching network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:15:47 user nova-compute[72782]: WARNING nova.compute.manager [req-28a3e7aa-a2c6-4c9b-8b9d-6ab3d21d6160 req-b7274603-26fb-49ed-82d6-42bc417383e1 service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received unexpected event network-vif-plugged-325817ed-4de8-4d31-afb7-d338d9391c55 for instance with vm_state deleted and task_state None.
Aug 14 20:15:47 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:15:48 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:15:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:15:48 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Deleted allocations for instance 0fa5392c-ea30-4007-bcdc-2802a46ed7a2
Aug 14 20:15:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f030f9b-1d24-4046-a426-80cda4ec72ed tempest-ServerRescueNegativeTestJSON-1321611883 tempest-ServerRescueNegativeTestJSON-1321611883-project-member] Lock "0fa5392c-ea30-4007-bcdc-2802a46ed7a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.667s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:15:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:48 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044148.8105557, a9a07178-5051-4ecb-850f-113402dfa682 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:15:48 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] VM Resumed (Lifecycle Event)
Aug 14 20:15:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:15:48 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:15:48 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Instance spawned successfully.
Aug 14 20:15:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:15:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:15:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:15:48 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:15:48 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044148.811755, a9a07178-5051-4ecb-850f-113402dfa682 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:15:48 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] VM Started (Lifecycle Event)
Aug 14 20:15:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:15:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:15:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-35bcbecb-54a1-48bb-b521-d0f90ae0a717 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "a9a07178-5051-4ecb-850f-113402dfa682" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.007s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:15:49 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Snapshot image upload complete
Aug 14 20:15:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:15:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-52dbf541-6bc2-45f6-8929-5143a4cce5eb req-3fc0341e-a660-4c6b-9147-12321a34b29d service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received event network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:15:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-52dbf541-6bc2-45f6-8929-5143a4cce5eb req-3fc0341e-a660-4c6b-9147-12321a34b29d service nova] Acquiring lock "a9a07178-5051-4ecb-850f-113402dfa682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:15:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-52dbf541-6bc2-45f6-8929-5143a4cce5eb req-3fc0341e-a660-4c6b-9147-12321a34b29d service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:15:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-52dbf541-6bc2-45f6-8929-5143a4cce5eb req-3fc0341e-a660-4c6b-9147-12321a34b29d service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:15:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-52dbf541-6bc2-45f6-8929-5143a4cce5eb req-3fc0341e-a660-4c6b-9147-12321a34b29d service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] No waiting events found dispatching network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:15:49 user nova-compute[72782]: WARNING nova.compute.manager [req-52dbf541-6bc2-45f6-8929-5143a4cce5eb req-3fc0341e-a660-4c6b-9147-12321a34b29d service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received unexpected event network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e for instance with vm_state active and task_state None.
Aug 14 20:15:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-52dbf541-6bc2-45f6-8929-5143a4cce5eb req-3fc0341e-a660-4c6b-9147-12321a34b29d service nova] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Received event network-vif-deleted-325817ed-4de8-4d31-afb7-d338d9391c55 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:15:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-52dbf541-6bc2-45f6-8929-5143a4cce5eb req-3fc0341e-a660-4c6b-9147-12321a34b29d service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received event network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:15:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-52dbf541-6bc2-45f6-8929-5143a4cce5eb req-3fc0341e-a660-4c6b-9147-12321a34b29d service nova] Acquiring lock "a9a07178-5051-4ecb-850f-113402dfa682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:15:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-52dbf541-6bc2-45f6-8929-5143a4cce5eb req-3fc0341e-a660-4c6b-9147-12321a34b29d service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:15:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-52dbf541-6bc2-45f6-8929-5143a4cce5eb req-3fc0341e-a660-4c6b-9147-12321a34b29d service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:15:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-52dbf541-6bc2-45f6-8929-5143a4cce5eb req-3fc0341e-a660-4c6b-9147-12321a34b29d service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] No waiting events found dispatching network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:15:49 user nova-compute[72782]: WARNING nova.compute.manager [req-52dbf541-6bc2-45f6-8929-5143a4cce5eb req-3fc0341e-a660-4c6b-9147-12321a34b29d service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received unexpected event network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e for instance with vm_state active and task_state None.
Aug 14 20:15:49 user nova-compute[72782]: INFO nova.compute.manager [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Shelve offloading
Aug 14 20:15:49 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Instance destroyed successfully.
Aug 14 20:15:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:15:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:15:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquired lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:15:49 user nova-compute[72782]: DEBUG nova.network.neutron [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:15:49 user nova-compute[72782]: DEBUG nova.network.neutron [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Updating instance_info_cache with network_info: [{"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:15:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Releasing lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:15:50 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Instance destroyed successfully.
Aug 14 20:15:50 user nova-compute[72782]: DEBUG nova.objects.instance [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'resources' on Instance uuid be408523-bdab-4ac8-b2ea-65003af6d1d7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:15:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-677276841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-677276841',id=38,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8Uj8zUnrkLTabv1RW3o8Wjjs2cJCkSEF6Sq2fXEMYcLeivZLio4OyDTatGotv181HghXlTiTtSJpCmTIT7gSAT44MCn+0NAkSnkNGXlqDb3Drqo0qiXvUqYDHGzF0JdQ==',key_name='tempest-keypair-1426773445',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d8754bbf7f9945fba2bd1ad571f556f6',ramdisk_id='',reservation_id='r-y67p6eax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-220778544',owner_user_name='tempest-AttachVolumeShelveTestJSON-220778544-project-member',shelved_at='2023-08-14T20:15:49.397616',shelved_host='user',shelved_image_id='4cebdab1-e6d5-4ba7-9799-7ae4debfd762'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:15:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3090a5cb6ba34a7fb007d98a351c8313',uuid=be408523-bdab-4ac8-b2ea-65003af6d1d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:15:50 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converting VIF {"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:15:50 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:98:04,bridge_name='br-int',has_traffic_filtering=True,id=6f79c61c-2a19-4e1d-9661-6dccabb07572,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f79c61c-2a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:15:50 user nova-compute[72782]: DEBUG os_vif [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:98:04,bridge_name='br-int',has_traffic_filtering=True,id=6f79c61c-2a19-4e1d-9661-6dccabb07572,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f79c61c-2a') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:15:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f79c61c-2a, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:15:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:15:50 user nova-compute[72782]: INFO os_vif [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:98:04,bridge_name='br-int',has_traffic_filtering=True,id=6f79c61c-2a19-4e1d-9661-6dccabb07572,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f79c61c-2a')
Aug 14 20:15:50 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Deleting instance files /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7_del
Aug 14 20:15:50 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Deletion of /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7_del complete
Aug 14 20:15:50 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Deleted allocations for instance be408523-bdab-4ac8-b2ea-65003af6d1d7
Aug 14 20:15:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:15:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:15:50 user nova-compute[72782]: DEBUG nova.objects.instance [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'numa_topology' on Instance uuid be408523-bdab-4ac8-b2ea-65003af6d1d7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:15:50 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:15:50 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:15:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:15:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1631e7c4-710c-4be7-8bd9-be6095851825 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.143s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:15:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:15:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:01 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692044146.159448, be408523-bdab-4ac8-b2ea-65003af6d1d7 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:16:01 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] VM Stopped (Lifecycle Event)
Aug 14 20:16:01 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692044146.1769388, 0fa5392c-ea30-4007-bcdc-2802a46ed7a2 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:16:01 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] VM Stopped (Lifecycle Event)
Aug 14 20:16:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-999dcff8-573c-4061-adaf-22a3d49293c4 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:16:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-773e963e-c22c-423d-ad2f-99f42d83f301 None None] [instance: 0fa5392c-ea30-4007-bcdc-2802a46ed7a2] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:16:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:16:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:14 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:16:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:16:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:16:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:16:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:16:14 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:16:14 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid a9a07178-5051-4ecb-850f-113402dfa682 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:16:14 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Updating instance_info_cache with network_info: [{"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:16:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:16:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:16:14 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:16:15 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:16:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:16 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:16:17 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:16:17 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:16:18 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:16:18 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:16:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:16:20 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:16:20 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:16:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8623MB free_disk=25.460296630859375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance a9a07178-5051-4ecb-850f-113402dfa682 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing inventories for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating ProviderTree inventory for provider d26c9e3b-40e6-476e-9664-3119ebf5873b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing aggregate associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, aggregates: None {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing trait associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:16:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:16:24 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:16:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:16:27 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:16:27 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72782) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 20:16:28 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:16:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 20:16:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] There are 0 instances to clean {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 20:16:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:16:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquiring lock "07cf5f99-542b-4604-b3cf-575ad218edf7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:16:51 user nova-compute[72782]: INFO nova.compute.claims [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Claim successful on node user
Aug 14 20:16:51 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.204s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG nova.network.neutron [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:16:51 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:16:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG nova.policy [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0118609059f24257894c2ea98f193228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f0a4b8575346f380ba1a31617004ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:16:51 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Creating image(s)
Aug 14 20:16:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquiring lock "/opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "/opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "/opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.173s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:16:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:16:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:16:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:16:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/disk 1073741824" returned: 0 in 0.060s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:16:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:16:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:16:52 user nova-compute[72782]: DEBUG nova.network.neutron [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Successfully created port: 9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:16:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:16:52 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 20:16:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:16:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:16:52 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Cannot resize image /opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 20:16:52 user nova-compute[72782]: DEBUG nova.objects.instance [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lazy-loading 'migration_context' on Instance uuid 07cf5f99-542b-4604-b3cf-575ad218edf7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:16:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:16:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Ensure instance console log exists: /opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:16:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:16:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:16:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:16:52 user nova-compute[72782]: DEBUG nova.network.neutron [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Successfully updated port: 9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquiring lock "refresh_cache-07cf5f99-542b-4604-b3cf-575ad218edf7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquired lock "refresh_cache-07cf5f99-542b-4604-b3cf-575ad218edf7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.network.neutron [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.network.neutron [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.compute.manager [req-942ed4e6-11b3-496a-802a-7524b49a9d2d req-ed28c9a7-f048-4697-b40c-b01659246612 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Received event network-changed-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.compute.manager [req-942ed4e6-11b3-496a-802a-7524b49a9d2d req-ed28c9a7-f048-4697-b40c-b01659246612 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Refreshing instance network info cache due to event network-changed-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-942ed4e6-11b3-496a-802a-7524b49a9d2d req-ed28c9a7-f048-4697-b40c-b01659246612 service nova] Acquiring lock "refresh_cache-07cf5f99-542b-4604-b3cf-575ad218edf7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.network.neutron [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Updating instance_info_cache with network_info: [{"id": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "address": "fa:16:3e:94:b5:4b", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0b33aa-45", "ovs_interfaceid": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Releasing lock "refresh_cache-07cf5f99-542b-4604-b3cf-575ad218edf7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.compute.manager [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Instance network_info: |[{"id": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "address": "fa:16:3e:94:b5:4b", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0b33aa-45", "ovs_interfaceid": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-942ed4e6-11b3-496a-802a-7524b49a9d2d req-ed28c9a7-f048-4697-b40c-b01659246612 service nova] Acquired lock "refresh_cache-07cf5f99-542b-4604-b3cf-575ad218edf7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.network.neutron [req-942ed4e6-11b3-496a-802a-7524b49a9d2d req-ed28c9a7-f048-4697-b40c-b01659246612 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Refreshing network info cache for port 9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Start _get_guest_xml network_info=[{"id": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "address": "fa:16:3e:94:b5:4b", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0b33aa-45", "ovs_interfaceid": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:16:53 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:16:53 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:16:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-885529377',display_name='tempest-VolumesActionsTest-instance-885529377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-885529377',id=39,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04f0a4b8575346f380ba1a31617004ea',ramdisk_id='',reservation_id='r-60p6pofr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-42673821',owner_user_name='tempest-VolumesActionsTest-42673821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:16:52Z,user_data=None,user_id='0118609059f24257894c2ea98f193228',uuid=07cf5f99-542b-4604-b3cf-575ad218edf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "address": "fa:16:3e:94:b5:4b", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0b33aa-45", "ovs_interfaceid": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Converting VIF {"id": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "address": "fa:16:3e:94:b5:4b", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0b33aa-45", "ovs_interfaceid": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:b5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9a0b33aa-4553-4676-85ed-e1a34cd5e8e6,network=Network(b5704a85-ae42-4617-9b54-6905496ae839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0b33aa-45') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.objects.instance [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lazy-loading 'pci_devices' on Instance uuid 07cf5f99-542b-4604-b3cf-575ad218edf7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:16:53 user nova-compute[72782]:   <uuid>07cf5f99-542b-4604-b3cf-575ad218edf7</uuid>
Aug 14 20:16:53 user nova-compute[72782]:   <name>instance-00000027</name>
Aug 14 20:16:53 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:16:53 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:16:53 user nova-compute[72782]:   <metadata>
Aug 14 20:16:53 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:16:53 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:16:53 user nova-compute[72782]:       <nova:name>tempest-VolumesActionsTest-instance-885529377</nova:name>
Aug 14 20:16:53 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:16:53</nova:creationTime>
Aug 14 20:16:53 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:16:53 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:16:53 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:16:53 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:16:53 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:16:53 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:16:53 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:16:53 user nova-compute[72782]:       <nova:owner>
Aug 14 20:16:53 user nova-compute[72782]:         <nova:user uuid="0118609059f24257894c2ea98f193228">tempest-VolumesActionsTest-42673821-project-member</nova:user>
Aug 14 20:16:53 user nova-compute[72782]:         <nova:project uuid="04f0a4b8575346f380ba1a31617004ea">tempest-VolumesActionsTest-42673821</nova:project>
Aug 14 20:16:53 user nova-compute[72782]:       </nova:owner>
Aug 14 20:16:53 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 20:16:53 user nova-compute[72782]:       <nova:ports>
Aug 14 20:16:53 user nova-compute[72782]:         <nova:port uuid="9a0b33aa-4553-4676-85ed-e1a34cd5e8e6">
Aug 14 20:16:53 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 20:16:53 user nova-compute[72782]:         </nova:port>
Aug 14 20:16:53 user nova-compute[72782]:       </nova:ports>
Aug 14 20:16:53 user nova-compute[72782]:     </nova:instance>
Aug 14 20:16:53 user nova-compute[72782]:   </metadata>
Aug 14 20:16:53 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:16:53 user nova-compute[72782]:     <system>
Aug 14 20:16:53 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:16:53 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:16:53 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:16:53 user nova-compute[72782]:       <entry name="serial">07cf5f99-542b-4604-b3cf-575ad218edf7</entry>
Aug 14 20:16:53 user nova-compute[72782]:       <entry name="uuid">07cf5f99-542b-4604-b3cf-575ad218edf7</entry>
Aug 14 20:16:53 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:16:53 user nova-compute[72782]:     </system>
Aug 14 20:16:53 user nova-compute[72782]:   </sysinfo>
Aug 14 20:16:53 user nova-compute[72782]:   <os>
Aug 14 20:16:53 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:16:53 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:16:53 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:16:53 user nova-compute[72782]:   </os>
Aug 14 20:16:53 user nova-compute[72782]:   <features>
Aug 14 20:16:53 user nova-compute[72782]:     <acpi/>
Aug 14 20:16:53 user nova-compute[72782]:     <apic/>
Aug 14 20:16:53 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:16:53 user nova-compute[72782]:   </features>
Aug 14 20:16:53 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:16:53 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:16:53 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:16:53 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:16:53 user nova-compute[72782]:   </clock>
Aug 14 20:16:53 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:16:53 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:16:53 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:16:53 user nova-compute[72782]:   </cpu>
Aug 14 20:16:53 user nova-compute[72782]:   <devices>
Aug 14 20:16:53 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:16:53 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:16:53 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/disk"/>
Aug 14 20:16:53 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:16:53 user nova-compute[72782]:     </disk>
Aug 14 20:16:53 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:16:53 user nova-compute[72782]:       <mac address="fa:16:3e:94:b5:4b"/>
Aug 14 20:16:53 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:16:53 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:16:53 user nova-compute[72782]:       <target dev="tap9a0b33aa-45"/>
Aug 14 20:16:53 user nova-compute[72782]:     </interface>
Aug 14 20:16:53 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:16:53 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/console.log" append="off"/>
Aug 14 20:16:53 user nova-compute[72782]:     </serial>
Aug 14 20:16:53 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:16:53 user nova-compute[72782]:     <video>
Aug 14 20:16:53 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:16:53 user nova-compute[72782]:     </video>
Aug 14 20:16:53 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:16:53 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:16:53 user nova-compute[72782]:     </rng>
Aug 14 20:16:53 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:16:53 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:16:53 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:16:53 user nova-compute[72782]:     </memballoon>
Aug 14 20:16:53 user nova-compute[72782]:   </devices>
Aug 14 20:16:53 user nova-compute[72782]: </domain>
Aug 14 20:16:53 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:16:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-885529377',display_name='tempest-VolumesActionsTest-instance-885529377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-885529377',id=39,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04f0a4b8575346f380ba1a31617004ea',ramdisk_id='',reservation_id='r-60p6pofr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-42673821',owner_user_name='tempest-VolumesActionsTest-42673821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:16:52Z,user_data=None,user_id='0118609059f24257894c2ea98f193228',uuid=07cf5f99-542b-4604-b3cf-575ad218edf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "address": "fa:16:3e:94:b5:4b", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0b33aa-45", "ovs_interfaceid": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Converting VIF {"id": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "address": "fa:16:3e:94:b5:4b", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0b33aa-45", "ovs_interfaceid": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:b5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9a0b33aa-4553-4676-85ed-e1a34cd5e8e6,network=Network(b5704a85-ae42-4617-9b54-6905496ae839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0b33aa-45') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG os_vif [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:b5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9a0b33aa-4553-4676-85ed-e1a34cd5e8e6,network=Network(b5704a85-ae42-4617-9b54-6905496ae839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0b33aa-45') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a0b33aa-45, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a0b33aa-45, col_values=(('external_ids', {'iface-id': '9a0b33aa-4553-4676-85ed-e1a34cd5e8e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:b5:4b', 'vm-uuid': '07cf5f99-542b-4604-b3cf-575ad218edf7'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:53 user nova-compute[72782]: INFO os_vif [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:b5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9a0b33aa-4553-4676-85ed-e1a34cd5e8e6,network=Network(b5704a85-ae42-4617-9b54-6905496ae839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0b33aa-45')
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] No VIF found with MAC fa:16:3e:94:b5:4b, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.network.neutron [req-942ed4e6-11b3-496a-802a-7524b49a9d2d req-ed28c9a7-f048-4697-b40c-b01659246612 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Updated VIF entry in instance network info cache for port 9a0b33aa-4553-4676-85ed-e1a34cd5e8e6. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:16:53 user nova-compute[72782]: DEBUG nova.network.neutron [req-942ed4e6-11b3-496a-802a-7524b49a9d2d req-ed28c9a7-f048-4697-b40c-b01659246612 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Updating instance_info_cache with network_info: [{"id": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "address": "fa:16:3e:94:b5:4b", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0b33aa-45", "ovs_interfaceid": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:16:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-942ed4e6-11b3-496a-802a-7524b49a9d2d req-ed28c9a7-f048-4697-b40c-b01659246612 service nova] Releasing lock "refresh_cache-07cf5f99-542b-4604-b3cf-575ad218edf7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:16:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:55 user nova-compute[72782]: DEBUG nova.compute.manager [req-3958c8fa-d63b-4392-b909-db5482f3c58e req-fb1cfa9c-4d1a-4475-9e98-e55098fcce82 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Received event network-vif-plugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:16:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3958c8fa-d63b-4392-b909-db5482f3c58e req-fb1cfa9c-4d1a-4475-9e98-e55098fcce82 service nova] Acquiring lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:16:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3958c8fa-d63b-4392-b909-db5482f3c58e req-fb1cfa9c-4d1a-4475-9e98-e55098fcce82 service nova] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:16:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3958c8fa-d63b-4392-b909-db5482f3c58e req-fb1cfa9c-4d1a-4475-9e98-e55098fcce82 service nova] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:16:55 user nova-compute[72782]: DEBUG nova.compute.manager [req-3958c8fa-d63b-4392-b909-db5482f3c58e req-fb1cfa9c-4d1a-4475-9e98-e55098fcce82 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] No waiting events found dispatching network-vif-plugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:16:55 user nova-compute[72782]: WARNING nova.compute.manager [req-3958c8fa-d63b-4392-b909-db5482f3c58e req-fb1cfa9c-4d1a-4475-9e98-e55098fcce82 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Received unexpected event network-vif-plugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 for instance with vm_state building and task_state spawning.
Aug 14 20:16:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:57 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044217.0164988, 07cf5f99-542b-4604-b3cf-575ad218edf7 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:16:57 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] VM Resumed (Lifecycle Event)
Aug 14 20:16:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:16:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:16:57 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Instance spawned successfully.
Aug 14 20:16:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:16:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:16:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:16:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:16:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:16:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:16:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:16:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:16:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:16:57 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:16:57 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044217.0194395, 07cf5f99-542b-4604-b3cf-575ad218edf7 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:16:57 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] VM Started (Lifecycle Event)
Aug 14 20:16:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:16:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:16:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-bc06ab95-1783-4150-b8ee-dbc00f9b1434 req-e9e69e6b-4c37-4a85-b69a-a626a086979e service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Received event network-vif-plugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:16:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bc06ab95-1783-4150-b8ee-dbc00f9b1434 req-e9e69e6b-4c37-4a85-b69a-a626a086979e service nova] Acquiring lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:16:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bc06ab95-1783-4150-b8ee-dbc00f9b1434 req-e9e69e6b-4c37-4a85-b69a-a626a086979e service nova] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:16:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bc06ab95-1783-4150-b8ee-dbc00f9b1434 req-e9e69e6b-4c37-4a85-b69a-a626a086979e service nova] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:16:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-bc06ab95-1783-4150-b8ee-dbc00f9b1434 req-e9e69e6b-4c37-4a85-b69a-a626a086979e service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] No waiting events found dispatching network-vif-plugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:16:57 user nova-compute[72782]: WARNING nova.compute.manager [req-bc06ab95-1783-4150-b8ee-dbc00f9b1434 req-e9e69e6b-4c37-4a85-b69a-a626a086979e service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Received unexpected event network-vif-plugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 for instance with vm_state building and task_state spawning.
Aug 14 20:16:57 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:16:57 user nova-compute[72782]: INFO nova.compute.manager [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Took 5.47 seconds to spawn the instance on the hypervisor.
Aug 14 20:16:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:16:57 user nova-compute[72782]: INFO nova.compute.manager [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Took 6.00 seconds to build instance.
Aug 14 20:16:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-05507486-053c-488a-8d0b-296f6a651672 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.100s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:16:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:16:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:17:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:17:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:17:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:17:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:17:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:17:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:16 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:17:16 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:17:16 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:17:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-07cf5f99-542b-4604-b3cf-575ad218edf7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:17:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-07cf5f99-542b-4604-b3cf-575ad218edf7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:17:16 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:17:16 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 07cf5f99-542b-4604-b3cf-575ad218edf7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:17:16 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Updating instance_info_cache with network_info: [{"id": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "address": "fa:16:3e:94:b5:4b", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0b33aa-45", "ovs_interfaceid": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:17:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-07cf5f99-542b-4604-b3cf-575ad218edf7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:17:16 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:17:16 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:17:16 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:17:17 user nova-compute[72782]: DEBUG nova.compute.manager [req-ce2a3679-913d-4acb-a2db-d9d4feeda3c2 req-e4348576-1af2-4c43-93b5-32cf6acd3ba8 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received event network-changed-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:17:17 user nova-compute[72782]: DEBUG nova.compute.manager [req-ce2a3679-913d-4acb-a2db-d9d4feeda3c2 req-e4348576-1af2-4c43-93b5-32cf6acd3ba8 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Refreshing instance network info cache due to event network-changed-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:17:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ce2a3679-913d-4acb-a2db-d9d4feeda3c2 req-e4348576-1af2-4c43-93b5-32cf6acd3ba8 service nova] Acquiring lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:17:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ce2a3679-913d-4acb-a2db-d9d4feeda3c2 req-e4348576-1af2-4c43-93b5-32cf6acd3ba8 service nova] Acquired lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:17:17 user nova-compute[72782]: DEBUG nova.network.neutron [req-ce2a3679-913d-4acb-a2db-d9d4feeda3c2 req-e4348576-1af2-4c43-93b5-32cf6acd3ba8 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Refreshing network info cache for port 76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:17:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "a9a07178-5051-4ecb-850f-113402dfa682" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:17:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "a9a07178-5051-4ecb-850f-113402dfa682" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:17:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "a9a07178-5051-4ecb-850f-113402dfa682-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:17:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:17:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:17:17 user nova-compute[72782]: INFO nova.compute.manager [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Terminating instance
Aug 14 20:17:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:17:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:18 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Instance destroyed successfully.
Aug 14 20:17:18 user nova-compute[72782]: DEBUG nova.objects.instance [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lazy-loading 'resources' on Instance uuid a9a07178-5051-4ecb-850f-113402dfa682 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T20:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1943938335',display_name='tempest-TestShelveInstance-server-1943938335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1943938335',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkXzREVSXh3D8FqrMcNT1eaqAV2O3PHytdmYLqeEKhgHFXcrt2opcbmZgjUvXZuzqSCG5IGsiLjbmbLSWTFnMeyB9kzRqUjQuU8JN2tblBNVpbHSf9B07JWbp9O03FEJQ==',key_name='tempest-TestShelveInstance-114729578',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:15:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0a05a5fa43b4d7fbcc888cbd03384af',ramdisk_id='',reservation_id='r-h47r0r7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2109215903',owner_user_name='tempest-TestShelveInstance-2109215903-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:15:49Z,user_data=None,user_id='d98849817bd8443d8d332bd044833a66',uuid=a9a07178-5051-4ecb-850f-113402dfa682,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Converting VIF {"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=76ee2f39-b22b-4c07-9aa6-9bdbbc52393e,network=Network(5c8ea35b-08e7-49d8-8fbe-0d6603bb281c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ee2f39-b2') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_vif [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=76ee2f39-b22b-4c07-9aa6-9bdbbc52393e,network=Network(5c8ea35b-08e7-49d8-8fbe-0d6603bb281c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ee2f39-b2') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG nova.network.neutron [req-ce2a3679-913d-4acb-a2db-d9d4feeda3c2 req-e4348576-1af2-4c43-93b5-32cf6acd3ba8 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Updated VIF entry in instance network info cache for port 76ee2f39-b22b-4c07-9aa6-9bdbbc52393e. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG nova.network.neutron [req-ce2a3679-913d-4acb-a2db-d9d4feeda3c2 req-e4348576-1af2-4c43-93b5-32cf6acd3ba8 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Updating instance_info_cache with network_info: [{"id": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "address": "fa:16:3e:df:32:2b", "network": {"id": "5c8ea35b-08e7-49d8-8fbe-0d6603bb281c", "bridge": "br-int", "label": "tempest-TestShelveInstance-601895334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a05a5fa43b4d7fbcc888cbd03384af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76ee2f39-b2", "ovs_interfaceid": "76ee2f39-b22b-4c07-9aa6-9bdbbc52393e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76ee2f39-b2, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:17:18 user nova-compute[72782]: INFO os_vif [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:32:2b,bridge_name='br-int',has_traffic_filtering=True,id=76ee2f39-b22b-4c07-9aa6-9bdbbc52393e,network=Network(5c8ea35b-08e7-49d8-8fbe-0d6603bb281c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76ee2f39-b2')
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ce2a3679-913d-4acb-a2db-d9d4feeda3c2 req-e4348576-1af2-4c43-93b5-32cf6acd3ba8 service nova] Releasing lock "refresh_cache-a9a07178-5051-4ecb-850f-113402dfa682" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tslePvrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:17:18 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e9531f-d013-4756-9635-69a2d3a1cc1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b44b142-f694-4015-9444-ef4e505170fb]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 (non-flash)
Aug 14 20:17:18 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 (non-flash)
Aug 14 20:17:18 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f64087d9480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d571f3ca-4751-4e62-8e27-45ebb2f32672]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8509071e-d0e8-4de9-a132-265610557b39]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[feae5479-1e9f-421b-8c28-a3e1d8c2bdd5]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec70736-7724-4d6f-b6ae-2773502ef554]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23935356337636639', '/dev/disk/by-id/scsi-1SCST_BIOa48df96e-955c7cf90fd6b2d8', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a48df96e') {{(pid=83776) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93f4e7f-9ba5-4734-98d5-4103f496269b]: (4, None) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7bb7c3-a7a8-49f6-8f0f-00353a44125b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4f9762-c812-4300-9aba-a3e8382a3443]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36, portal: 172.16.0.220,3260]
Aug 14 20:17:18 user nova-compute[72782]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36, portal: 172.16.0.220,3260] successful.
Aug 14 20:17:18 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f19ce5-e794-4bd1-b546-4a8bb1365f36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2810b9a5-d2c6-4d4b-95d0-df417b53e23e]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:17:18 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:17:19 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] <== disconnect_volume: return (290ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:17:19 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:17:19 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Deleting instance files /opt/stack/data/nova/instances/a9a07178-5051-4ecb-850f-113402dfa682_del
Aug 14 20:17:19 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Deletion of /opt/stack/data/nova/instances/a9a07178-5051-4ecb-850f-113402dfa682_del complete
Aug 14 20:17:19 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:17:19 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:17:19 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:17:19 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:17:19 user nova-compute[72782]: INFO nova.compute.manager [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 14 20:17:19 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:17:19 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:17:19 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: a9a07178-5051-4ecb-850f-113402dfa682] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:17:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-fd2ba0f8-9fcd-4312-a85e-d5bfb9592d01 req-f9ed1e07-4612-4b3d-9514-565a95f96790 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received event network-vif-unplugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:17:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fd2ba0f8-9fcd-4312-a85e-d5bfb9592d01 req-f9ed1e07-4612-4b3d-9514-565a95f96790 service nova] Acquiring lock "a9a07178-5051-4ecb-850f-113402dfa682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:17:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fd2ba0f8-9fcd-4312-a85e-d5bfb9592d01 req-f9ed1e07-4612-4b3d-9514-565a95f96790 service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:17:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fd2ba0f8-9fcd-4312-a85e-d5bfb9592d01 req-f9ed1e07-4612-4b3d-9514-565a95f96790 service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:17:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-fd2ba0f8-9fcd-4312-a85e-d5bfb9592d01 req-f9ed1e07-4612-4b3d-9514-565a95f96790 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] No waiting events found dispatching network-vif-unplugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:17:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-fd2ba0f8-9fcd-4312-a85e-d5bfb9592d01 req-f9ed1e07-4612-4b3d-9514-565a95f96790 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received event network-vif-unplugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:17:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-fd2ba0f8-9fcd-4312-a85e-d5bfb9592d01 req-f9ed1e07-4612-4b3d-9514-565a95f96790 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received event network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:17:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fd2ba0f8-9fcd-4312-a85e-d5bfb9592d01 req-f9ed1e07-4612-4b3d-9514-565a95f96790 service nova] Acquiring lock "a9a07178-5051-4ecb-850f-113402dfa682-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:17:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fd2ba0f8-9fcd-4312-a85e-d5bfb9592d01 req-f9ed1e07-4612-4b3d-9514-565a95f96790 service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:17:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fd2ba0f8-9fcd-4312-a85e-d5bfb9592d01 req-f9ed1e07-4612-4b3d-9514-565a95f96790 service nova] Lock "a9a07178-5051-4ecb-850f-113402dfa682-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:17:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-fd2ba0f8-9fcd-4312-a85e-d5bfb9592d01 req-f9ed1e07-4612-4b3d-9514-565a95f96790 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] No waiting events found dispatching network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:17:19 user nova-compute[72782]: WARNING nova.compute.manager [req-fd2ba0f8-9fcd-4312-a85e-d5bfb9592d01 req-f9ed1e07-4612-4b3d-9514-565a95f96790 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received unexpected event network-vif-plugged-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e for instance with vm_state active and task_state deleting.
Aug 14 20:17:20 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:17:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:17:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:17:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:17:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:17:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:20 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:17:20 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Took 1.15 seconds to deallocate network for instance.
Aug 14 20:17:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:20 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:17:20 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:17:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8569MB free_disk=25.43014144897461GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:17:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:17:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:17:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance a9a07178-5051-4ecb-850f-113402dfa682 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:17:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 07cf5f99-542b-4604-b3cf-575ad218edf7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:17:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:17:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:17:21 user nova-compute[72782]: INFO nova.compute.manager [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Took 0.81 seconds to detach 1 volumes for instance.
Aug 14 20:17:21 user nova-compute[72782]: DEBUG nova.compute.manager [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Deleting volume: b1f19ce5-e794-4bd1-b546-4a8bb1365f36 {{(pid=72782) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 20:17:21 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:17:21 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:17:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:17:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:17:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:17:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:17:21 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:17:21 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:17:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:17:21 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Deleted allocations for instance a9a07178-5051-4ecb-850f-113402dfa682
Aug 14 20:17:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-07c19f46-1ea8-4264-a4cf-527414c61297 tempest-TestShelveInstance-2109215903 tempest-TestShelveInstance-2109215903-project-member] Lock "a9a07178-5051-4ecb-850f-113402dfa682" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.652s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:17:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-f87599ab-4448-4ddd-90b2-a3f07f2bc687 req-c4b26af5-99ce-4dc2-8f28-9bf6b260f047 service nova] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Received event network-vif-deleted-76ee2f39-b22b-4c07-9aa6-9bdbbc52393e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:17:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:25 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:17:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:33 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692044238.6494904, a9a07178-5051-4ecb-850f-113402dfa682 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:17:33 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: a9a07178-5051-4ecb-850f-113402dfa682] VM Stopped (Lifecycle Event)
Aug 14 20:17:33 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6218cd2e-7b9b-42d2-916a-cfa6cf84960b None None] [instance: a9a07178-5051-4ecb-850f-113402dfa682] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:17:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:17:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:17:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:17:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:17:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "be408523-bdab-4ac8-b2ea-65003af6d1d7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:17:37 user nova-compute[72782]: INFO nova.compute.manager [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Unshelving
Aug 14 20:17:37 user nova-compute[72782]: INFO nova.virt.block_device [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Booting with volume 0cb6ed70-44a3-4486-ba67-fc0d80261d11 at /dev/vdc
Aug 14 20:17:37 user nova-compute[72782]: DEBUG os_brick.utils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5661f17-ecf7-428a-aede-9beb04b60bfd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cee6d2-5993-4a33-bc85-96dc071aaaee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[447f7cf9-3640-4599-a464-9bea09e35928]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ababb0b7-cca6-46ec-9a88-25fae0a24ad8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:17:37 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:17:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9b3b51-db2e-4e2c-94d3-ea6404a468cc]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG os_brick.utils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:17:37 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Updating existing volume attachment record: 6e968ec1-3e81-4383-a578-073e1634c047 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:17:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:17:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:17:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:17:45 user nova-compute[72782]: DEBUG nova.objects.instance [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'pci_requests' on Instance uuid be408523-bdab-4ac8-b2ea-65003af6d1d7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:17:45 user nova-compute[72782]: DEBUG nova.objects.instance [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'numa_topology' on Instance uuid be408523-bdab-4ac8-b2ea-65003af6d1d7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:17:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:17:45 user nova-compute[72782]: INFO nova.compute.claims [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Claim successful on node user
Aug 14 20:17:45 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:17:45 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:17:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:17:46 user nova-compute[72782]: INFO nova.network.neutron [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Updating port 6f79c61c-2a19-4e1d-9661-6dccabb07572 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 20:17:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:17:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquired lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:17:46 user nova-compute[72782]: DEBUG nova.network.neutron [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:17:46 user nova-compute[72782]: DEBUG nova.compute.manager [req-f98edf7a-8538-4d9b-8488-b1dcc8a2e54e req-cefdc98a-665a-420c-bc84-636a491854c2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received event network-changed-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:17:46 user nova-compute[72782]: DEBUG nova.compute.manager [req-f98edf7a-8538-4d9b-8488-b1dcc8a2e54e req-cefdc98a-665a-420c-bc84-636a491854c2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Refreshing instance network info cache due to event network-changed-6f79c61c-2a19-4e1d-9661-6dccabb07572. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:17:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f98edf7a-8538-4d9b-8488-b1dcc8a2e54e req-cefdc98a-665a-420c-bc84-636a491854c2 service nova] Acquiring lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:17:47 user nova-compute[72782]: DEBUG nova.network.neutron [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Updating instance_info_cache with network_info: [{"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:17:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Releasing lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:17:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:17:47 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Creating image(s)
Aug 14 20:17:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "/opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:17:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "/opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:17:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "/opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:17:47 user nova-compute[72782]: DEBUG nova.objects.instance [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'trusted_certs' on Instance uuid be408523-bdab-4ac8-b2ea-65003af6d1d7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:17:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f98edf7a-8538-4d9b-8488-b1dcc8a2e54e req-cefdc98a-665a-420c-bc84-636a491854c2 service nova] Acquired lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:17:47 user nova-compute[72782]: DEBUG nova.network.neutron [req-f98edf7a-8538-4d9b-8488-b1dcc8a2e54e req-cefdc98a-665a-420c-bc84-636a491854c2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Refreshing network info cache for port 6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:17:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "79602d575bcce32d6d5315b4ef0c73f7a85a007f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:17:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "79602d575bcce32d6d5315b4ef0c73f7a85a007f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:17:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f.part --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f.part --force-share --output=json" returned: 0 in 0.192s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:48 user nova-compute[72782]: DEBUG nova.virt.images [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] 4cebdab1-e6d5-4ba7-9799-7ae4debfd762 was qcow2, converting to raw {{(pid=72782) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 20:17:48 user nova-compute[72782]: DEBUG nova.privsep.utils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72782) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 20:17:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f.part /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f.converted {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:48 user nova-compute[72782]: DEBUG nova.network.neutron [req-f98edf7a-8538-4d9b-8488-b1dcc8a2e54e req-cefdc98a-665a-420c-bc84-636a491854c2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Updated VIF entry in instance network info cache for port 6f79c61c-2a19-4e1d-9661-6dccabb07572. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:17:48 user nova-compute[72782]: DEBUG nova.network.neutron [req-f98edf7a-8538-4d9b-8488-b1dcc8a2e54e req-cefdc98a-665a-420c-bc84-636a491854c2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Updating instance_info_cache with network_info: [{"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:17:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f98edf7a-8538-4d9b-8488-b1dcc8a2e54e req-cefdc98a-665a-420c-bc84-636a491854c2 service nova] Releasing lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:17:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f.part /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f.converted" returned: 0 in 0.710s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f.converted --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "79602d575bcce32d6d5315b4ef0c73f7a85a007f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.276s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:17:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "79602d575bcce32d6d5315b4ef0c73f7a85a007f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:17:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "79602d575bcce32d6d5315b4ef0c73f7a85a007f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:17:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f --force-share --output=json" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f,backing_fmt=raw /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f,backing_fmt=raw /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk 1073741824" returned: 0 in 0.049s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "79602d575bcce32d6d5315b4ef0c73f7a85a007f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:17:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:50 user nova-compute[72782]: DEBUG nova.objects.instance [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'migration_context' on Instance uuid be408523-bdab-4ac8-b2ea-65003af6d1d7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:17:50 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Rebasing disk image.
Aug 14 20:17:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 -F raw /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 -F raw /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk" returned: 0 in 2.006s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Ensure instance console log exists: /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Start _get_guest_xml network_info=[{"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='765417ce5222724d898d07236c19a036',container_format='bare',created_at=2023-08-14T20:15:45Z,direct_url=<?>,disk_format='qcow2',id=4cebdab1-e6d5-4ba7-9799-7ae4debfd762,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-677276841-shelved',owner='d8754bbf7f9945fba2bd1ad571f556f6',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-14T20:15:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '6e968ec1-3e81-4383-a578-073e1634c047', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXGHhntz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'be408523-bdab-4ac8-b2ea-65003af6d1d7', 'attached_at': '', 'detached_at': '', 'volume_id': '0cb6ed70-44a3-4486-ba67-fc0d80261d11', 'serial': '0cb6ed70-44a3-4486-ba67-fc0d80261d11'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:17:52 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:17:52 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='765417ce5222724d898d07236c19a036',container_format='bare',created_at=2023-08-14T20:15:45Z,direct_url=<?>,disk_format='qcow2',id=4cebdab1-e6d5-4ba7-9799-7ae4debfd762,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-677276841-shelved',owner='d8754bbf7f9945fba2bd1ad571f556f6',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-14T20:15:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.objects.instance [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'vcpu_model' on Instance uuid be408523-bdab-4ac8-b2ea-65003af6d1d7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXGHhntz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:17:52 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:17:52 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:17:52 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a547fe-6f32-4d3a-a951-bc262bb3673b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:17:52 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1b378b-4d38-4eef-bd6f-9fc35f06eeec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11] added
Aug 14 20:17:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.067s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[52263475-a55e-4e87-a1e4-6a6f3e4204ad]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[332d8423-af52-4af5-9dde-2736f8232703]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VXGHhntz {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VXGHhntz" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2373e764-1bb1-4c4a-b43c-7a7219759cc2]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VXGHhntz'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac4f828-9a6d-4723-bd8c-3be12d8268f9]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[026ff35a-283d-4470-862c-823d0b7e5d1b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:17:52 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:17:52 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:17:52 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 20:17:52 user nova-compute[72782]: 
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8df0fbb-f219-4597-baf2-f27d733af3c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11, portal: 172.16.0.220,3260]
Aug 14 20:17:52 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11, portal: 172.16.0.220,3260] successful.
Aug 14 20:17:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec94c0a-6176-4100-ad6f-fb01c4fa939b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bbfd48-025c-4c72-bb9a-b8b6892ed94d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 (non-flash)
Aug 14 20:17:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 (non-flash)
Aug 14 20:17:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:17:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:17:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:17:53 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[108dd378-678c-4178-b61a-f4efda2428e4]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:17:53 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:17:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXGHhntz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:17:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:17:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:17:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:17:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:17:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23136613634633731', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136613634633731', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T20:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-677276841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-677276841',id=38,image_ref='4cebdab1-e6d5-4ba7-9799-7ae4debfd762',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1426773445',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d8754bbf7f9945fba2bd1ad571f556f6',ramdisk_id='',reservation_id='r-y67p6eax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-220778544',owner_user_name='tempest-AttachVolumeShelveTestJSON-220778544-project-member',shelved_at='2023-08-14T20:15:49.397616',shelved_host='user',shelved_image_id='4cebdab1-e6d5-4ba7-9799-7ae4debfd762'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3090a5cb6ba34a7fb007d98a351c8313',uuid=be408523-bdab-4ac8-b2ea-65003af6d1d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converting VIF {"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:98:04,bridge_name='br-int',has_traffic_filtering=True,id=6f79c61c-2a19-4e1d-9661-6dccabb07572,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f79c61c-2a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG nova.objects.instance [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'pci_devices' on Instance uuid be408523-bdab-4ac8-b2ea-65003af6d1d7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:17:54 user nova-compute[72782]:   <uuid>be408523-bdab-4ac8-b2ea-65003af6d1d7</uuid>
Aug 14 20:17:54 user nova-compute[72782]:   <name>instance-00000026</name>
Aug 14 20:17:54 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:17:54 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:17:54 user nova-compute[72782]:   <metadata>
Aug 14 20:17:54 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:17:54 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:17:54 user nova-compute[72782]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-677276841</nova:name>
Aug 14 20:17:54 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:17:52</nova:creationTime>
Aug 14 20:17:54 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:17:54 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:17:54 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:17:54 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:17:54 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:17:54 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:17:54 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:17:54 user nova-compute[72782]:       <nova:owner>
Aug 14 20:17:54 user nova-compute[72782]:         <nova:user uuid="3090a5cb6ba34a7fb007d98a351c8313">tempest-AttachVolumeShelveTestJSON-220778544-project-member</nova:user>
Aug 14 20:17:54 user nova-compute[72782]:         <nova:project uuid="d8754bbf7f9945fba2bd1ad571f556f6">tempest-AttachVolumeShelveTestJSON-220778544</nova:project>
Aug 14 20:17:54 user nova-compute[72782]:       </nova:owner>
Aug 14 20:17:54 user nova-compute[72782]:       <nova:root type="image" uuid="4cebdab1-e6d5-4ba7-9799-7ae4debfd762"/>
Aug 14 20:17:54 user nova-compute[72782]:       <nova:ports>
Aug 14 20:17:54 user nova-compute[72782]:         <nova:port uuid="6f79c61c-2a19-4e1d-9661-6dccabb07572">
Aug 14 20:17:54 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 20:17:54 user nova-compute[72782]:         </nova:port>
Aug 14 20:17:54 user nova-compute[72782]:       </nova:ports>
Aug 14 20:17:54 user nova-compute[72782]:     </nova:instance>
Aug 14 20:17:54 user nova-compute[72782]:   </metadata>
Aug 14 20:17:54 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:17:54 user nova-compute[72782]:     <system>
Aug 14 20:17:54 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:17:54 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:17:54 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:17:54 user nova-compute[72782]:       <entry name="serial">be408523-bdab-4ac8-b2ea-65003af6d1d7</entry>
Aug 14 20:17:54 user nova-compute[72782]:       <entry name="uuid">be408523-bdab-4ac8-b2ea-65003af6d1d7</entry>
Aug 14 20:17:54 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:17:54 user nova-compute[72782]:     </system>
Aug 14 20:17:54 user nova-compute[72782]:   </sysinfo>
Aug 14 20:17:54 user nova-compute[72782]:   <os>
Aug 14 20:17:54 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:17:54 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:17:54 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:17:54 user nova-compute[72782]:   </os>
Aug 14 20:17:54 user nova-compute[72782]:   <features>
Aug 14 20:17:54 user nova-compute[72782]:     <acpi/>
Aug 14 20:17:54 user nova-compute[72782]:     <apic/>
Aug 14 20:17:54 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:17:54 user nova-compute[72782]:   </features>
Aug 14 20:17:54 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:17:54 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:17:54 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:17:54 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:17:54 user nova-compute[72782]:   </clock>
Aug 14 20:17:54 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:17:54 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:17:54 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:17:54 user nova-compute[72782]:   </cpu>
Aug 14 20:17:54 user nova-compute[72782]:   <devices>
Aug 14 20:17:54 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:17:54 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:17:54 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk"/>
Aug 14 20:17:54 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:17:54 user nova-compute[72782]:     </disk>
Aug 14 20:17:54 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 20:17:54 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:17:54 user nova-compute[72782]:       <source dev="/dev/sdb"/>
Aug 14 20:17:54 user nova-compute[72782]:       <target dev="vdc" bus="virtio"/>
Aug 14 20:17:54 user nova-compute[72782]:       <serial>0cb6ed70-44a3-4486-ba67-fc0d80261d11</serial>
Aug 14 20:17:54 user nova-compute[72782]:     </disk>
Aug 14 20:17:54 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:17:54 user nova-compute[72782]:       <mac address="fa:16:3e:2d:98:04"/>
Aug 14 20:17:54 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:17:54 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:17:54 user nova-compute[72782]:       <target dev="tap6f79c61c-2a"/>
Aug 14 20:17:54 user nova-compute[72782]:     </interface>
Aug 14 20:17:54 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:17:54 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/console.log" append="off"/>
Aug 14 20:17:54 user nova-compute[72782]:     </serial>
Aug 14 20:17:54 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:17:54 user nova-compute[72782]:     <video>
Aug 14 20:17:54 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:17:54 user nova-compute[72782]:     </video>
Aug 14 20:17:54 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:17:54 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:17:54 user nova-compute[72782]:     </rng>
Aug 14 20:17:54 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:17:54 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:17:54 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:17:54 user nova-compute[72782]:     </memballoon>
Aug 14 20:17:54 user nova-compute[72782]:   </devices>
Aug 14 20:17:54 user nova-compute[72782]: </domain>
Aug 14 20:17:54 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T20:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-677276841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-677276841',id=38,image_ref='4cebdab1-e6d5-4ba7-9799-7ae4debfd762',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1426773445',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d8754bbf7f9945fba2bd1ad571f556f6',ramdisk_id='',reservation_id='r-y67p6eax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-220778544',owner_user_name='tempest-AttachVolumeShelveTestJSON-220778544-project-member',shelved_at='2023-08-14T20:15:49.397616',shelved_host='user',shelved_image_id='4cebdab1-e6d5-4ba7-9799-7ae4debfd762'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3090a5cb6ba34a7fb007d98a351c8313',uuid=be408523-bdab-4ac8-b2ea-65003af6d1d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converting VIF {"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:98:04,bridge_name='br-int',has_traffic_filtering=True,id=6f79c61c-2a19-4e1d-9661-6dccabb07572,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f79c61c-2a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG os_vif [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:98:04,bridge_name='br-int',has_traffic_filtering=True,id=6f79c61c-2a19-4e1d-9661-6dccabb07572,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f79c61c-2a') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f79c61c-2a, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f79c61c-2a, col_values=(('external_ids', {'iface-id': '6f79c61c-2a19-4e1d-9661-6dccabb07572', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:98:04', 'vm-uuid': 'be408523-bdab-4ac8-b2ea-65003af6d1d7'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:54 user nova-compute[72782]: INFO os_vif [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:98:04,bridge_name='br-int',has_traffic_filtering=True,id=6f79c61c-2a19-4e1d-9661-6dccabb07572,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f79c61c-2a')
Aug 14 20:17:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:17:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] No VIF found with MAC fa:16:3e:2d:98:04, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:17:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:55 user nova-compute[72782]: DEBUG nova.compute.manager [req-bad679d8-d764-4e55-bb58-d3152091c3f3 req-7b67f764-6927-4f72-a0e3-d3288e3b6c66 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received event network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:17:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bad679d8-d764-4e55-bb58-d3152091c3f3 req-7b67f764-6927-4f72-a0e3-d3288e3b6c66 service nova] Acquiring lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:17:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bad679d8-d764-4e55-bb58-d3152091c3f3 req-7b67f764-6927-4f72-a0e3-d3288e3b6c66 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:17:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bad679d8-d764-4e55-bb58-d3152091c3f3 req-7b67f764-6927-4f72-a0e3-d3288e3b6c66 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:17:55 user nova-compute[72782]: DEBUG nova.compute.manager [req-bad679d8-d764-4e55-bb58-d3152091c3f3 req-7b67f764-6927-4f72-a0e3-d3288e3b6c66 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] No waiting events found dispatching network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:17:55 user nova-compute[72782]: WARNING nova.compute.manager [req-bad679d8-d764-4e55-bb58-d3152091c3f3 req-7b67f764-6927-4f72-a0e3-d3288e3b6c66 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received unexpected event network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 20:17:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:57 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044277.4828637, be408523-bdab-4ac8-b2ea-65003af6d1d7 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:17:57 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] VM Resumed (Lifecycle Event)
Aug 14 20:17:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:17:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:17:57 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Instance spawned successfully.
Aug 14 20:17:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:17:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:17:57 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:17:57 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044277.484348, be408523-bdab-4ac8-b2ea-65003af6d1d7 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:17:57 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] VM Started (Lifecycle Event)
Aug 14 20:17:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:17:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:17:57 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:17:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:17:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-78be7ed1-2651-4856-9580-9aa2781e1eec req-461c2618-3d40-4d54-a662-07632e144f78 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received event network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:17:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-78be7ed1-2651-4856-9580-9aa2781e1eec req-461c2618-3d40-4d54-a662-07632e144f78 service nova] Acquiring lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:17:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-78be7ed1-2651-4856-9580-9aa2781e1eec req-461c2618-3d40-4d54-a662-07632e144f78 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:17:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-78be7ed1-2651-4856-9580-9aa2781e1eec req-461c2618-3d40-4d54-a662-07632e144f78 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:17:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-78be7ed1-2651-4856-9580-9aa2781e1eec req-461c2618-3d40-4d54-a662-07632e144f78 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] No waiting events found dispatching network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:17:57 user nova-compute[72782]: WARNING nova.compute.manager [req-78be7ed1-2651-4856-9580-9aa2781e1eec req-461c2618-3d40-4d54-a662-07632e144f78 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received unexpected event network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 20:17:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-82df375a-48d8-435d-8fa2-2ff0b678055f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.683s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:17:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:17:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:18:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:18:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:18:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:18:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:18:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:16 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:18:17 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:18:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:18:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 20:18:17 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:18:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:20 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:18:20 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:18:20 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:18:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:18:20 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:18:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:18:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:18:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:18:20 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:18:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:18:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:18:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:18:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:18:20 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:18:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:18:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:18:20 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:18:21 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:18:21 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:18:21 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:18:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8574MB free_disk=25.395248413085938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:18:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:18:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:18:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 07cf5f99-542b-4604-b3cf-575ad218edf7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:18:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance be408523-bdab-4ac8-b2ea-65003af6d1d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:18:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:18:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:18:21 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:18:21 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:18:21 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:18:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:18:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:27 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:18:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:18:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:18:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:18:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:18:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:18:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:18:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquiring lock "07cf5f99-542b-4604-b3cf-575ad218edf7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:18:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:18:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquiring lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:18:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:18:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:18:41 user nova-compute[72782]: INFO nova.compute.manager [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Terminating instance
Aug 14 20:18:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:18:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG nova.compute.manager [req-bd85a0ed-9c0a-42b6-b173-bda74fa02fe3 req-793c00ca-9af8-4bd5-9b87-44139a31d4f1 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Received event network-vif-unplugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bd85a0ed-9c0a-42b6-b173-bda74fa02fe3 req-793c00ca-9af8-4bd5-9b87-44139a31d4f1 service nova] Acquiring lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bd85a0ed-9c0a-42b6-b173-bda74fa02fe3 req-793c00ca-9af8-4bd5-9b87-44139a31d4f1 service nova] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bd85a0ed-9c0a-42b6-b173-bda74fa02fe3 req-793c00ca-9af8-4bd5-9b87-44139a31d4f1 service nova] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG nova.compute.manager [req-bd85a0ed-9c0a-42b6-b173-bda74fa02fe3 req-793c00ca-9af8-4bd5-9b87-44139a31d4f1 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] No waiting events found dispatching network-vif-unplugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG nova.compute.manager [req-bd85a0ed-9c0a-42b6-b173-bda74fa02fe3 req-793c00ca-9af8-4bd5-9b87-44139a31d4f1 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Received event network-vif-unplugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:42 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Instance destroyed successfully.
Aug 14 20:18:42 user nova-compute[72782]: DEBUG nova.objects.instance [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lazy-loading 'resources' on Instance uuid 07cf5f99-542b-4604-b3cf-575ad218edf7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:16:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-885529377',display_name='tempest-VolumesActionsTest-instance-885529377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-885529377',id=39,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:16:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04f0a4b8575346f380ba1a31617004ea',ramdisk_id='',reservation_id='r-60p6pofr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-42673821',owner_user_name='tempest-VolumesActionsTest-42673821-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:16:57Z,user_data=None,user_id='0118609059f24257894c2ea98f193228',uuid=07cf5f99-542b-4604-b3cf-575ad218edf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "address": "fa:16:3e:94:b5:4b", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0b33aa-45", "ovs_interfaceid": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Converting VIF {"id": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "address": "fa:16:3e:94:b5:4b", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0b33aa-45", "ovs_interfaceid": "9a0b33aa-4553-4676-85ed-e1a34cd5e8e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:b5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9a0b33aa-4553-4676-85ed-e1a34cd5e8e6,network=Network(b5704a85-ae42-4617-9b54-6905496ae839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0b33aa-45') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG os_vif [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:b5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9a0b33aa-4553-4676-85ed-e1a34cd5e8e6,network=Network(b5704a85-ae42-4617-9b54-6905496ae839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0b33aa-45') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a0b33aa-45, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:18:42 user nova-compute[72782]: INFO os_vif [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:b5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9a0b33aa-4553-4676-85ed-e1a34cd5e8e6,network=Network(b5704a85-ae42-4617-9b54-6905496ae839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0b33aa-45')
Aug 14 20:18:42 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Deleting instance files /opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7_del
Aug 14 20:18:42 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Deletion of /opt/stack/data/nova/instances/07cf5f99-542b-4604-b3cf-575ad218edf7_del complete
Aug 14 20:18:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:42 user nova-compute[72782]: INFO nova.compute.manager [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 20:18:42 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:18:42 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:18:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:43 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:18:43 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Took 0.50 seconds to deallocate network for instance.
Aug 14 20:18:43 user nova-compute[72782]: DEBUG nova.compute.manager [req-58d04164-5aaa-48d1-8408-716a9ef42c34 req-1086594b-198d-4cf3-88b1-ca9ec5d48033 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Received event network-vif-deleted-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:18:43 user nova-compute[72782]: INFO nova.compute.manager [req-58d04164-5aaa-48d1-8408-716a9ef42c34 req-1086594b-198d-4cf3-88b1-ca9ec5d48033 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Neutron deleted interface 9a0b33aa-4553-4676-85ed-e1a34cd5e8e6; detaching it from the instance and deleting it from the info cache
Aug 14 20:18:43 user nova-compute[72782]: DEBUG nova.network.neutron [req-58d04164-5aaa-48d1-8408-716a9ef42c34 req-1086594b-198d-4cf3-88b1-ca9ec5d48033 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:18:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:43 user nova-compute[72782]: DEBUG nova.compute.manager [req-58d04164-5aaa-48d1-8408-716a9ef42c34 req-1086594b-198d-4cf3-88b1-ca9ec5d48033 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Detach interface failed, port_id=9a0b33aa-4553-4676-85ed-e1a34cd5e8e6, reason: Instance 07cf5f99-542b-4604-b3cf-575ad218edf7 could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 20:18:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:18:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:18:43 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:18:43 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:18:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:18:43 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Deleted allocations for instance 07cf5f99-542b-4604-b3cf-575ad218edf7
Aug 14 20:18:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6de1f5ab-7372-47fe-b344-0810c723c2e0 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.716s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:18:44 user nova-compute[72782]: DEBUG nova.compute.manager [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Received event network-vif-plugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:18:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] Acquiring lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:18:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:18:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:18:44 user nova-compute[72782]: DEBUG nova.compute.manager [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] No waiting events found dispatching network-vif-plugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:18:44 user nova-compute[72782]: WARNING nova.compute.manager [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Received unexpected event network-vif-plugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 for instance with vm_state deleted and task_state None.
Aug 14 20:18:44 user nova-compute[72782]: DEBUG nova.compute.manager [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Received event network-vif-plugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:18:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] Acquiring lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:18:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:18:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:18:44 user nova-compute[72782]: DEBUG nova.compute.manager [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] No waiting events found dispatching network-vif-plugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:18:44 user nova-compute[72782]: WARNING nova.compute.manager [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Received unexpected event network-vif-plugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 for instance with vm_state deleted and task_state None.
Aug 14 20:18:44 user nova-compute[72782]: DEBUG nova.compute.manager [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Received event network-vif-plugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:18:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] Acquiring lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:18:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:18:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:18:44 user nova-compute[72782]: DEBUG nova.compute.manager [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] No waiting events found dispatching network-vif-plugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:18:44 user nova-compute[72782]: WARNING nova.compute.manager [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Received unexpected event network-vif-plugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 for instance with vm_state deleted and task_state None.
Aug 14 20:18:44 user nova-compute[72782]: DEBUG nova.compute.manager [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Received event network-vif-plugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:18:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] Acquiring lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:18:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:18:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] Lock "07cf5f99-542b-4604-b3cf-575ad218edf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:18:44 user nova-compute[72782]: DEBUG nova.compute.manager [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] No waiting events found dispatching network-vif-plugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:18:44 user nova-compute[72782]: WARNING nova.compute.manager [req-ddd402bc-02cb-4325-9eab-516dee74f582 req-3ac7c8a1-023b-4604-bee6-30e2a10d54b0 service nova] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Received unexpected event network-vif-plugged-9a0b33aa-4553-4676-85ed-e1a34cd5e8e6 for instance with vm_state deleted and task_state None.
Aug 14 20:18:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:57 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692044322.5069299, 07cf5f99-542b-4604-b3cf-575ad218edf7 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:18:57 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] VM Stopped (Lifecycle Event)
Aug 14 20:18:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-10b41a55-38c5-476f-9fc2-47c73e6bf09b None None] [instance: 07cf5f99-542b-4604-b3cf-575ad218edf7] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:18:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:18:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:18:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:18:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:18:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:18:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:19:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:19:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:19:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:19:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:19:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:19:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:19:17 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:19:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:19:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:19:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:19:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:19:17 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:19:17 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid be408523-bdab-4ac8-b2ea-65003af6d1d7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:19:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:19:17 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Updating instance_info_cache with network_info: [{"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:19:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-be408523-bdab-4ac8-b2ea-65003af6d1d7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:19:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:19:18 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:19:18 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:19:19 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:19:21 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:19:21 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:19:21 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:19:21 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:19:22 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:19:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:19:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:19:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:19:22 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:19:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:19:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:19:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:19:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:19:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:19:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:22 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:19:22 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:19:22 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8713MB free_disk=25.422218322753906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:19:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:19:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:19:23 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance be408523-bdab-4ac8-b2ea-65003af6d1d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:19:23 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:19:23 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:19:23 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:19:23 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:19:23 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:19:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:19:27 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:19:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "be408523-bdab-4ac8-b2ea-65003af6d1d7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:19:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:19:27 user nova-compute[72782]: INFO nova.compute.manager [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Detaching volume 0cb6ed70-44a3-4486-ba67-fc0d80261d11
Aug 14 20:19:27 user nova-compute[72782]: INFO nova.virt.block_device [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Attempting to driver detach volume 0cb6ed70-44a3-4486-ba67-fc0d80261d11 from mountpoint /dev/vdc
Aug 14 20:19:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Attempting to detach device vdc from instance be408523-bdab-4ac8-b2ea-65003af6d1d7 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 20:19:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:19:27 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:19:27 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:19:27 user nova-compute[72782]:   <target dev="vdc" bus="virtio"/>
Aug 14 20:19:27 user nova-compute[72782]:   <serial>0cb6ed70-44a3-4486-ba67-fc0d80261d11</serial>
Aug 14 20:19:27 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 20:19:27 user nova-compute[72782]: </disk>
Aug 14 20:19:27 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:19:27 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Successfully detached device vdc from instance be408523-bdab-4ac8-b2ea-65003af6d1d7 from the persistent domain config.
Aug 14 20:19:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance be408523-bdab-4ac8-b2ea-65003af6d1d7 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 20:19:27 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:19:27 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:19:27 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:19:27 user nova-compute[72782]:   <target dev="vdc" bus="virtio"/>
Aug 14 20:19:27 user nova-compute[72782]:   <serial>0cb6ed70-44a3-4486-ba67-fc0d80261d11</serial>
Aug 14 20:19:27 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 20:19:27 user nova-compute[72782]: </disk>
Aug 14 20:19:27 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:19:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:19:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:19:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:19:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:19:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692044368.0320814, be408523-bdab-4ac8-b2ea-65003af6d1d7 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance be408523-bdab-4ac8-b2ea-65003af6d1d7 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 20:19:28 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Successfully detached device vdc from instance be408523-bdab-4ac8-b2ea-65003af6d1d7 from the live domain config.
Aug 14 20:19:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXGHhntz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:19:28 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:19:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1698f82c-7c0a-4dcc-9086-6f24a61d62d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c02be1-547f-4217-a48a-5f8915681bbf]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 (non-flash)
Aug 14 20:19:28 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 (non-flash)
Aug 14 20:19:28 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f64086ea710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4c6cbe-3708-46f7-98d3-698909b3acb5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41be190-a661-4a8c-b3f4-862fbcbbd416]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d156446-c772-4fa4-9724-4a2e1e4c2e8f]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7adcb0-5f72-4fd5-aa6e-672907ed1db7]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[70be6869-093c-4b6e-bad8-7f728f040c95]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[648c4f0b-6685-4ea1-ad2e-3bd87b236bc0]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11, portal: 172.16.0.220,3260]
Aug 14 20:19:28 user nova-compute[72782]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11, portal: 172.16.0.220,3260] successful.
Aug 14 20:19:28 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cb6ed70-44a3-4486-ba67-fc0d80261d11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[139f0ae0-0224-4736-a6c5-cd57876c3c0b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] <== disconnect_volume: return (275ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:19:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:29 user nova-compute[72782]: DEBUG nova.objects.instance [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'flavor' on Instance uuid be408523-bdab-4ac8-b2ea-65003af6d1d7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:19:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b2a276b3-459d-4e35-9340-ce2f606e1412 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.680s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:19:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquiring lock "08afbc52-3c73-4d38-86a0-8dfd23757b83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:19:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:19:33 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:19:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:19:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:19:33 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:19:33 user nova-compute[72782]: INFO nova.compute.claims [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Claim successful on node user
Aug 14 20:19:33 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:19:33 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:19:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:19:33 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:19:33 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:19:33 user nova-compute[72782]: DEBUG nova.network.neutron [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:19:33 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:19:33 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:19:33 user nova-compute[72782]: DEBUG nova.policy [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0118609059f24257894c2ea98f193228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f0a4b8575346f380ba1a31617004ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:19:33 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:19:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:19:33 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Creating image(s)
Aug 14 20:19:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquiring lock "/opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:19:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "/opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:19:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "/opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:19:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.172s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.207s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83/disk 1073741824" returned: 0 in 0.050s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG nova.network.neutron [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Successfully created port: 5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Cannot resize image /opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG nova.objects.instance [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lazy-loading 'migration_context' on Instance uuid 08afbc52-3c73-4d38-86a0-8dfd23757b83 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Ensure instance console log exists: /opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:19:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.network.neutron [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Successfully updated port: 5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquiring lock "refresh_cache-08afbc52-3c73-4d38-86a0-8dfd23757b83" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquired lock "refresh_cache-08afbc52-3c73-4d38-86a0-8dfd23757b83" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.network.neutron [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-4890ccf8-cff3-460c-a68f-d10915a055d6 req-e157803f-2166-4f35-b514-a1e31a1321e9 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Received event network-changed-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-4890ccf8-cff3-460c-a68f-d10915a055d6 req-e157803f-2166-4f35-b514-a1e31a1321e9 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Refreshing instance network info cache due to event network-changed-5ffae37d-d6ef-491a-993f-1d8aef43cbf5. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4890ccf8-cff3-460c-a68f-d10915a055d6 req-e157803f-2166-4f35-b514-a1e31a1321e9 service nova] Acquiring lock "refresh_cache-08afbc52-3c73-4d38-86a0-8dfd23757b83" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.network.neutron [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.network.neutron [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Updating instance_info_cache with network_info: [{"id": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "address": "fa:16:3e:92:6c:a7", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffae37d-d6", "ovs_interfaceid": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Releasing lock "refresh_cache-08afbc52-3c73-4d38-86a0-8dfd23757b83" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Instance network_info: |[{"id": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "address": "fa:16:3e:92:6c:a7", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffae37d-d6", "ovs_interfaceid": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4890ccf8-cff3-460c-a68f-d10915a055d6 req-e157803f-2166-4f35-b514-a1e31a1321e9 service nova] Acquired lock "refresh_cache-08afbc52-3c73-4d38-86a0-8dfd23757b83" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.network.neutron [req-4890ccf8-cff3-460c-a68f-d10915a055d6 req-e157803f-2166-4f35-b514-a1e31a1321e9 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Refreshing network info cache for port 5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Start _get_guest_xml network_info=[{"id": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "address": "fa:16:3e:92:6c:a7", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffae37d-d6", "ovs_interfaceid": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:19:35 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:19:35 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:19:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-30209042',display_name='tempest-VolumesActionsTest-instance-30209042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-30209042',id=40,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04f0a4b8575346f380ba1a31617004ea',ramdisk_id='',reservation_id='r-wvec1k03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-42673821',owner_user_name='tempest-VolumesActionsTest-42673821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:19:34Z,user_data=None,user_id='0118609059f24257894c2ea98f193228',uuid=08afbc52-3c73-4d38-86a0-8dfd23757b83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "address": "fa:16:3e:92:6c:a7", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffae37d-d6", "ovs_interfaceid": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Converting VIF {"id": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "address": "fa:16:3e:92:6c:a7", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffae37d-d6", "ovs_interfaceid": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:6c:a7,bridge_name='br-int',has_traffic_filtering=True,id=5ffae37d-d6ef-491a-993f-1d8aef43cbf5,network=Network(b5704a85-ae42-4617-9b54-6905496ae839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ffae37d-d6') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.objects.instance [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lazy-loading 'pci_devices' on Instance uuid 08afbc52-3c73-4d38-86a0-8dfd23757b83 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:19:35 user nova-compute[72782]:   <uuid>08afbc52-3c73-4d38-86a0-8dfd23757b83</uuid>
Aug 14 20:19:35 user nova-compute[72782]:   <name>instance-00000028</name>
Aug 14 20:19:35 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:19:35 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:19:35 user nova-compute[72782]:   <metadata>
Aug 14 20:19:35 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:19:35 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:19:35 user nova-compute[72782]:       <nova:name>tempest-VolumesActionsTest-instance-30209042</nova:name>
Aug 14 20:19:35 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:19:35</nova:creationTime>
Aug 14 20:19:35 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:19:35 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:19:35 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:19:35 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:19:35 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:19:35 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:19:35 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:19:35 user nova-compute[72782]:       <nova:owner>
Aug 14 20:19:35 user nova-compute[72782]:         <nova:user uuid="0118609059f24257894c2ea98f193228">tempest-VolumesActionsTest-42673821-project-member</nova:user>
Aug 14 20:19:35 user nova-compute[72782]:         <nova:project uuid="04f0a4b8575346f380ba1a31617004ea">tempest-VolumesActionsTest-42673821</nova:project>
Aug 14 20:19:35 user nova-compute[72782]:       </nova:owner>
Aug 14 20:19:35 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 20:19:35 user nova-compute[72782]:       <nova:ports>
Aug 14 20:19:35 user nova-compute[72782]:         <nova:port uuid="5ffae37d-d6ef-491a-993f-1d8aef43cbf5">
Aug 14 20:19:35 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 20:19:35 user nova-compute[72782]:         </nova:port>
Aug 14 20:19:35 user nova-compute[72782]:       </nova:ports>
Aug 14 20:19:35 user nova-compute[72782]:     </nova:instance>
Aug 14 20:19:35 user nova-compute[72782]:   </metadata>
Aug 14 20:19:35 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:19:35 user nova-compute[72782]:     <system>
Aug 14 20:19:35 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:19:35 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:19:35 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:19:35 user nova-compute[72782]:       <entry name="serial">08afbc52-3c73-4d38-86a0-8dfd23757b83</entry>
Aug 14 20:19:35 user nova-compute[72782]:       <entry name="uuid">08afbc52-3c73-4d38-86a0-8dfd23757b83</entry>
Aug 14 20:19:35 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:19:35 user nova-compute[72782]:     </system>
Aug 14 20:19:35 user nova-compute[72782]:   </sysinfo>
Aug 14 20:19:35 user nova-compute[72782]:   <os>
Aug 14 20:19:35 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:19:35 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:19:35 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:19:35 user nova-compute[72782]:   </os>
Aug 14 20:19:35 user nova-compute[72782]:   <features>
Aug 14 20:19:35 user nova-compute[72782]:     <acpi/>
Aug 14 20:19:35 user nova-compute[72782]:     <apic/>
Aug 14 20:19:35 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:19:35 user nova-compute[72782]:   </features>
Aug 14 20:19:35 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:19:35 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:19:35 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:19:35 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:19:35 user nova-compute[72782]:   </clock>
Aug 14 20:19:35 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:19:35 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:19:35 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:19:35 user nova-compute[72782]:   </cpu>
Aug 14 20:19:35 user nova-compute[72782]:   <devices>
Aug 14 20:19:35 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:19:35 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:19:35 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83/disk"/>
Aug 14 20:19:35 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:19:35 user nova-compute[72782]:     </disk>
Aug 14 20:19:35 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:19:35 user nova-compute[72782]:       <mac address="fa:16:3e:92:6c:a7"/>
Aug 14 20:19:35 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:19:35 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:19:35 user nova-compute[72782]:       <target dev="tap5ffae37d-d6"/>
Aug 14 20:19:35 user nova-compute[72782]:     </interface>
Aug 14 20:19:35 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:19:35 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83/console.log" append="off"/>
Aug 14 20:19:35 user nova-compute[72782]:     </serial>
Aug 14 20:19:35 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:19:35 user nova-compute[72782]:     <video>
Aug 14 20:19:35 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:19:35 user nova-compute[72782]:     </video>
Aug 14 20:19:35 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:19:35 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:19:35 user nova-compute[72782]:     </rng>
Aug 14 20:19:35 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:19:35 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:19:35 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:19:35 user nova-compute[72782]:     </memballoon>
Aug 14 20:19:35 user nova-compute[72782]:   </devices>
Aug 14 20:19:35 user nova-compute[72782]: </domain>
Aug 14 20:19:35 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:19:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-30209042',display_name='tempest-VolumesActionsTest-instance-30209042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-30209042',id=40,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04f0a4b8575346f380ba1a31617004ea',ramdisk_id='',reservation_id='r-wvec1k03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-42673821',owner_user_name='tempest-VolumesActionsTest-42673821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:19:34Z,user_data=None,user_id='0118609059f24257894c2ea98f193228',uuid=08afbc52-3c73-4d38-86a0-8dfd23757b83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "address": "fa:16:3e:92:6c:a7", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffae37d-d6", "ovs_interfaceid": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Converting VIF {"id": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "address": "fa:16:3e:92:6c:a7", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffae37d-d6", "ovs_interfaceid": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:6c:a7,bridge_name='br-int',has_traffic_filtering=True,id=5ffae37d-d6ef-491a-993f-1d8aef43cbf5,network=Network(b5704a85-ae42-4617-9b54-6905496ae839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ffae37d-d6') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG os_vif [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:6c:a7,bridge_name='br-int',has_traffic_filtering=True,id=5ffae37d-d6ef-491a-993f-1d8aef43cbf5,network=Network(b5704a85-ae42-4617-9b54-6905496ae839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ffae37d-d6') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ffae37d-d6, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ffae37d-d6, col_values=(('external_ids', {'iface-id': '5ffae37d-d6ef-491a-993f-1d8aef43cbf5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:6c:a7', 'vm-uuid': '08afbc52-3c73-4d38-86a0-8dfd23757b83'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:35 user nova-compute[72782]: INFO os_vif [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:6c:a7,bridge_name='br-int',has_traffic_filtering=True,id=5ffae37d-d6ef-491a-993f-1d8aef43cbf5,network=Network(b5704a85-ae42-4617-9b54-6905496ae839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ffae37d-d6')
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:19:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] No VIF found with MAC fa:16:3e:92:6c:a7, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:19:36 user nova-compute[72782]: DEBUG nova.network.neutron [req-4890ccf8-cff3-460c-a68f-d10915a055d6 req-e157803f-2166-4f35-b514-a1e31a1321e9 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Updated VIF entry in instance network info cache for port 5ffae37d-d6ef-491a-993f-1d8aef43cbf5. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:19:36 user nova-compute[72782]: DEBUG nova.network.neutron [req-4890ccf8-cff3-460c-a68f-d10915a055d6 req-e157803f-2166-4f35-b514-a1e31a1321e9 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Updating instance_info_cache with network_info: [{"id": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "address": "fa:16:3e:92:6c:a7", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffae37d-d6", "ovs_interfaceid": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:19:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4890ccf8-cff3-460c-a68f-d10915a055d6 req-e157803f-2166-4f35-b514-a1e31a1321e9 service nova] Releasing lock "refresh_cache-08afbc52-3c73-4d38-86a0-8dfd23757b83" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:19:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-a212d2e6-a0d3-4bf9-bfda-767938a67e04 req-e8db0443-80a6-4ed6-b29b-d1a555a0b32f service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Received event network-vif-plugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:19:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a212d2e6-a0d3-4bf9-bfda-767938a67e04 req-e8db0443-80a6-4ed6-b29b-d1a555a0b32f service nova] Acquiring lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:19:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a212d2e6-a0d3-4bf9-bfda-767938a67e04 req-e8db0443-80a6-4ed6-b29b-d1a555a0b32f service nova] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:19:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-a212d2e6-a0d3-4bf9-bfda-767938a67e04 req-e8db0443-80a6-4ed6-b29b-d1a555a0b32f service nova] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:19:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-a212d2e6-a0d3-4bf9-bfda-767938a67e04 req-e8db0443-80a6-4ed6-b29b-d1a555a0b32f service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] No waiting events found dispatching network-vif-plugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:19:37 user nova-compute[72782]: WARNING nova.compute.manager [req-a212d2e6-a0d3-4bf9-bfda-767938a67e04 req-e8db0443-80a6-4ed6-b29b-d1a555a0b32f service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Received unexpected event network-vif-plugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 for instance with vm_state building and task_state spawning.
Aug 14 20:19:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:39 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044378.999651, 08afbc52-3c73-4d38-86a0-8dfd23757b83 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:19:39 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] VM Resumed (Lifecycle Event)
Aug 14 20:19:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:19:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:19:39 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Instance spawned successfully.
Aug 14 20:19:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:19:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:19:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:19:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:19:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:19:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:19:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:19:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:19:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:19:39 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:19:39 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044379.004191, 08afbc52-3c73-4d38-86a0-8dfd23757b83 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:19:39 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] VM Started (Lifecycle Event)
Aug 14 20:19:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:19:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:19:39 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:19:39 user nova-compute[72782]: INFO nova.compute.manager [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Took 5.30 seconds to spawn the instance on the hypervisor.
Aug 14 20:19:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:19:39 user nova-compute[72782]: INFO nova.compute.manager [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Took 5.84 seconds to build instance.
Aug 14 20:19:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-1e953e29-8a46-41e1-a904-2850793817d3 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.934s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:19:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-6be65585-700e-4169-8fc9-187dfdc81d8c req-bdcd8ebb-8b31-48a1-8a7b-833ea94323a9 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Received event network-vif-plugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:19:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6be65585-700e-4169-8fc9-187dfdc81d8c req-bdcd8ebb-8b31-48a1-8a7b-833ea94323a9 service nova] Acquiring lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:19:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6be65585-700e-4169-8fc9-187dfdc81d8c req-bdcd8ebb-8b31-48a1-8a7b-833ea94323a9 service nova] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:19:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6be65585-700e-4169-8fc9-187dfdc81d8c req-bdcd8ebb-8b31-48a1-8a7b-833ea94323a9 service nova] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:19:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-6be65585-700e-4169-8fc9-187dfdc81d8c req-bdcd8ebb-8b31-48a1-8a7b-833ea94323a9 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] No waiting events found dispatching network-vif-plugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:19:39 user nova-compute[72782]: WARNING nova.compute.manager [req-6be65585-700e-4169-8fc9-187dfdc81d8c req-bdcd8ebb-8b31-48a1-8a7b-833ea94323a9 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Received unexpected event network-vif-plugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 for instance with vm_state active and task_state None.
Aug 14 20:19:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:19:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:20:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "be408523-bdab-4ac8-b2ea-65003af6d1d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:20:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:20:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:20:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:20:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:20:17 user nova-compute[72782]: INFO nova.compute.manager [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Terminating instance
Aug 14 20:20:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:20:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG nova.compute.manager [req-9a4bd517-9455-464c-936a-3dbb257d8e61 req-711846db-b509-45df-bb02-54d0ad329d87 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received event network-vif-unplugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9a4bd517-9455-464c-936a-3dbb257d8e61 req-711846db-b509-45df-bb02-54d0ad329d87 service nova] Acquiring lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9a4bd517-9455-464c-936a-3dbb257d8e61 req-711846db-b509-45df-bb02-54d0ad329d87 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9a4bd517-9455-464c-936a-3dbb257d8e61 req-711846db-b509-45df-bb02-54d0ad329d87 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG nova.compute.manager [req-9a4bd517-9455-464c-936a-3dbb257d8e61 req-711846db-b509-45df-bb02-54d0ad329d87 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] No waiting events found dispatching network-vif-unplugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG nova.compute.manager [req-9a4bd517-9455-464c-936a-3dbb257d8e61 req-711846db-b509-45df-bb02-54d0ad329d87 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received event network-vif-unplugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:18 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Instance destroyed successfully.
Aug 14 20:20:18 user nova-compute[72782]: DEBUG nova.objects.instance [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'resources' on Instance uuid be408523-bdab-4ac8-b2ea-65003af6d1d7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T20:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-677276841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-677276841',id=38,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8Uj8zUnrkLTabv1RW3o8Wjjs2cJCkSEF6Sq2fXEMYcLeivZLio4OyDTatGotv181HghXlTiTtSJpCmTIT7gSAT44MCn+0NAkSnkNGXlqDb3Drqo0qiXvUqYDHGzF0JdQ==',key_name='tempest-keypair-1426773445',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:17:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8754bbf7f9945fba2bd1ad571f556f6',ramdisk_id='',reservation_id='r-y67p6eax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-220778544',owner_user_name='tempest-AttachVolumeShelveTestJSON-220778544-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3090a5cb6ba34a7fb007d98a351c8313',uuid=be408523-bdab-4ac8-b2ea-65003af6d1d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converting VIF {"id": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "address": "fa:16:3e:2d:98:04", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f79c61c-2a", "ovs_interfaceid": "6f79c61c-2a19-4e1d-9661-6dccabb07572", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:98:04,bridge_name='br-int',has_traffic_filtering=True,id=6f79c61c-2a19-4e1d-9661-6dccabb07572,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f79c61c-2a') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG os_vif [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:98:04,bridge_name='br-int',has_traffic_filtering=True,id=6f79c61c-2a19-4e1d-9661-6dccabb07572,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f79c61c-2a') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f79c61c-2a, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:20:18 user nova-compute[72782]: INFO os_vif [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:98:04,bridge_name='br-int',has_traffic_filtering=True,id=6f79c61c-2a19-4e1d-9661-6dccabb07572,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f79c61c-2a')
Aug 14 20:20:18 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Deleting instance files /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7_del
Aug 14 20:20:18 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Deletion of /opt/stack/data/nova/instances/be408523-bdab-4ac8-b2ea-65003af6d1d7_del complete
Aug 14 20:20:18 user nova-compute[72782]: INFO nova.compute.manager [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 20:20:18 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:20:18 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:20:19 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:20:19 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:20:19 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:20:19 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Skipping network cache update for instance because it is being deleted. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 14 20:20:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-08afbc52-3c73-4d38-86a0-8dfd23757b83" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:20:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-08afbc52-3c73-4d38-86a0-8dfd23757b83" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:20:19 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:20:19 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 08afbc52-3c73-4d38-86a0-8dfd23757b83 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:20:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Updating instance_info_cache with network_info: [{"id": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "address": "fa:16:3e:92:6c:a7", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffae37d-d6", "ovs_interfaceid": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-08afbc52-3c73-4d38-86a0-8dfd23757b83" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received event network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] Acquiring lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] No waiting events found dispatching network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:20:20 user nova-compute[72782]: WARNING nova.compute.manager [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received unexpected event network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 for instance with vm_state active and task_state deleting.
Aug 14 20:20:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received event network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] Acquiring lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] No waiting events found dispatching network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:20:20 user nova-compute[72782]: WARNING nova.compute.manager [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received unexpected event network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 for instance with vm_state active and task_state deleting.
Aug 14 20:20:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received event network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] Acquiring lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] No waiting events found dispatching network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:20:20 user nova-compute[72782]: WARNING nova.compute.manager [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received unexpected event network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 for instance with vm_state active and task_state deleting.
Aug 14 20:20:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received event network-vif-unplugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] Acquiring lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] No waiting events found dispatching network-vif-unplugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received event network-vif-unplugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received event network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] Acquiring lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] No waiting events found dispatching network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:20:20 user nova-compute[72782]: WARNING nova.compute.manager [req-c729cde4-f010-4cd0-9336-ae13d1ed5973 req-5effb57d-629b-42ee-bc48-da3305a233b2 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received unexpected event network-vif-plugged-6f79c61c-2a19-4e1d-9661-6dccabb07572 for instance with vm_state active and task_state deleting.
Aug 14 20:20:20 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Took 1.58 seconds to deallocate network for instance.
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:20:20 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Deleted allocations for instance be408523-bdab-4ac8-b2ea-65003af6d1d7
Aug 14 20:20:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ae5a5b9-b376-4d10-8d9a-b91a3f83844f tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "be408523-bdab-4ac8-b2ea-65003af6d1d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.804s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:20:21 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:20:22 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:20:22 user nova-compute[72782]: DEBUG nova.compute.manager [req-e58063d8-e9f8-4d41-b2d9-e58efd7320eb req-a9b28dc0-a608-42ec-855f-a0d764454468 service nova] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Received event network-vif-deleted-6f79c61c-2a19-4e1d-9661-6dccabb07572 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:20:23 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:20:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:20:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:24 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:20:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:20:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:20:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:20:24 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:20:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:20:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:20:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:20:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:20:24 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:20:24 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:20:24 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8690MB free_disk=25.420238494873047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:20:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:20:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:20:24 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 08afbc52-3c73-4d38-86a0-8dfd23757b83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:20:24 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:20:24 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:20:25 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:20:25 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:20:25 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:20:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:20:27 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:20:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:20:33 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692044418.5919292, be408523-bdab-4ac8-b2ea-65003af6d1d7 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:20:33 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] VM Stopped (Lifecycle Event)
Aug 14 20:20:33 user nova-compute[72782]: DEBUG nova.compute.manager [None req-9696c81d-a5ce-482e-8bb4-b7fad3c73d5f None None] [instance: be408523-bdab-4ac8-b2ea-65003af6d1d7] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:20:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:20:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:20:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:20:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:20:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:20:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:20:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:20:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:20:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:20:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:20:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:20:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:20:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:20:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Verify base images {{(pid=72782) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 14 20:20:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Image id 450d2d82-4a73-4a35-bff3-71ddab4bfe0e yields fingerprint 8990fad913cce9ee17eada141a5bf50d30e51dd7 {{(pid=72782) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 14 20:20:43 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] image 450d2d82-4a73-4a35-bff3-71ddab4bfe0e at (/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7): checking
Aug 14 20:20:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] image 450d2d82-4a73-4a35-bff3-71ddab4bfe0e at (/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7): image is in use {{(pid=72782) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 14 20:20:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72782) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 14 20:20:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] 08afbc52-3c73-4d38-86a0-8dfd23757b83 is a valid instance name {{(pid=72782) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 14 20:20:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] 08afbc52-3c73-4d38-86a0-8dfd23757b83 has a disk file {{(pid=72782) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 14 20:20:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:20:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:20:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 08afbc52-3c73-4d38-86a0-8dfd23757b83 is backed by 8990fad913cce9ee17eada141a5bf50d30e51dd7 {{(pid=72782) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 14 20:20:43 user nova-compute[72782]: WARNING nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1b064ad33aca857b6604904004add257f9390c7f
Aug 14 20:20:43 user nova-compute[72782]: WARNING nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Unknown base file: /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719
Aug 14 20:20:43 user nova-compute[72782]: WARNING nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65
Aug 14 20:20:43 user nova-compute[72782]: WARNING nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Unknown base file: /opt/stack/data/nova/instances/_base/124cf09669d2c652a7e47d3f9894d52c12c78248
Aug 14 20:20:43 user nova-compute[72782]: WARNING nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1
Aug 14 20:20:43 user nova-compute[72782]: WARNING nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Unknown base file: /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f
Aug 14 20:20:43 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Active base files: /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7
Aug 14 20:20:43 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Removable base files: /opt/stack/data/nova/instances/_base/1b064ad33aca857b6604904004add257f9390c7f /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719 /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65 /opt/stack/data/nova/instances/_base/124cf09669d2c652a7e47d3f9894d52c12c78248 /opt/stack/data/nova/instances/_base/e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1 /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f
Aug 14 20:20:43 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1b064ad33aca857b6604904004add257f9390c7f
Aug 14 20:20:43 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719
Aug 14 20:20:43 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65
Aug 14 20:20:43 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/124cf09669d2c652a7e47d3f9894d52c12c78248
Aug 14 20:20:43 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1
Aug 14 20:20:43 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f
Aug 14 20:20:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Verification complete {{(pid=72782) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 14 20:20:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Verify swap images {{(pid=72782) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 14 20:20:43 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Verify ephemeral images {{(pid=72782) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 14 20:20:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:20:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:20:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:20:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:20:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:20:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:20:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:20:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:20:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:20:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:20:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:20:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:20:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:20:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:21:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:21:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "b4c69b22-f628-40c1-ab95-983d6005b10c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:21:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:21:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:21:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:21:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:21:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:21:11 user nova-compute[72782]: INFO nova.compute.claims [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Claim successful on node user
Aug 14 20:21:11 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:21:11 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG nova.network.neutron [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:21:12 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:21:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:21:12 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Creating image(s)
Aug 14 20:21:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "/opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "/opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG nova.policy [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3090a5cb6ba34a7fb007d98a351c8313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8754bbf7f9945fba2bd1ad571f556f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.212s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.172s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk 1073741824" returned: 0 in 0.053s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.172s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:21:12 user nova-compute[72782]: DEBUG nova.network.neutron [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Successfully created port: fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:21:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:21:13 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Cannot resize image /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 20:21:13 user nova-compute[72782]: DEBUG nova.objects.instance [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'migration_context' on Instance uuid b4c69b22-f628-40c1-ab95-983d6005b10c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:21:13 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:21:13 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Ensure instance console log exists: /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:21:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:21:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:21:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:21:13 user nova-compute[72782]: DEBUG nova.network.neutron [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Successfully updated port: fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:21:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:21:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:21:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquired lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:21:13 user nova-compute[72782]: DEBUG nova.network.neutron [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:21:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-f82883f5-9b46-444e-a682-eda7461a67ea req-257283d1-8b19-47d4-bbd8-a490b0ad8b83 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received event network-changed-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:21:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-f82883f5-9b46-444e-a682-eda7461a67ea req-257283d1-8b19-47d4-bbd8-a490b0ad8b83 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Refreshing instance network info cache due to event network-changed-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:21:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f82883f5-9b46-444e-a682-eda7461a67ea req-257283d1-8b19-47d4-bbd8-a490b0ad8b83 service nova] Acquiring lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:21:13 user nova-compute[72782]: DEBUG nova.network.neutron [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.network.neutron [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Updating instance_info_cache with network_info: [{"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Releasing lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Instance network_info: |[{"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f82883f5-9b46-444e-a682-eda7461a67ea req-257283d1-8b19-47d4-bbd8-a490b0ad8b83 service nova] Acquired lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.network.neutron [req-f82883f5-9b46-444e-a682-eda7461a67ea req-257283d1-8b19-47d4-bbd8-a490b0ad8b83 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Refreshing network info cache for port fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Start _get_guest_xml network_info=[{"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:21:14 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:21:14 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1261581948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1261581948',id=41,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUcZm/ixOHXdKaRFGd0Vcj7OPXNUUPuROJ2bl7c+YwYJt2z+sgaboFOA+89jQPGz9pfpXJCdE0Hdl8dwOwfF5lOzsOO7GOn/zukXSHkUntg5Pn/2ZAGAV3Hl6u8h29jwA==',key_name='tempest-keypair-222436759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8754bbf7f9945fba2bd1ad571f556f6',ramdisk_id='',reservation_id='r-t0ee9af6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-220778544',owner_user_name='tempest-AttachVolumeShelveTestJSON-220778544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3090a5cb6ba34a7fb007d98a351c8313',uuid=b4c69b22-f628-40c1-ab95-983d6005b10c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converting VIF {"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:8e:23,bridge_name='br-int',has_traffic_filtering=True,id=fe0631cb-7cfd-40ba-ae3f-e924307c0ab0,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0631cb-7c') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.objects.instance [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'pci_devices' on Instance uuid b4c69b22-f628-40c1-ab95-983d6005b10c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:21:14 user nova-compute[72782]:   <uuid>b4c69b22-f628-40c1-ab95-983d6005b10c</uuid>
Aug 14 20:21:14 user nova-compute[72782]:   <name>instance-00000029</name>
Aug 14 20:21:14 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:21:14 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:21:14 user nova-compute[72782]:   <metadata>
Aug 14 20:21:14 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:21:14 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:21:14 user nova-compute[72782]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1261581948</nova:name>
Aug 14 20:21:14 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:21:14</nova:creationTime>
Aug 14 20:21:14 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:21:14 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:21:14 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:21:14 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:21:14 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:21:14 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:21:14 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:21:14 user nova-compute[72782]:       <nova:owner>
Aug 14 20:21:14 user nova-compute[72782]:         <nova:user uuid="3090a5cb6ba34a7fb007d98a351c8313">tempest-AttachVolumeShelveTestJSON-220778544-project-member</nova:user>
Aug 14 20:21:14 user nova-compute[72782]:         <nova:project uuid="d8754bbf7f9945fba2bd1ad571f556f6">tempest-AttachVolumeShelveTestJSON-220778544</nova:project>
Aug 14 20:21:14 user nova-compute[72782]:       </nova:owner>
Aug 14 20:21:14 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 20:21:14 user nova-compute[72782]:       <nova:ports>
Aug 14 20:21:14 user nova-compute[72782]:         <nova:port uuid="fe0631cb-7cfd-40ba-ae3f-e924307c0ab0">
Aug 14 20:21:14 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 20:21:14 user nova-compute[72782]:         </nova:port>
Aug 14 20:21:14 user nova-compute[72782]:       </nova:ports>
Aug 14 20:21:14 user nova-compute[72782]:     </nova:instance>
Aug 14 20:21:14 user nova-compute[72782]:   </metadata>
Aug 14 20:21:14 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:21:14 user nova-compute[72782]:     <system>
Aug 14 20:21:14 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:21:14 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:21:14 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:21:14 user nova-compute[72782]:       <entry name="serial">b4c69b22-f628-40c1-ab95-983d6005b10c</entry>
Aug 14 20:21:14 user nova-compute[72782]:       <entry name="uuid">b4c69b22-f628-40c1-ab95-983d6005b10c</entry>
Aug 14 20:21:14 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:21:14 user nova-compute[72782]:     </system>
Aug 14 20:21:14 user nova-compute[72782]:   </sysinfo>
Aug 14 20:21:14 user nova-compute[72782]:   <os>
Aug 14 20:21:14 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:21:14 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:21:14 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:21:14 user nova-compute[72782]:   </os>
Aug 14 20:21:14 user nova-compute[72782]:   <features>
Aug 14 20:21:14 user nova-compute[72782]:     <acpi/>
Aug 14 20:21:14 user nova-compute[72782]:     <apic/>
Aug 14 20:21:14 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:21:14 user nova-compute[72782]:   </features>
Aug 14 20:21:14 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:21:14 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:21:14 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:21:14 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:21:14 user nova-compute[72782]:   </clock>
Aug 14 20:21:14 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:21:14 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:21:14 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:21:14 user nova-compute[72782]:   </cpu>
Aug 14 20:21:14 user nova-compute[72782]:   <devices>
Aug 14 20:21:14 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:21:14 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:21:14 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk"/>
Aug 14 20:21:14 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:21:14 user nova-compute[72782]:     </disk>
Aug 14 20:21:14 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:21:14 user nova-compute[72782]:       <mac address="fa:16:3e:12:8e:23"/>
Aug 14 20:21:14 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:21:14 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:21:14 user nova-compute[72782]:       <target dev="tapfe0631cb-7c"/>
Aug 14 20:21:14 user nova-compute[72782]:     </interface>
Aug 14 20:21:14 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:21:14 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/console.log" append="off"/>
Aug 14 20:21:14 user nova-compute[72782]:     </serial>
Aug 14 20:21:14 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:21:14 user nova-compute[72782]:     <video>
Aug 14 20:21:14 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:21:14 user nova-compute[72782]:     </video>
Aug 14 20:21:14 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:21:14 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:21:14 user nova-compute[72782]:     </rng>
Aug 14 20:21:14 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:21:14 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:21:14 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:21:14 user nova-compute[72782]:     </memballoon>
Aug 14 20:21:14 user nova-compute[72782]:   </devices>
Aug 14 20:21:14 user nova-compute[72782]: </domain>
Aug 14 20:21:14 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1261581948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1261581948',id=41,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUcZm/ixOHXdKaRFGd0Vcj7OPXNUUPuROJ2bl7c+YwYJt2z+sgaboFOA+89jQPGz9pfpXJCdE0Hdl8dwOwfF5lOzsOO7GOn/zukXSHkUntg5Pn/2ZAGAV3Hl6u8h29jwA==',key_name='tempest-keypair-222436759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8754bbf7f9945fba2bd1ad571f556f6',ramdisk_id='',reservation_id='r-t0ee9af6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-220778544',owner_user_name='tempest-AttachVolumeShelveTestJSON-220778544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3090a5cb6ba34a7fb007d98a351c8313',uuid=b4c69b22-f628-40c1-ab95-983d6005b10c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converting VIF {"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:8e:23,bridge_name='br-int',has_traffic_filtering=True,id=fe0631cb-7cfd-40ba-ae3f-e924307c0ab0,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0631cb-7c') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG os_vif [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:8e:23,bridge_name='br-int',has_traffic_filtering=True,id=fe0631cb-7cfd-40ba-ae3f-e924307c0ab0,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0631cb-7c') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe0631cb-7c, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe0631cb-7c, col_values=(('external_ids', {'iface-id': 'fe0631cb-7cfd-40ba-ae3f-e924307c0ab0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:8e:23', 'vm-uuid': 'b4c69b22-f628-40c1-ab95-983d6005b10c'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:14 user nova-compute[72782]: INFO os_vif [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:8e:23,bridge_name='br-int',has_traffic_filtering=True,id=fe0631cb-7cfd-40ba-ae3f-e924307c0ab0,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0631cb-7c')
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] No VIF found with MAC fa:16:3e:12:8e:23, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.network.neutron [req-f82883f5-9b46-444e-a682-eda7461a67ea req-257283d1-8b19-47d4-bbd8-a490b0ad8b83 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Updated VIF entry in instance network info cache for port fe0631cb-7cfd-40ba-ae3f-e924307c0ab0. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG nova.network.neutron [req-f82883f5-9b46-444e-a682-eda7461a67ea req-257283d1-8b19-47d4-bbd8-a490b0ad8b83 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Updating instance_info_cache with network_info: [{"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:21:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f82883f5-9b46-444e-a682-eda7461a67ea req-257283d1-8b19-47d4-bbd8-a490b0ad8b83 service nova] Releasing lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:21:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:15 user nova-compute[72782]: DEBUG nova.compute.manager [req-35fa25af-8ee5-47e7-83ea-087cea113e1c req-6b64f1b4-c2d5-4c4c-9f09-0872da658275 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received event network-vif-plugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:21:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-35fa25af-8ee5-47e7-83ea-087cea113e1c req-6b64f1b4-c2d5-4c4c-9f09-0872da658275 service nova] Acquiring lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:21:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-35fa25af-8ee5-47e7-83ea-087cea113e1c req-6b64f1b4-c2d5-4c4c-9f09-0872da658275 service nova] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:21:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-35fa25af-8ee5-47e7-83ea-087cea113e1c req-6b64f1b4-c2d5-4c4c-9f09-0872da658275 service nova] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:21:15 user nova-compute[72782]: DEBUG nova.compute.manager [req-35fa25af-8ee5-47e7-83ea-087cea113e1c req-6b64f1b4-c2d5-4c4c-9f09-0872da658275 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] No waiting events found dispatching network-vif-plugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:21:15 user nova-compute[72782]: WARNING nova.compute.manager [req-35fa25af-8ee5-47e7-83ea-087cea113e1c req-6b64f1b4-c2d5-4c4c-9f09-0872da658275 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received unexpected event network-vif-plugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 for instance with vm_state building and task_state spawning.
Aug 14 20:21:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:17 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044477.4663846, b4c69b22-f628-40c1-ab95-983d6005b10c => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:21:17 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] VM Resumed (Lifecycle Event)
Aug 14 20:21:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:21:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:21:17 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Instance spawned successfully.
Aug 14 20:21:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:21:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:21:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:21:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:21:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:21:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:21:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:21:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:21:17 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:21:17 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:21:17 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044477.4679613, b4c69b22-f628-40c1-ab95-983d6005b10c => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:21:17 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] VM Started (Lifecycle Event)
Aug 14 20:21:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:21:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:21:17 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:21:17 user nova-compute[72782]: INFO nova.compute.manager [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Took 5.38 seconds to spawn the instance on the hypervisor.
Aug 14 20:21:17 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:21:17 user nova-compute[72782]: INFO nova.compute.manager [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Took 5.88 seconds to build instance.
Aug 14 20:21:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6c289c18-d643-455a-ba9f-eee529bf2255 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.975s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:21:17 user nova-compute[72782]: DEBUG nova.compute.manager [req-891d114a-ebe9-4237-947c-2a594aa04d9e req-e428ffd2-4749-4e08-a052-4fdeb960a5e7 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received event network-vif-plugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:21:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-891d114a-ebe9-4237-947c-2a594aa04d9e req-e428ffd2-4749-4e08-a052-4fdeb960a5e7 service nova] Acquiring lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:21:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-891d114a-ebe9-4237-947c-2a594aa04d9e req-e428ffd2-4749-4e08-a052-4fdeb960a5e7 service nova] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:21:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-891d114a-ebe9-4237-947c-2a594aa04d9e req-e428ffd2-4749-4e08-a052-4fdeb960a5e7 service nova] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:21:17 user nova-compute[72782]: DEBUG nova.compute.manager [req-891d114a-ebe9-4237-947c-2a594aa04d9e req-e428ffd2-4749-4e08-a052-4fdeb960a5e7 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] No waiting events found dispatching network-vif-plugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:21:17 user nova-compute[72782]: WARNING nova.compute.manager [req-891d114a-ebe9-4237-947c-2a594aa04d9e req-e428ffd2-4749-4e08-a052-4fdeb960a5e7 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received unexpected event network-vif-plugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 for instance with vm_state active and task_state None.
Aug 14 20:21:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:19 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:21:19 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:21:19 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:21:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-08afbc52-3c73-4d38-86a0-8dfd23757b83" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:21:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-08afbc52-3c73-4d38-86a0-8dfd23757b83" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:21:19 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:21:19 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 08afbc52-3c73-4d38-86a0-8dfd23757b83 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:21:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:19 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Updating instance_info_cache with network_info: [{"id": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "address": "fa:16:3e:92:6c:a7", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffae37d-d6", "ovs_interfaceid": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:21:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-08afbc52-3c73-4d38-86a0-8dfd23757b83" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:21:19 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:21:19 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:21:19 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:21:22 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:21:23 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:21:23 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:21:23 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:21:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:21:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquiring lock "08afbc52-3c73-4d38-86a0-8dfd23757b83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:21:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:21:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquiring lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:21:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:21:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:21:23 user nova-compute[72782]: INFO nova.compute.manager [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Terminating instance
Aug 14 20:21:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:21:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-8948106a-72fb-43e2-b8ec-06dd12f551a3 req-53fd4bfc-b3e7-46cd-9792-02f3cb69b840 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Received event network-vif-unplugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8948106a-72fb-43e2-b8ec-06dd12f551a3 req-53fd4bfc-b3e7-46cd-9792-02f3cb69b840 service nova] Acquiring lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8948106a-72fb-43e2-b8ec-06dd12f551a3 req-53fd4bfc-b3e7-46cd-9792-02f3cb69b840 service nova] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8948106a-72fb-43e2-b8ec-06dd12f551a3 req-53fd4bfc-b3e7-46cd-9792-02f3cb69b840 service nova] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-8948106a-72fb-43e2-b8ec-06dd12f551a3 req-53fd4bfc-b3e7-46cd-9792-02f3cb69b840 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] No waiting events found dispatching network-vif-unplugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-8948106a-72fb-43e2-b8ec-06dd12f551a3 req-53fd4bfc-b3e7-46cd-9792-02f3cb69b840 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Received event network-vif-unplugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:24 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Instance destroyed successfully.
Aug 14 20:21:24 user nova-compute[72782]: DEBUG nova.objects.instance [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lazy-loading 'resources' on Instance uuid 08afbc52-3c73-4d38-86a0-8dfd23757b83 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:19:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-30209042',display_name='tempest-VolumesActionsTest-instance-30209042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-30209042',id=40,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:19:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04f0a4b8575346f380ba1a31617004ea',ramdisk_id='',reservation_id='r-wvec1k03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-42673821',owner_user_name='tempest-VolumesActionsTest-42673821-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:19:39Z,user_data=None,user_id='0118609059f24257894c2ea98f193228',uuid=08afbc52-3c73-4d38-86a0-8dfd23757b83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "address": "fa:16:3e:92:6c:a7", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffae37d-d6", "ovs_interfaceid": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Converting VIF {"id": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "address": "fa:16:3e:92:6c:a7", "network": {"id": "b5704a85-ae42-4617-9b54-6905496ae839", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1626115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f0a4b8575346f380ba1a31617004ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ffae37d-d6", "ovs_interfaceid": "5ffae37d-d6ef-491a-993f-1d8aef43cbf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:6c:a7,bridge_name='br-int',has_traffic_filtering=True,id=5ffae37d-d6ef-491a-993f-1d8aef43cbf5,network=Network(b5704a85-ae42-4617-9b54-6905496ae839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ffae37d-d6') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG os_vif [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:6c:a7,bridge_name='br-int',has_traffic_filtering=True,id=5ffae37d-d6ef-491a-993f-1d8aef43cbf5,network=Network(b5704a85-ae42-4617-9b54-6905496ae839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ffae37d-d6') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ffae37d-d6, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:24 user nova-compute[72782]: INFO os_vif [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:6c:a7,bridge_name='br-int',has_traffic_filtering=True,id=5ffae37d-d6ef-491a-993f-1d8aef43cbf5,network=Network(b5704a85-ae42-4617-9b54-6905496ae839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ffae37d-d6')
Aug 14 20:21:24 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Deleting instance files /opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83_del
Aug 14 20:21:24 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Deletion of /opt/stack/data/nova/instances/08afbc52-3c73-4d38-86a0-8dfd23757b83_del complete
Aug 14 20:21:24 user nova-compute[72782]: INFO nova.compute.manager [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 14 20:21:24 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:21:24 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:21:25 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:21:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:21:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:21:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:21:25 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:21:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:21:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:21:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:21:25 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:21:25 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Took 0.86 seconds to deallocate network for instance.
Aug 14 20:21:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:21:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:21:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:21:25 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:21:25 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:21:25 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8702MB free_disk=25.446033477783203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:21:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Refreshing inventories for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Updating ProviderTree inventory for provider d26c9e3b-40e6-476e-9664-3119ebf5873b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Received event network-vif-plugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] Acquiring lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] No waiting events found dispatching network-vif-plugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:21:26 user nova-compute[72782]: WARNING nova.compute.manager [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Received unexpected event network-vif-plugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 for instance with vm_state deleted and task_state None.
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Received event network-vif-plugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] Acquiring lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] No waiting events found dispatching network-vif-plugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:21:26 user nova-compute[72782]: WARNING nova.compute.manager [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Received unexpected event network-vif-plugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 for instance with vm_state deleted and task_state None.
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Received event network-vif-plugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] Acquiring lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] No waiting events found dispatching network-vif-plugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:21:26 user nova-compute[72782]: WARNING nova.compute.manager [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Received unexpected event network-vif-plugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 for instance with vm_state deleted and task_state None.
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Received event network-vif-plugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] Acquiring lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] No waiting events found dispatching network-vif-plugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:21:26 user nova-compute[72782]: WARNING nova.compute.manager [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Received unexpected event network-vif-plugged-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 for instance with vm_state deleted and task_state None.
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.compute.manager [req-49859764-d79e-4bd0-9628-8ac0d91f5acc req-7a405bb1-434a-4f6f-a985-2a39e646c9a1 service nova] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Received event network-vif-deleted-5ffae37d-d6ef-491a-993f-1d8aef43cbf5 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Refreshing aggregate associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, aggregates: None {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Refreshing trait associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.325s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:21:26 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Deleted allocations for instance 08afbc52-3c73-4d38-86a0-8dfd23757b83
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance b4c69b22-f628-40c1-ab95-983d6005b10c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a3915d4d-88c2-404a-b35f-8afcead2b6b9 tempest-VolumesActionsTest-42673821 tempest-VolumesActionsTest-42673821-project-member] Lock "08afbc52-3c73-4d38-86a0-8dfd23757b83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.645s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:21:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:21:28 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:21:28 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:21:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:30 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:21:30 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 20:21:30 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] There are 0 instances to clean {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 20:21:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:39 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692044484.543749, 08afbc52-3c73-4d38-86a0-8dfd23757b83 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:21:39 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] VM Stopped (Lifecycle Event)
Aug 14 20:21:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cf85bbc2-7fad-4ae3-9a39-d1b3b2348a34 None None] [instance: 08afbc52-3c73-4d38-86a0-8dfd23757b83] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:21:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:41 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:21:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72782) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 20:21:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:49 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:21:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid b4c69b22-f628-40c1-ab95-983d6005b10c {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 20:21:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "b4c69b22-f628-40c1-ab95-983d6005b10c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:21:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:21:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:21:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:21:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:21:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:21:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:21:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:21:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:21:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:21:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:21:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:21:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:21:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:22:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:22:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:22:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:22:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:22:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:22:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:22:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:22:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:22:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:22:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:22:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:22:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:22:12 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:22:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:22:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:22:20 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:22:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:22:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:22:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:22:20 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:22:20 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Updating instance_info_cache with network_info: [{"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:22:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:22:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:22:20 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:22:20 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:22:23 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:22:24 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:22:24 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:22:24 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:22:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:22:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:22:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:22:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:22:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:22:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:22:27 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:22:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:22:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:22:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:22:27 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:22:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:22:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:22:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:22:27 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:22:27 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:22:27 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:22:27 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8691MB free_disk=25.40750503540039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:22:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:22:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:22:28 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance b4c69b22-f628-40c1-ab95-983d6005b10c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:22:28 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:22:28 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:22:28 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:22:28 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:22:28 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:22:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:22:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:22:30 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:22:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:22:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:22:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:22:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:22:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:22:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:22:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:22:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:22:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:22:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:22:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-25320faa-2353-4fdd-b3de-f0a3fa1dff56 req-61288ea2-6b35-43ab-92a0-015dae2e9453 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received event network-changed-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:23:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-25320faa-2353-4fdd-b3de-f0a3fa1dff56 req-61288ea2-6b35-43ab-92a0-015dae2e9453 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Refreshing instance network info cache due to event network-changed-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:23:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-25320faa-2353-4fdd-b3de-f0a3fa1dff56 req-61288ea2-6b35-43ab-92a0-015dae2e9453 service nova] Acquiring lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:23:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-25320faa-2353-4fdd-b3de-f0a3fa1dff56 req-61288ea2-6b35-43ab-92a0-015dae2e9453 service nova] Acquired lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:23:03 user nova-compute[72782]: DEBUG nova.network.neutron [req-25320faa-2353-4fdd-b3de-f0a3fa1dff56 req-61288ea2-6b35-43ab-92a0-015dae2e9453 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Refreshing network info cache for port fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:23:04 user nova-compute[72782]: DEBUG nova.network.neutron [req-25320faa-2353-4fdd-b3de-f0a3fa1dff56 req-61288ea2-6b35-43ab-92a0-015dae2e9453 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Updated VIF entry in instance network info cache for port fe0631cb-7cfd-40ba-ae3f-e924307c0ab0. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:23:04 user nova-compute[72782]: DEBUG nova.network.neutron [req-25320faa-2353-4fdd-b3de-f0a3fa1dff56 req-61288ea2-6b35-43ab-92a0-015dae2e9453 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Updating instance_info_cache with network_info: [{"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:23:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-25320faa-2353-4fdd-b3de-f0a3fa1dff56 req-61288ea2-6b35-43ab-92a0-015dae2e9453 service nova] Releasing lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:23:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "1229d145-40ad-487c-8141-60b9cdefc4ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:23:09 user nova-compute[72782]: INFO nova.compute.claims [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Claim successful on node user
Aug 14 20:23:09 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.208s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG nova.network.neutron [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:23:09 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:23:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG nova.policy [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4eedf2578e64fdd8f1a761e5ba1c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc168d9c3794a2e8c7934151ecc3d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:23:09 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Creating image(s)
Aug 14 20:23:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "/opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "/opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "/opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "1935faec8c79bbe8ab47c54066dab112a958bf3c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "1935faec8c79bbe8ab47c54066dab112a958bf3c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "b4c69b22-f628-40c1-ab95-983d6005b10c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:23:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:23:09 user nova-compute[72782]: INFO nova.compute.manager [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Shelving
Aug 14 20:23:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c.part --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:23:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-ca4e110b-1812-42d0-8352-9b4618889cf8 req-0fb0e42d-58f5-400d-b14c-244103be2a77 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received event network-vif-unplugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:23:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ca4e110b-1812-42d0-8352-9b4618889cf8 req-0fb0e42d-58f5-400d-b14c-244103be2a77 service nova] Acquiring lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:23:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ca4e110b-1812-42d0-8352-9b4618889cf8 req-0fb0e42d-58f5-400d-b14c-244103be2a77 service nova] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:23:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ca4e110b-1812-42d0-8352-9b4618889cf8 req-0fb0e42d-58f5-400d-b14c-244103be2a77 service nova] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:23:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-ca4e110b-1812-42d0-8352-9b4618889cf8 req-0fb0e42d-58f5-400d-b14c-244103be2a77 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] No waiting events found dispatching network-vif-unplugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:23:10 user nova-compute[72782]: WARNING nova.compute.manager [req-ca4e110b-1812-42d0-8352-9b4618889cf8 req-0fb0e42d-58f5-400d-b14c-244103be2a77 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received unexpected event network-vif-unplugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 for instance with vm_state active and task_state shelving.
Aug 14 20:23:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:23:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c.part --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:23:10 user nova-compute[72782]: DEBUG nova.virt.images [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] f4dfda46-204c-4e40-b331-bbffdb05f66b was qcow2, converting to raw {{(pid=72782) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 20:23:10 user nova-compute[72782]: DEBUG nova.privsep.utils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72782) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 20:23:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c.part /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c.converted {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:23:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:10 user nova-compute[72782]: DEBUG nova.network.neutron [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Successfully created port: f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:23:10 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Instance destroyed successfully.
Aug 14 20:23:10 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Beginning cold snapshot process
Aug 14 20:23:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c.part /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c.converted" returned: 0 in 0.619s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:23:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c.converted --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG nova.privsep.utils [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72782) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk /opt/stack/data/nova/instances/snapshots/tmpq57e7w_c/1d8630500e8e4ca8bffb902b103f78f0 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "1935faec8c79bbe8ab47c54066dab112a958bf3c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.528s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "1935faec8c79bbe8ab47c54066dab112a958bf3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "1935faec8c79bbe8ab47c54066dab112a958bf3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c --force-share --output=json" returned: 0 in 0.222s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c,backing_fmt=raw /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c,backing_fmt=raw /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk 1073741824" returned: 0 in 0.143s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG nova.network.neutron [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Successfully updated port: f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "1935faec8c79bbe8ab47c54066dab112a958bf3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.382s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquired lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG nova.network.neutron [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG nova.network.neutron [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 20:23:11 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk /opt/stack/data/nova/instances/snapshots/tmpq57e7w_c/1d8630500e8e4ca8bffb902b103f78f0" returned: 0 in 0.919s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:23:12 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Snapshot extracted, beginning image upload
Aug 14 20:23:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Cannot resize image /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.objects.instance [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lazy-loading 'migration_context' on Instance uuid 1229d145-40ad-487c-8141-60b9cdefc4ab {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Ensure instance console log exists: /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.network.neutron [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updating instance_info_cache with network_info: [{"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Releasing lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Instance network_info: |[{"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Start _get_guest_xml network_info=[{"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T20:23:06Z,direct_url=<?>,disk_format='qcow2',id=f4dfda46-204c-4e40-b331-bbffdb05f66b,min_disk=0,min_ram=0,name='tempest-scenario-img--1511338851',owner='9fc168d9c3794a2e8c7934151ecc3d2e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T20:23:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': 'f4dfda46-204c-4e40-b331-bbffdb05f66b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:23:12 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:23:12 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T20:23:06Z,direct_url=<?>,disk_format='qcow2',id=f4dfda46-204c-4e40-b331-bbffdb05f66b,min_disk=0,min_ram=0,name='tempest-scenario-img--1511338851',owner='9fc168d9c3794a2e8c7934151ecc3d2e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T20:23:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1878285010',display_name='tempest-TestMinimumBasicScenario-server-1878285010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1878285010',id=42,image_ref='f4dfda46-204c-4e40-b331-bbffdb05f66b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpCAqehdG5k+XsMcQDlaCnyAACwBFUQbys9aS48u9Mcp87Yj7TN/RfnjxlfddFCCwoX2OhkTUj7fGV0qraPeDv1jGHMzhy/NpSkETZiu3jdA4hu1+CPxqzk0W/m1z3aWw==',key_name='tempest-TestMinimumBasicScenario-1506570524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fc168d9c3794a2e8c7934151ecc3d2e',ramdisk_id='',reservation_id='r-4mch9rs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f4dfda46-204c-4e40-b331-bbffdb05f66b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-77953630',owner_user_name='tempest-TestMinimumBasicScenario-77953630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:23:10Z,user_data=None,user_id='f4eedf2578e64fdd8f1a761e5ba1c626',uuid=1229d145-40ad-487c-8141-60b9cdefc4ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Converting VIF {"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:64:54,bridge_name='br-int',has_traffic_filtering=True,id=f52a6d15-15d8-4276-a6d8-343ec4b547d8,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52a6d15-15') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.objects.instance [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lazy-loading 'pci_devices' on Instance uuid 1229d145-40ad-487c-8141-60b9cdefc4ab {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-6a06ae56-93a3-4179-94ef-d43eeccb0724 req-a63cbbde-8cbc-4db0-a73e-3fb43de067dd service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received event network-vif-plugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6a06ae56-93a3-4179-94ef-d43eeccb0724 req-a63cbbde-8cbc-4db0-a73e-3fb43de067dd service nova] Acquiring lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6a06ae56-93a3-4179-94ef-d43eeccb0724 req-a63cbbde-8cbc-4db0-a73e-3fb43de067dd service nova] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6a06ae56-93a3-4179-94ef-d43eeccb0724 req-a63cbbde-8cbc-4db0-a73e-3fb43de067dd service nova] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-6a06ae56-93a3-4179-94ef-d43eeccb0724 req-a63cbbde-8cbc-4db0-a73e-3fb43de067dd service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] No waiting events found dispatching network-vif-plugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:23:12 user nova-compute[72782]: WARNING nova.compute.manager [req-6a06ae56-93a3-4179-94ef-d43eeccb0724 req-a63cbbde-8cbc-4db0-a73e-3fb43de067dd service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received unexpected event network-vif-plugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 for instance with vm_state active and task_state shelving_image_uploading.
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-6a06ae56-93a3-4179-94ef-d43eeccb0724 req-a63cbbde-8cbc-4db0-a73e-3fb43de067dd service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received event network-changed-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-6a06ae56-93a3-4179-94ef-d43eeccb0724 req-a63cbbde-8cbc-4db0-a73e-3fb43de067dd service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Refreshing instance network info cache due to event network-changed-f52a6d15-15d8-4276-a6d8-343ec4b547d8. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6a06ae56-93a3-4179-94ef-d43eeccb0724 req-a63cbbde-8cbc-4db0-a73e-3fb43de067dd service nova] Acquiring lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6a06ae56-93a3-4179-94ef-d43eeccb0724 req-a63cbbde-8cbc-4db0-a73e-3fb43de067dd service nova] Acquired lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.network.neutron [req-6a06ae56-93a3-4179-94ef-d43eeccb0724 req-a63cbbde-8cbc-4db0-a73e-3fb43de067dd service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Refreshing network info cache for port f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:23:12 user nova-compute[72782]:   <uuid>1229d145-40ad-487c-8141-60b9cdefc4ab</uuid>
Aug 14 20:23:12 user nova-compute[72782]:   <name>instance-0000002a</name>
Aug 14 20:23:12 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:23:12 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:23:12 user nova-compute[72782]:   <metadata>
Aug 14 20:23:12 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:23:12 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:23:12 user nova-compute[72782]:       <nova:name>tempest-TestMinimumBasicScenario-server-1878285010</nova:name>
Aug 14 20:23:12 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:23:12</nova:creationTime>
Aug 14 20:23:12 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:23:12 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:23:12 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:23:12 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:23:12 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:23:12 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:23:12 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:23:12 user nova-compute[72782]:       <nova:owner>
Aug 14 20:23:12 user nova-compute[72782]:         <nova:user uuid="f4eedf2578e64fdd8f1a761e5ba1c626">tempest-TestMinimumBasicScenario-77953630-project-member</nova:user>
Aug 14 20:23:12 user nova-compute[72782]:         <nova:project uuid="9fc168d9c3794a2e8c7934151ecc3d2e">tempest-TestMinimumBasicScenario-77953630</nova:project>
Aug 14 20:23:12 user nova-compute[72782]:       </nova:owner>
Aug 14 20:23:12 user nova-compute[72782]:       <nova:root type="image" uuid="f4dfda46-204c-4e40-b331-bbffdb05f66b"/>
Aug 14 20:23:12 user nova-compute[72782]:       <nova:ports>
Aug 14 20:23:12 user nova-compute[72782]:         <nova:port uuid="f52a6d15-15d8-4276-a6d8-343ec4b547d8">
Aug 14 20:23:12 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 20:23:12 user nova-compute[72782]:         </nova:port>
Aug 14 20:23:12 user nova-compute[72782]:       </nova:ports>
Aug 14 20:23:12 user nova-compute[72782]:     </nova:instance>
Aug 14 20:23:12 user nova-compute[72782]:   </metadata>
Aug 14 20:23:12 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:23:12 user nova-compute[72782]:     <system>
Aug 14 20:23:12 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:23:12 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:23:12 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:23:12 user nova-compute[72782]:       <entry name="serial">1229d145-40ad-487c-8141-60b9cdefc4ab</entry>
Aug 14 20:23:12 user nova-compute[72782]:       <entry name="uuid">1229d145-40ad-487c-8141-60b9cdefc4ab</entry>
Aug 14 20:23:12 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:23:12 user nova-compute[72782]:     </system>
Aug 14 20:23:12 user nova-compute[72782]:   </sysinfo>
Aug 14 20:23:12 user nova-compute[72782]:   <os>
Aug 14 20:23:12 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:23:12 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:23:12 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:23:12 user nova-compute[72782]:   </os>
Aug 14 20:23:12 user nova-compute[72782]:   <features>
Aug 14 20:23:12 user nova-compute[72782]:     <acpi/>
Aug 14 20:23:12 user nova-compute[72782]:     <apic/>
Aug 14 20:23:12 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:23:12 user nova-compute[72782]:   </features>
Aug 14 20:23:12 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:23:12 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:23:12 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:23:12 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:23:12 user nova-compute[72782]:   </clock>
Aug 14 20:23:12 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:23:12 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:23:12 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:23:12 user nova-compute[72782]:   </cpu>
Aug 14 20:23:12 user nova-compute[72782]:   <devices>
Aug 14 20:23:12 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:23:12 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:23:12 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk"/>
Aug 14 20:23:12 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:23:12 user nova-compute[72782]:     </disk>
Aug 14 20:23:12 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:23:12 user nova-compute[72782]:       <mac address="fa:16:3e:2c:64:54"/>
Aug 14 20:23:12 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:23:12 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:23:12 user nova-compute[72782]:       <target dev="tapf52a6d15-15"/>
Aug 14 20:23:12 user nova-compute[72782]:     </interface>
Aug 14 20:23:12 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:23:12 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/console.log" append="off"/>
Aug 14 20:23:12 user nova-compute[72782]:     </serial>
Aug 14 20:23:12 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:23:12 user nova-compute[72782]:     <video>
Aug 14 20:23:12 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:23:12 user nova-compute[72782]:     </video>
Aug 14 20:23:12 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:23:12 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:23:12 user nova-compute[72782]:     </rng>
Aug 14 20:23:12 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:23:12 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:23:12 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:23:12 user nova-compute[72782]:     </memballoon>
Aug 14 20:23:12 user nova-compute[72782]:   </devices>
Aug 14 20:23:12 user nova-compute[72782]: </domain>
Aug 14 20:23:12 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1878285010',display_name='tempest-TestMinimumBasicScenario-server-1878285010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1878285010',id=42,image_ref='f4dfda46-204c-4e40-b331-bbffdb05f66b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpCAqehdG5k+XsMcQDlaCnyAACwBFUQbys9aS48u9Mcp87Yj7TN/RfnjxlfddFCCwoX2OhkTUj7fGV0qraPeDv1jGHMzhy/NpSkETZiu3jdA4hu1+CPxqzk0W/m1z3aWw==',key_name='tempest-TestMinimumBasicScenario-1506570524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fc168d9c3794a2e8c7934151ecc3d2e',ramdisk_id='',reservation_id='r-4mch9rs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f4dfda46-204c-4e40-b331-bbffdb05f66b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-77953630',owner_user_name='tempest-TestMinimumBasicScenario-77953630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:23:10Z,user_data=None,user_id='f4eedf2578e64fdd8f1a761e5ba1c626',uuid=1229d145-40ad-487c-8141-60b9cdefc4ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Converting VIF {"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:64:54,bridge_name='br-int',has_traffic_filtering=True,id=f52a6d15-15d8-4276-a6d8-343ec4b547d8,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52a6d15-15') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG os_vif [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:64:54,bridge_name='br-int',has_traffic_filtering=True,id=f52a6d15-15d8-4276-a6d8-343ec4b547d8,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52a6d15-15') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf52a6d15-15, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf52a6d15-15, col_values=(('external_ids', {'iface-id': 'f52a6d15-15d8-4276-a6d8-343ec4b547d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:64:54', 'vm-uuid': '1229d145-40ad-487c-8141-60b9cdefc4ab'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:12 user nova-compute[72782]: INFO os_vif [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:64:54,bridge_name='br-int',has_traffic_filtering=True,id=f52a6d15-15d8-4276-a6d8-343ec4b547d8,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52a6d15-15')
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] No VIF found with MAC fa:16:3e:2c:64:54, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.network.neutron [req-6a06ae56-93a3-4179-94ef-d43eeccb0724 req-a63cbbde-8cbc-4db0-a73e-3fb43de067dd service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updated VIF entry in instance network info cache for port f52a6d15-15d8-4276-a6d8-343ec4b547d8. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG nova.network.neutron [req-6a06ae56-93a3-4179-94ef-d43eeccb0724 req-a63cbbde-8cbc-4db0-a73e-3fb43de067dd service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updating instance_info_cache with network_info: [{"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:23:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6a06ae56-93a3-4179-94ef-d43eeccb0724 req-a63cbbde-8cbc-4db0-a73e-3fb43de067dd service nova] Releasing lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:23:13 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:23:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-50a158df-0081-453f-920d-ecd3cc0dc168 req-28d82703-71c9-46ad-976e-10e5f8a53c30 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received event network-vif-plugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:23:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-50a158df-0081-453f-920d-ecd3cc0dc168 req-28d82703-71c9-46ad-976e-10e5f8a53c30 service nova] Acquiring lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:23:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-50a158df-0081-453f-920d-ecd3cc0dc168 req-28d82703-71c9-46ad-976e-10e5f8a53c30 service nova] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:23:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-50a158df-0081-453f-920d-ecd3cc0dc168 req-28d82703-71c9-46ad-976e-10e5f8a53c30 service nova] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:23:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-50a158df-0081-453f-920d-ecd3cc0dc168 req-28d82703-71c9-46ad-976e-10e5f8a53c30 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] No waiting events found dispatching network-vif-plugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:23:14 user nova-compute[72782]: WARNING nova.compute.manager [req-50a158df-0081-453f-920d-ecd3cc0dc168 req-28d82703-71c9-46ad-976e-10e5f8a53c30 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received unexpected event network-vif-plugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 for instance with vm_state building and task_state spawning.
Aug 14 20:23:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-50a158df-0081-453f-920d-ecd3cc0dc168 req-28d82703-71c9-46ad-976e-10e5f8a53c30 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received event network-vif-plugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:23:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-50a158df-0081-453f-920d-ecd3cc0dc168 req-28d82703-71c9-46ad-976e-10e5f8a53c30 service nova] Acquiring lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:23:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-50a158df-0081-453f-920d-ecd3cc0dc168 req-28d82703-71c9-46ad-976e-10e5f8a53c30 service nova] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:23:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-50a158df-0081-453f-920d-ecd3cc0dc168 req-28d82703-71c9-46ad-976e-10e5f8a53c30 service nova] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:23:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-50a158df-0081-453f-920d-ecd3cc0dc168 req-28d82703-71c9-46ad-976e-10e5f8a53c30 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] No waiting events found dispatching network-vif-plugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:23:14 user nova-compute[72782]: WARNING nova.compute.manager [req-50a158df-0081-453f-920d-ecd3cc0dc168 req-28d82703-71c9-46ad-976e-10e5f8a53c30 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received unexpected event network-vif-plugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 for instance with vm_state building and task_state spawning.
Aug 14 20:23:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:14 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Snapshot image upload complete
Aug 14 20:23:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:23:14 user nova-compute[72782]: INFO nova.compute.manager [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Shelve offloading
Aug 14 20:23:14 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Instance destroyed successfully.
Aug 14 20:23:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:23:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:23:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquired lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:23:14 user nova-compute[72782]: DEBUG nova.network.neutron [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:23:15 user nova-compute[72782]: DEBUG nova.network.neutron [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Updating instance_info_cache with network_info: [{"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:23:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Releasing lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:23:15 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Instance destroyed successfully.
Aug 14 20:23:15 user nova-compute[72782]: DEBUG nova.objects.instance [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'resources' on Instance uuid b4c69b22-f628-40c1-ab95-983d6005b10c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:23:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1261581948',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1261581948',id=41,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUcZm/ixOHXdKaRFGd0Vcj7OPXNUUPuROJ2bl7c+YwYJt2z+sgaboFOA+89jQPGz9pfpXJCdE0Hdl8dwOwfF5lOzsOO7GOn/zukXSHkUntg5Pn/2ZAGAV3Hl6u8h29jwA==',key_name='tempest-keypair-222436759',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:21:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d8754bbf7f9945fba2bd1ad571f556f6',ramdisk_id='',reservation_id='r-t0ee9af6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-220778544',owner_user_name='tempest-AttachVolumeShelveTestJSON-220778544-project-member',shelved_at='2023-08-14T20:23:14.533438',shelved_host='user',shelved_image_id='ead227c5-f3c4-4b99-a452-3db58dfb1c74'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3090a5cb6ba34a7fb007d98a351c8313',uuid=b4c69b22-f628-40c1-ab95-983d6005b10c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:23:15 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converting VIF {"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:23:15 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:8e:23,bridge_name='br-int',has_traffic_filtering=True,id=fe0631cb-7cfd-40ba-ae3f-e924307c0ab0,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0631cb-7c') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:23:15 user nova-compute[72782]: DEBUG os_vif [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:8e:23,bridge_name='br-int',has_traffic_filtering=True,id=fe0631cb-7cfd-40ba-ae3f-e924307c0ab0,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0631cb-7c') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:23:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe0631cb-7c, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:23:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:23:15 user nova-compute[72782]: INFO os_vif [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:8e:23,bridge_name='br-int',has_traffic_filtering=True,id=fe0631cb-7cfd-40ba-ae3f-e924307c0ab0,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0631cb-7c')
Aug 14 20:23:15 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Deleting instance files /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c_del
Aug 14 20:23:15 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Deletion of /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c_del complete
Aug 14 20:23:15 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Deleted allocations for instance b4c69b22-f628-40c1-ab95-983d6005b10c
Aug 14 20:23:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:23:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:23:15 user nova-compute[72782]: DEBUG nova.objects.instance [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'numa_topology' on Instance uuid b4c69b22-f628-40c1-ab95-983d6005b10c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:23:15 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:23:15 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:23:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:23:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d226e6c0-3e3e-4718-965b-4641532b1aa2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.336s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:23:16 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044596.0171275, 1229d145-40ad-487c-8141-60b9cdefc4ab => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:23:16 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] VM Resumed (Lifecycle Event)
Aug 14 20:23:16 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:23:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:23:16 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Instance spawned successfully.
Aug 14 20:23:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:23:16 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:23:16 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:23:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:23:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:23:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:23:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:23:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:23:16 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:23:16 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:23:16 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044596.018154, 1229d145-40ad-487c-8141-60b9cdefc4ab => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:23:16 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] VM Started (Lifecycle Event)
Aug 14 20:23:16 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:23:16 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:23:16 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:23:16 user nova-compute[72782]: INFO nova.compute.manager [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Took 6.54 seconds to spawn the instance on the hypervisor.
Aug 14 20:23:16 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:23:16 user nova-compute[72782]: INFO nova.compute.manager [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Took 7.06 seconds to build instance.
Aug 14 20:23:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6ca51ccd-ec9c-4d75-8974-763819ca69da tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.149s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:23:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:21 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:23:22 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:23:22 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:23:22 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:23:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:23:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:23:22 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:23:22 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 1229d145-40ad-487c-8141-60b9cdefc4ab {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:23:22 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updating instance_info_cache with network_info: [{"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:23:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:23:22 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:23:22 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:23:23 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:23:24 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:23:25 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:23:25 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:23:25 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:23:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:25 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692044590.635375, b4c69b22-f628-40c1-ab95-983d6005b10c => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:23:25 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] VM Stopped (Lifecycle Event)
Aug 14 20:23:25 user nova-compute[72782]: DEBUG nova.compute.manager [None req-2bf13f3e-beb8-4d05-a587-8d1e566b17cc None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:23:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:29 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:23:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:23:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:23:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:23:29 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:23:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:23:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:23:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:23:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:23:29 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:23:29 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:23:29 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8654MB free_disk=25.324501037597656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:23:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:23:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:23:29 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 1229d145-40ad-487c-8141-60b9cdefc4ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:23:29 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:23:29 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:23:30 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:23:30 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:23:30 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:23:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:23:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:31 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:23:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:23:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:24:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:24:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:24:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:24:15 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:24:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:24:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:24:22 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:24:23 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:24:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:24:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:24:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:24:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:24:23 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:24:23 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 1229d145-40ad-487c-8141-60b9cdefc4ab {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:24:24 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updating instance_info_cache with network_info: [{"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:24:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:24:24 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:24:24 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:24:24 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:24:25 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:24:25 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:24:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:24:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:24:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:24:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:24:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:24:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:24:27 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:24:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:24:31 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:24:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:24:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:24:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:24:31 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:24:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:24:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:24:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:24:31 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:24:31 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:24:31 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:24:31 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8714MB free_disk=25.296112060546875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:24:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:24:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:24:32 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 1229d145-40ad-487c-8141-60b9cdefc4ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:24:32 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:24:32 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:24:32 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:24:32 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:24:32 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:24:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:24:33 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:24:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:24:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:24:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:24:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:24:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:25:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "b4c69b22-f628-40c1-ab95-983d6005b10c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:25:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:25:02 user nova-compute[72782]: INFO nova.compute.manager [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Unshelving
Aug 14 20:25:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:25:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:25:02 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'pci_requests' on Instance uuid b4c69b22-f628-40c1-ab95-983d6005b10c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:25:02 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'numa_topology' on Instance uuid b4c69b22-f628-40c1-ab95-983d6005b10c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:25:02 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:25:02 user nova-compute[72782]: INFO nova.compute.claims [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Claim successful on node user
Aug 14 20:25:02 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:25:02 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:25:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:25:02 user nova-compute[72782]: INFO nova.network.neutron [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Updating port fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "1229d145-40ad-487c-8141-60b9cdefc4ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG nova.objects.instance [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lazy-loading 'flavor' on Instance uuid 1229d145-40ad-487c-8141-60b9cdefc4ab {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "1229d145-40ad-487c-8141-60b9cdefc4ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:25:03 user nova-compute[72782]: INFO nova.compute.manager [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Attaching volume aa026731-5e12-4c31-8e64-fb2a5cdcada3 to /dev/vdb
Aug 14 20:25:03 user nova-compute[72782]: DEBUG os_brick.utils [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquired lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d734da74-2839-45b2-8a99-d06e6faedcc2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-0f3e308f-8238-40b8-9322-c059bf3b50da req-52172ae9-7731-458e-8352-11f91fcd4d7a service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received event network-changed-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-0f3e308f-8238-40b8-9322-c059bf3b50da req-52172ae9-7731-458e-8352-11f91fcd4d7a service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Refreshing instance network info cache due to event network-changed-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0f3e308f-8238-40b8-9322-c059bf3b50da req-52172ae9-7731-458e-8352-11f91fcd4d7a service nova] Acquiring lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ade57e1-7e81-4cb2-b878-c6752076e415]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a35a39-b4cb-40be-8d0c-abe3e67e197d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcecdff-92f1-43c1-bfc2-3c9c72d29b7c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:25:03 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:25:03 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ffc825-d6ed-4770-8fd9-b639ddce51d0]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG os_brick.utils [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:25:03 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updating existing volume attachment record: c1c6897c-032c-435d-b928-6d77958952d4 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:25:04 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Updating instance_info_cache with network_info: [{"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:25:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Releasing lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:25:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:25:04 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Creating image(s)
Aug 14 20:25:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:25:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "/opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:25:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "/opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:25:04 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'trusted_certs' on Instance uuid b4c69b22-f628-40c1-ab95-983d6005b10c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:25:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0f3e308f-8238-40b8-9322-c059bf3b50da req-52172ae9-7731-458e-8352-11f91fcd4d7a service nova] Acquired lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:25:04 user nova-compute[72782]: DEBUG nova.network.neutron [req-0f3e308f-8238-40b8-9322-c059bf3b50da req-52172ae9-7731-458e-8352-11f91fcd4d7a service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Refreshing network info cache for port fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:25:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "82cd5b17a612011434277ceb66e2e257753aca6c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:25:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "82cd5b17a612011434277ceb66e2e257753aca6c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:25:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c.part --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c.part --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:05 user nova-compute[72782]: DEBUG nova.virt.images [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] ead227c5-f3c4-4b99-a452-3db58dfb1c74 was qcow2, converting to raw {{(pid=72782) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 20:25:05 user nova-compute[72782]: DEBUG nova.privsep.utils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72782) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 20:25:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c.part /opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c.converted {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:05 user nova-compute[72782]: DEBUG nova.network.neutron [req-0f3e308f-8238-40b8-9322-c059bf3b50da req-52172ae9-7731-458e-8352-11f91fcd4d7a service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Updated VIF entry in instance network info cache for port fe0631cb-7cfd-40ba-ae3f-e924307c0ab0. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:25:05 user nova-compute[72782]: DEBUG nova.network.neutron [req-0f3e308f-8238-40b8-9322-c059bf3b50da req-52172ae9-7731-458e-8352-11f91fcd4d7a service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Updating instance_info_cache with network_info: [{"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:25:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0f3e308f-8238-40b8-9322-c059bf3b50da req-52172ae9-7731-458e-8352-11f91fcd4d7a service nova] Releasing lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:25:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c.part /opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c.converted" returned: 0 in 0.529s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c.converted --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "82cd5b17a612011434277ceb66e2e257753aca6c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.193s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:25:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c --force-share --output=json" returned: 0 in 0.212s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "82cd5b17a612011434277ceb66e2e257753aca6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:25:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "82cd5b17a612011434277ceb66e2e257753aca6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:25:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c --force-share --output=json" returned: 0 in 0.191s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c,backing_fmt=raw /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c,backing_fmt=raw /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk 1073741824" returned: 0 in 0.051s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "82cd5b17a612011434277ceb66e2e257753aca6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:25:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:07 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'migration_context' on Instance uuid b4c69b22-f628-40c1-ab95-983d6005b10c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:25:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Rebasing disk image.
Aug 14 20:25:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 -F raw /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 -F raw /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk" returned: 0 in 2.168s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Ensure instance console log exists: /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Start _get_guest_xml network_info=[{"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='6adf915124d2729e0974c378217b25b8',container_format='bare',created_at=2023-08-14T20:23:10Z,direct_url=<?>,disk_format='qcow2',id=ead227c5-f3c4-4b99-a452-3db58dfb1c74,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1261581948-shelved',owner='d8754bbf7f9945fba2bd1ad571f556f6',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-14T20:23:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:25:09 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:25:09 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6adf915124d2729e0974c378217b25b8',container_format='bare',created_at=2023-08-14T20:23:10Z,direct_url=<?>,disk_format='qcow2',id=ead227c5-f3c4-4b99-a452-3db58dfb1c74,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1261581948-shelved',owner='d8754bbf7f9945fba2bd1ad571f556f6',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-14T20:23:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'vcpu_model' on Instance uuid b4c69b22-f628-40c1-ab95-983d6005b10c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T20:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1261581948',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1261581948',id=41,image_ref='ead227c5-f3c4-4b99-a452-3db58dfb1c74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-222436759',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:21:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d8754bbf7f9945fba2bd1ad571f556f6',ramdisk_id='',reservation_id='r-t0ee9af6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-220778544',owner_user_name='tempest-AttachVolumeShelveTestJSON-220778544-project-member',shelved_at='2023-08-14T20:23:14.533438',shelved_host='user',shelved_image_id='ead227c5-f3c4-4b99-a452-3db58dfb1c74'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:25:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3090a5cb6ba34a7fb007d98a351c8313',uuid=b4c69b22-f628-40c1-ab95-983d6005b10c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converting VIF {"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:8e:23,bridge_name='br-int',has_traffic_filtering=True,id=fe0631cb-7cfd-40ba-ae3f-e924307c0ab0,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0631cb-7c') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'pci_devices' on Instance uuid b4c69b22-f628-40c1-ab95-983d6005b10c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:25:09 user nova-compute[72782]:   <uuid>b4c69b22-f628-40c1-ab95-983d6005b10c</uuid>
Aug 14 20:25:09 user nova-compute[72782]:   <name>instance-00000029</name>
Aug 14 20:25:09 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:25:09 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:25:09 user nova-compute[72782]:   <metadata>
Aug 14 20:25:09 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:25:09 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:25:09 user nova-compute[72782]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1261581948</nova:name>
Aug 14 20:25:09 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:25:09</nova:creationTime>
Aug 14 20:25:09 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:25:09 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:25:09 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:25:09 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:25:09 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:25:09 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:25:09 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:25:09 user nova-compute[72782]:       <nova:owner>
Aug 14 20:25:09 user nova-compute[72782]:         <nova:user uuid="3090a5cb6ba34a7fb007d98a351c8313">tempest-AttachVolumeShelveTestJSON-220778544-project-member</nova:user>
Aug 14 20:25:09 user nova-compute[72782]:         <nova:project uuid="d8754bbf7f9945fba2bd1ad571f556f6">tempest-AttachVolumeShelveTestJSON-220778544</nova:project>
Aug 14 20:25:09 user nova-compute[72782]:       </nova:owner>
Aug 14 20:25:09 user nova-compute[72782]:       <nova:root type="image" uuid="ead227c5-f3c4-4b99-a452-3db58dfb1c74"/>
Aug 14 20:25:09 user nova-compute[72782]:       <nova:ports>
Aug 14 20:25:09 user nova-compute[72782]:         <nova:port uuid="fe0631cb-7cfd-40ba-ae3f-e924307c0ab0">
Aug 14 20:25:09 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 20:25:09 user nova-compute[72782]:         </nova:port>
Aug 14 20:25:09 user nova-compute[72782]:       </nova:ports>
Aug 14 20:25:09 user nova-compute[72782]:     </nova:instance>
Aug 14 20:25:09 user nova-compute[72782]:   </metadata>
Aug 14 20:25:09 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:25:09 user nova-compute[72782]:     <system>
Aug 14 20:25:09 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:25:09 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:25:09 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:25:09 user nova-compute[72782]:       <entry name="serial">b4c69b22-f628-40c1-ab95-983d6005b10c</entry>
Aug 14 20:25:09 user nova-compute[72782]:       <entry name="uuid">b4c69b22-f628-40c1-ab95-983d6005b10c</entry>
Aug 14 20:25:09 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:25:09 user nova-compute[72782]:     </system>
Aug 14 20:25:09 user nova-compute[72782]:   </sysinfo>
Aug 14 20:25:09 user nova-compute[72782]:   <os>
Aug 14 20:25:09 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:25:09 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:25:09 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:25:09 user nova-compute[72782]:   </os>
Aug 14 20:25:09 user nova-compute[72782]:   <features>
Aug 14 20:25:09 user nova-compute[72782]:     <acpi/>
Aug 14 20:25:09 user nova-compute[72782]:     <apic/>
Aug 14 20:25:09 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:25:09 user nova-compute[72782]:   </features>
Aug 14 20:25:09 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:25:09 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:25:09 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:25:09 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:25:09 user nova-compute[72782]:   </clock>
Aug 14 20:25:09 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:25:09 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:25:09 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:25:09 user nova-compute[72782]:   </cpu>
Aug 14 20:25:09 user nova-compute[72782]:   <devices>
Aug 14 20:25:09 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:25:09 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:25:09 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk"/>
Aug 14 20:25:09 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:25:09 user nova-compute[72782]:     </disk>
Aug 14 20:25:09 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:25:09 user nova-compute[72782]:       <mac address="fa:16:3e:12:8e:23"/>
Aug 14 20:25:09 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:25:09 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:25:09 user nova-compute[72782]:       <target dev="tapfe0631cb-7c"/>
Aug 14 20:25:09 user nova-compute[72782]:     </interface>
Aug 14 20:25:09 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:25:09 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/console.log" append="off"/>
Aug 14 20:25:09 user nova-compute[72782]:     </serial>
Aug 14 20:25:09 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:25:09 user nova-compute[72782]:     <video>
Aug 14 20:25:09 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:25:09 user nova-compute[72782]:     </video>
Aug 14 20:25:09 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:25:09 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:25:09 user nova-compute[72782]:     </rng>
Aug 14 20:25:09 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:25:09 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:25:09 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:25:09 user nova-compute[72782]:     </memballoon>
Aug 14 20:25:09 user nova-compute[72782]:   </devices>
Aug 14 20:25:09 user nova-compute[72782]: </domain>
Aug 14 20:25:09 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T20:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1261581948',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1261581948',id=41,image_ref='ead227c5-f3c4-4b99-a452-3db58dfb1c74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-222436759',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:21:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d8754bbf7f9945fba2bd1ad571f556f6',ramdisk_id='',reservation_id='r-t0ee9af6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-220778544',owner_user_name='tempest-AttachVolumeShelveTestJSON-220778544-project-member',shelved_at='2023-08-14T20:23:14.533438',shelved_host='user',shelved_image_id='ead227c5-f3c4-4b99-a452-3db58dfb1c74'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:25:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3090a5cb6ba34a7fb007d98a351c8313',uuid=b4c69b22-f628-40c1-ab95-983d6005b10c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converting VIF {"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:8e:23,bridge_name='br-int',has_traffic_filtering=True,id=fe0631cb-7cfd-40ba-ae3f-e924307c0ab0,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0631cb-7c') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG os_vif [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:8e:23,bridge_name='br-int',has_traffic_filtering=True,id=fe0631cb-7cfd-40ba-ae3f-e924307c0ab0,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0631cb-7c') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe0631cb-7c, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe0631cb-7c, col_values=(('external_ids', {'iface-id': 'fe0631cb-7cfd-40ba-ae3f-e924307c0ab0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:8e:23', 'vm-uuid': 'b4c69b22-f628-40c1-ab95-983d6005b10c'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:09 user nova-compute[72782]: INFO os_vif [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:8e:23,bridge_name='br-int',has_traffic_filtering=True,id=fe0631cb-7cfd-40ba-ae3f-e924307c0ab0,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0631cb-7c')
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:25:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] No VIF found with MAC fa:16:3e:12:8e:23, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:25:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-14b73a30-b2da-4488-bc7d-499c03f253ee req-dd2478df-5ae1-40dc-a4cc-2d33705758e6 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received event network-vif-plugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:25:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-14b73a30-b2da-4488-bc7d-499c03f253ee req-dd2478df-5ae1-40dc-a4cc-2d33705758e6 service nova] Acquiring lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:25:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-14b73a30-b2da-4488-bc7d-499c03f253ee req-dd2478df-5ae1-40dc-a4cc-2d33705758e6 service nova] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:25:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-14b73a30-b2da-4488-bc7d-499c03f253ee req-dd2478df-5ae1-40dc-a4cc-2d33705758e6 service nova] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:25:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-14b73a30-b2da-4488-bc7d-499c03f253ee req-dd2478df-5ae1-40dc-a4cc-2d33705758e6 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] No waiting events found dispatching network-vif-plugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:25:11 user nova-compute[72782]: WARNING nova.compute.manager [req-14b73a30-b2da-4488-bc7d-499c03f253ee req-dd2478df-5ae1-40dc-a4cc-2d33705758e6 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received unexpected event network-vif-plugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 20:25:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zptZXvBU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:25:12 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:25:12 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:25:12 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[694ce149-88f4-430f-89d0-d0081eaddc5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:25:12 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed6e5c1-8e85-40a4-931f-f9388bb2306f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3] added
Aug 14 20:25:12 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e57f89-116d-4e25-afee-d30d579ebd57]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9ab1c6-0ac7-4210-a9c2-a11ed95b4ad4]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zptZXvBU {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zptZXvBU" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce51ddd-1d6f-442c-aec7-30ebb3b718ed]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zptZXvBU'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e91c753-edb4-4cc3-b2a8-7fd4db6e0df0]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6c14ea-31ab-40ee-aafc-b65fcb63d07e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:25:12 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:25:12 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:25:12 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 20:25:12 user nova-compute[72782]: 
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ca1519-6ee6-46af-89e6-fed6b6dd346e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3, portal: 172.16.0.220,3260]
Aug 14 20:25:12 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3, portal: 172.16.0.220,3260] successful.
Aug 14 20:25:12 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a82929-197a-4f82-8772-7590414fbccf]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[496db0ec-0239-4905-80ab-4138c4186671]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 (non-flash)
Aug 14 20:25:12 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 (non-flash)
Aug 14 20:25:12 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4777efdf-b2f1-446c-83ac-90ae59e8c1c1]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:25:12 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zptZXvBU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:25:13 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044713.3140662, b4c69b22-f628-40c1-ab95-983d6005b10c => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:25:13 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] VM Resumed (Lifecycle Event)
Aug 14 20:25:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:25:13 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:25:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-61306e8b-8e6b-4ad3-b8f2-dde160478afd req-043d1980-8d8e-4bc1-907c-5f9a81d20649 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received event network-vif-plugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:25:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-61306e8b-8e6b-4ad3-b8f2-dde160478afd req-043d1980-8d8e-4bc1-907c-5f9a81d20649 service nova] Acquiring lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:25:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-61306e8b-8e6b-4ad3-b8f2-dde160478afd req-043d1980-8d8e-4bc1-907c-5f9a81d20649 service nova] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:25:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-61306e8b-8e6b-4ad3-b8f2-dde160478afd req-043d1980-8d8e-4bc1-907c-5f9a81d20649 service nova] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:25:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-61306e8b-8e6b-4ad3-b8f2-dde160478afd req-043d1980-8d8e-4bc1-907c-5f9a81d20649 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] No waiting events found dispatching network-vif-plugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:25:13 user nova-compute[72782]: WARNING nova.compute.manager [req-61306e8b-8e6b-4ad3-b8f2-dde160478afd req-043d1980-8d8e-4bc1-907c-5f9a81d20649 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received unexpected event network-vif-plugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 20:25:13 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Instance spawned successfully.
Aug 14 20:25:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:25:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:25:13 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:25:13 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044713.3176556, b4c69b22-f628-40c1-ab95-983d6005b10c => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:25:13 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] VM Started (Lifecycle Event)
Aug 14 20:25:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:25:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:25:13 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:25:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:25:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:25:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23631313031363766', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:25:13 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631313031363766', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:25:13 user nova-compute[72782]: DEBUG nova.objects.instance [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lazy-loading 'flavor' on Instance uuid 1229d145-40ad-487c-8141-60b9cdefc4ab {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:25:13 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 20:25:13 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:25:13 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:25:13 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:25:13 user nova-compute[72782]:   <serial>aa026731-5e12-4c31-8e64-fb2a5cdcada3</serial>
Aug 14 20:25:13 user nova-compute[72782]: </disk>
Aug 14 20:25:13 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 20:25:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f4626a4-6258-41d8-80cb-7f22eb7793ad tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.413s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:25:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:25:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:25:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] No VIF found with MAC fa:16:3e:2c:64:54, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:25:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-71cb4b62-b303-4195-9852-b3963acc954e tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.597s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:25:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:16 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:25:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:25:23 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:25:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:25:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:25:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:25:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:25:23 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:25:23 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid b4c69b22-f628-40c1-ab95-983d6005b10c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:25:23 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Updating instance_info_cache with network_info: [{"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:25:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-b4c69b22-f628-40c1-ab95-983d6005b10c" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:25:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:25:23 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:25:24 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:25:24 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:25:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-45fda2cf-c118-41e0-8772-d204e1c45d32 req-29bff988-e041-45e9-8ad1-961eb007b214 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received event network-changed-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:25:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-45fda2cf-c118-41e0-8772-d204e1c45d32 req-29bff988-e041-45e9-8ad1-961eb007b214 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Refreshing instance network info cache due to event network-changed-f52a6d15-15d8-4276-a6d8-343ec4b547d8. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:25:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-45fda2cf-c118-41e0-8772-d204e1c45d32 req-29bff988-e041-45e9-8ad1-961eb007b214 service nova] Acquiring lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:25:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-45fda2cf-c118-41e0-8772-d204e1c45d32 req-29bff988-e041-45e9-8ad1-961eb007b214 service nova] Acquired lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:25:24 user nova-compute[72782]: DEBUG nova.network.neutron [req-45fda2cf-c118-41e0-8772-d204e1c45d32 req-29bff988-e041-45e9-8ad1-961eb007b214 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Refreshing network info cache for port f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:25:24 user nova-compute[72782]: DEBUG nova.network.neutron [req-45fda2cf-c118-41e0-8772-d204e1c45d32 req-29bff988-e041-45e9-8ad1-961eb007b214 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updated VIF entry in instance network info cache for port f52a6d15-15d8-4276-a6d8-343ec4b547d8. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:25:24 user nova-compute[72782]: DEBUG nova.network.neutron [req-45fda2cf-c118-41e0-8772-d204e1c45d32 req-29bff988-e041-45e9-8ad1-961eb007b214 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updating instance_info_cache with network_info: [{"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:25:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-45fda2cf-c118-41e0-8772-d204e1c45d32 req-29bff988-e041-45e9-8ad1-961eb007b214 service nova] Releasing lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:25:25 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:25:25 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:25:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-fbcf9af0-618a-4b0d-ba57-048a14036c9c req-2f0eff2d-e67d-4f66-a1f3-cf9075442f4a service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received event network-changed-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:25:25 user nova-compute[72782]: DEBUG nova.compute.manager [req-fbcf9af0-618a-4b0d-ba57-048a14036c9c req-2f0eff2d-e67d-4f66-a1f3-cf9075442f4a service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Refreshing instance network info cache due to event network-changed-f52a6d15-15d8-4276-a6d8-343ec4b547d8. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:25:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fbcf9af0-618a-4b0d-ba57-048a14036c9c req-2f0eff2d-e67d-4f66-a1f3-cf9075442f4a service nova] Acquiring lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:25:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fbcf9af0-618a-4b0d-ba57-048a14036c9c req-2f0eff2d-e67d-4f66-a1f3-cf9075442f4a service nova] Acquired lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:25:25 user nova-compute[72782]: DEBUG nova.network.neutron [req-fbcf9af0-618a-4b0d-ba57-048a14036c9c req-2f0eff2d-e67d-4f66-a1f3-cf9075442f4a service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Refreshing network info cache for port f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:25:26 user nova-compute[72782]: DEBUG nova.network.neutron [req-fbcf9af0-618a-4b0d-ba57-048a14036c9c req-2f0eff2d-e67d-4f66-a1f3-cf9075442f4a service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updated VIF entry in instance network info cache for port f52a6d15-15d8-4276-a6d8-343ec4b547d8. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:25:26 user nova-compute[72782]: DEBUG nova.network.neutron [req-fbcf9af0-618a-4b0d-ba57-048a14036c9c req-2f0eff2d-e67d-4f66-a1f3-cf9075442f4a service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updating instance_info_cache with network_info: [{"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:25:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-fbcf9af0-618a-4b0d-ba57-048a14036c9c req-2f0eff2d-e67d-4f66-a1f3-cf9075442f4a service nova] Releasing lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:25:27 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:25:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:29 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:25:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "1229d145-40ad-487c-8141-60b9cdefc4ab" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:25:32 user nova-compute[72782]: INFO nova.compute.manager [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Rebooting instance
Aug 14 20:25:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquired lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG nova.network.neutron [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG nova.network.neutron [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updating instance_info_cache with network_info: [{"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Releasing lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:25:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG nova.compute.manager [req-8d930269-4569-41d8-b77f-3ddc6476cecf req-206876ca-b18a-401b-aa39-3d21e14635b0 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received event network-vif-unplugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8d930269-4569-41d8-b77f-3ddc6476cecf req-206876ca-b18a-401b-aa39-3d21e14635b0 service nova] Acquiring lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8d930269-4569-41d8-b77f-3ddc6476cecf req-206876ca-b18a-401b-aa39-3d21e14635b0 service nova] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8d930269-4569-41d8-b77f-3ddc6476cecf req-206876ca-b18a-401b-aa39-3d21e14635b0 service nova] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG nova.compute.manager [req-8d930269-4569-41d8-b77f-3ddc6476cecf req-206876ca-b18a-401b-aa39-3d21e14635b0 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] No waiting events found dispatching network-vif-unplugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:25:33 user nova-compute[72782]: WARNING nova.compute.manager [req-8d930269-4569-41d8-b77f-3ddc6476cecf req-206876ca-b18a-401b-aa39-3d21e14635b0 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received unexpected event network-vif-unplugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 for instance with vm_state active and task_state reboot_started_hard.
Aug 14 20:25:33 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:25:33 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:25:33 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8529MB free_disk=25.269176483154297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:25:33 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Instance destroyed successfully.
Aug 14 20:25:33 user nova-compute[72782]: DEBUG nova.objects.instance [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lazy-loading 'resources' on Instance uuid 1229d145-40ad-487c-8141-60b9cdefc4ab {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1878285010',display_name='tempest-TestMinimumBasicScenario-server-1878285010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1878285010',id=42,image_ref='f4dfda46-204c-4e40-b331-bbffdb05f66b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpCAqehdG5k+XsMcQDlaCnyAACwBFUQbys9aS48u9Mcp87Yj7TN/RfnjxlfddFCCwoX2OhkTUj7fGV0qraPeDv1jGHMzhy/NpSkETZiu3jdA4hu1+CPxqzk0W/m1z3aWw==',key_name='tempest-TestMinimumBasicScenario-1506570524',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:23:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fc168d9c3794a2e8c7934151ecc3d2e',ramdisk_id='',reservation_id='r-4mch9rs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f4dfda46-204c-4e40-b331-bbffdb05f66b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-77953630',owner_user_name='tempest-TestMinimumBasicScenario-77953630-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:25:33Z,user_data=None,user_id='f4eedf2578e64fdd8f1a761e5ba1c626',uuid=1229d145-40ad-487c-8141-60b9cdefc4ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Converting VIF {"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:64:54,bridge_name='br-int',has_traffic_filtering=True,id=f52a6d15-15d8-4276-a6d8-343ec4b547d8,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52a6d15-15') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG os_vif [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:64:54,bridge_name='br-int',has_traffic_filtering=True,id=f52a6d15-15d8-4276-a6d8-343ec4b547d8,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52a6d15-15') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf52a6d15-15, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:25:33 user nova-compute[72782]: INFO os_vif [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:64:54,bridge_name='br-int',has_traffic_filtering=True,id=f52a6d15-15d8-4276-a6d8-343ec4b547d8,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52a6d15-15')
Aug 14 20:25:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zptZXvBU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:25:33 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:25:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d97672b-9dcd-465a-8b3a-ffb03241fa4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 1229d145-40ad-487c-8141-60b9cdefc4ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance b4c69b22-f628-40c1-ab95-983d6005b10c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93594ae-942d-4366-88ac-3b57a656accb]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 (non-flash)
Aug 14 20:25:33 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 (non-flash)
Aug 14 20:25:33 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e869ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[33187446-4697-4fff-b1b4-a3c33da6bfa3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d0532c-800c-4f1e-a58f-f5a357be627d]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a57259-270d-4600-aec7-4f9ff16a1b0b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[725673f8-3240-4602-9594-24e60c82849a]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:25:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5fcf22-1f86-4a66-b04e-bd0936cf289e]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b255df34-a5b8-4101-a1c2-b78f2bd19130]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3, portal: 172.16.0.220,3260]
Aug 14 20:25:34 user nova-compute[72782]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3, portal: 172.16.0.220,3260] successful.
Aug 14 20:25:34 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3986819b-54e6-42b1-bfdc-977edf5a677a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] <== disconnect_volume: return (255ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Start _get_guest_xml network_info=[{"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f4dfda46-204c-4e40-b331-bbffdb05f66b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': 'f4dfda46-204c-4e40-b331-bbffdb05f66b'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'c1c6897c-032c-435d-b928-6d77958952d4', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zptZXvBU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1229d145-40ad-487c-8141-60b9cdefc4ab', 'attached_at': '', 'detached_at': '', 'volume_id': 'aa026731-5e12-4c31-8e64-fb2a5cdcada3', 'serial': 'aa026731-5e12-4c31-8e64-fb2a5cdcada3'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:25:34 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:25:34 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f4dfda46-204c-4e40-b331-bbffdb05f66b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.objects.instance [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1229d145-40ad-487c-8141-60b9cdefc4ab {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zptZXvBU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:25:34 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:25:34 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:25:34 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7e57fa-b731-4a89-a955-769a0fde18a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:25:34 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7b4c22-0987-4a37-a7c7-0ccff6ddd44f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3] added
Aug 14 20:25:34 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95c2044-f3ef-49b2-bb2f-711c759f097a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b30e6a9-6f4e-4379-b31e-a4062051ceaa]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zptZXvBU {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zptZXvBU" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a080a6f-3b5f-4abd-82a5-df9079c9706f]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zptZXvBU'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da37fd7-75f7-431e-ac1a-7046fe41c9cf]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc50a61-04be-4dfc-bd11-cd87a3fb045b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:25:34 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:25:34 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:25:34 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 20:25:34 user nova-compute[72782]: 
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac6d03d-701a-4efc-bdb1-3231175efc21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3, portal: 172.16.0.220,3260]
Aug 14 20:25:34 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3, portal: 172.16.0.220,3260] successful.
Aug 14 20:25:34 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfe11cb-fcdf-487c-aaa7-c8200093c883]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54444d8-8927-45c3-b00e-3075d928d2da]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 (non-flash)
Aug 14 20:25:34 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 (non-flash)
Aug 14 20:25:34 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e59e6b7-48f2-4447-aaaf-732560c412e7]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:25:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zptZXvBU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-8984d6f4-c41a-46ac-a66f-c66813db8567 req-239e92e4-4150-4b46-ba72-600e775b6733 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received event network-vif-plugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8984d6f4-c41a-46ac-a66f-c66813db8567 req-239e92e4-4150-4b46-ba72-600e775b6733 service nova] Acquiring lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8984d6f4-c41a-46ac-a66f-c66813db8567 req-239e92e4-4150-4b46-ba72-600e775b6733 service nova] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8984d6f4-c41a-46ac-a66f-c66813db8567 req-239e92e4-4150-4b46-ba72-600e775b6733 service nova] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-8984d6f4-c41a-46ac-a66f-c66813db8567 req-239e92e4-4150-4b46-ba72-600e775b6733 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] No waiting events found dispatching network-vif-plugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:25:35 user nova-compute[72782]: WARNING nova.compute.manager [req-8984d6f4-c41a-46ac-a66f-c66813db8567 req-239e92e4-4150-4b46-ba72-600e775b6733 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received unexpected event network-vif-plugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 for instance with vm_state active and task_state reboot_started_hard.
Aug 14 20:25:35 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23631313031363766', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631313031363766', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1878285010',display_name='tempest-TestMinimumBasicScenario-server-1878285010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1878285010',id=42,image_ref='f4dfda46-204c-4e40-b331-bbffdb05f66b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpCAqehdG5k+XsMcQDlaCnyAACwBFUQbys9aS48u9Mcp87Yj7TN/RfnjxlfddFCCwoX2OhkTUj7fGV0qraPeDv1jGHMzhy/NpSkETZiu3jdA4hu1+CPxqzk0W/m1z3aWw==',key_name='tempest-TestMinimumBasicScenario-1506570524',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:23:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fc168d9c3794a2e8c7934151ecc3d2e',ramdisk_id='',reservation_id='r-4mch9rs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f4dfda46-204c-4e40-b331-bbffdb05f66b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-77953630',owner_user_name='tempest-TestMinimumBasicScenario-77953630-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:25:33Z,user_data=None,user_id='f4eedf2578e64fdd8f1a761e5ba1c626',uuid=1229d145-40ad-487c-8141-60b9cdefc4ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Converting VIF {"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:64:54,bridge_name='br-int',has_traffic_filtering=True,id=f52a6d15-15d8-4276-a6d8-343ec4b547d8,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52a6d15-15') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG nova.objects.instance [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lazy-loading 'pci_devices' on Instance uuid 1229d145-40ad-487c-8141-60b9cdefc4ab {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:25:35 user nova-compute[72782]:   <uuid>1229d145-40ad-487c-8141-60b9cdefc4ab</uuid>
Aug 14 20:25:35 user nova-compute[72782]:   <name>instance-0000002a</name>
Aug 14 20:25:35 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:25:35 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:25:35 user nova-compute[72782]:   <metadata>
Aug 14 20:25:35 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:25:35 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:25:35 user nova-compute[72782]:       <nova:name>tempest-TestMinimumBasicScenario-server-1878285010</nova:name>
Aug 14 20:25:35 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:25:34</nova:creationTime>
Aug 14 20:25:35 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:25:35 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:25:35 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:25:35 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:25:35 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:25:35 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:25:35 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:25:35 user nova-compute[72782]:       <nova:owner>
Aug 14 20:25:35 user nova-compute[72782]:         <nova:user uuid="f4eedf2578e64fdd8f1a761e5ba1c626">tempest-TestMinimumBasicScenario-77953630-project-member</nova:user>
Aug 14 20:25:35 user nova-compute[72782]:         <nova:project uuid="9fc168d9c3794a2e8c7934151ecc3d2e">tempest-TestMinimumBasicScenario-77953630</nova:project>
Aug 14 20:25:35 user nova-compute[72782]:       </nova:owner>
Aug 14 20:25:35 user nova-compute[72782]:       <nova:root type="image" uuid="f4dfda46-204c-4e40-b331-bbffdb05f66b"/>
Aug 14 20:25:35 user nova-compute[72782]:       <nova:ports>
Aug 14 20:25:35 user nova-compute[72782]:         <nova:port uuid="f52a6d15-15d8-4276-a6d8-343ec4b547d8">
Aug 14 20:25:35 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 20:25:35 user nova-compute[72782]:         </nova:port>
Aug 14 20:25:35 user nova-compute[72782]:       </nova:ports>
Aug 14 20:25:35 user nova-compute[72782]:     </nova:instance>
Aug 14 20:25:35 user nova-compute[72782]:   </metadata>
Aug 14 20:25:35 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:25:35 user nova-compute[72782]:     <system>
Aug 14 20:25:35 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:25:35 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:25:35 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:25:35 user nova-compute[72782]:       <entry name="serial">1229d145-40ad-487c-8141-60b9cdefc4ab</entry>
Aug 14 20:25:35 user nova-compute[72782]:       <entry name="uuid">1229d145-40ad-487c-8141-60b9cdefc4ab</entry>
Aug 14 20:25:35 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:25:35 user nova-compute[72782]:     </system>
Aug 14 20:25:35 user nova-compute[72782]:   </sysinfo>
Aug 14 20:25:35 user nova-compute[72782]:   <os>
Aug 14 20:25:35 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:25:35 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:25:35 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:25:35 user nova-compute[72782]:   </os>
Aug 14 20:25:35 user nova-compute[72782]:   <features>
Aug 14 20:25:35 user nova-compute[72782]:     <acpi/>
Aug 14 20:25:35 user nova-compute[72782]:     <apic/>
Aug 14 20:25:35 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:25:35 user nova-compute[72782]:   </features>
Aug 14 20:25:35 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:25:35 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:25:35 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:25:35 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:25:35 user nova-compute[72782]:   </clock>
Aug 14 20:25:35 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:25:35 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:25:35 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:25:35 user nova-compute[72782]:   </cpu>
Aug 14 20:25:35 user nova-compute[72782]:   <devices>
Aug 14 20:25:35 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:25:35 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:25:35 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk"/>
Aug 14 20:25:35 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:25:35 user nova-compute[72782]:     </disk>
Aug 14 20:25:35 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 20:25:35 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:25:35 user nova-compute[72782]:       <source dev="/dev/sdb"/>
Aug 14 20:25:35 user nova-compute[72782]:       <target dev="vdb" bus="virtio"/>
Aug 14 20:25:35 user nova-compute[72782]:       <serial>aa026731-5e12-4c31-8e64-fb2a5cdcada3</serial>
Aug 14 20:25:35 user nova-compute[72782]:     </disk>
Aug 14 20:25:35 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:25:35 user nova-compute[72782]:       <mac address="fa:16:3e:2c:64:54"/>
Aug 14 20:25:35 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:25:35 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:25:35 user nova-compute[72782]:       <target dev="tapf52a6d15-15"/>
Aug 14 20:25:35 user nova-compute[72782]:     </interface>
Aug 14 20:25:35 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:25:35 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/console.log" append="off"/>
Aug 14 20:25:35 user nova-compute[72782]:     </serial>
Aug 14 20:25:35 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:25:35 user nova-compute[72782]:     <video>
Aug 14 20:25:35 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:25:35 user nova-compute[72782]:     </video>
Aug 14 20:25:35 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:25:35 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:25:35 user nova-compute[72782]:     </rng>
Aug 14 20:25:35 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:25:35 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:25:35 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:25:35 user nova-compute[72782]:     </memballoon>
Aug 14 20:25:35 user nova-compute[72782]:   </devices>
Aug 14 20:25:35 user nova-compute[72782]: </domain>
Aug 14 20:25:35 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG nova.objects.instance [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1229d145-40ad-487c-8141-60b9cdefc4ab {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:25:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Cannot resize image /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG nova.objects.instance [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lazy-loading 'migration_context' on Instance uuid 1229d145-40ad-487c-8141-60b9cdefc4ab {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1878285010',display_name='tempest-TestMinimumBasicScenario-server-1878285010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1878285010',id=42,image_ref='f4dfda46-204c-4e40-b331-bbffdb05f66b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpCAqehdG5k+XsMcQDlaCnyAACwBFUQbys9aS48u9Mcp87Yj7TN/RfnjxlfddFCCwoX2OhkTUj7fGV0qraPeDv1jGHMzhy/NpSkETZiu3jdA4hu1+CPxqzk0W/m1z3aWw==',key_name='tempest-TestMinimumBasicScenario-1506570524',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:23:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='9fc168d9c3794a2e8c7934151ecc3d2e',ramdisk_id='',reservation_id='r-4mch9rs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f4dfda46-204c-4e40-b331-bbffdb05f66b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-77953630',owner_user_name='tempest-TestMinimumBasicScenario-77953630-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:25:33Z,user_data=None,user_id='f4eedf2578e64fdd8f1a761e5ba1c626',uuid=1229d145-40ad-487c-8141-60b9cdefc4ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Converting VIF {"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:64:54,bridge_name='br-int',has_traffic_filtering=True,id=f52a6d15-15d8-4276-a6d8-343ec4b547d8,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52a6d15-15') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG os_vif [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:64:54,bridge_name='br-int',has_traffic_filtering=True,id=f52a6d15-15d8-4276-a6d8-343ec4b547d8,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52a6d15-15') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf52a6d15-15, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf52a6d15-15, col_values=(('external_ids', {'iface-id': 'f52a6d15-15d8-4276-a6d8-343ec4b547d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:64:54', 'vm-uuid': '1229d145-40ad-487c-8141-60b9cdefc4ab'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:25:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:36 user nova-compute[72782]: INFO os_vif [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:64:54,bridge_name='br-int',has_traffic_filtering=True,id=f52a6d15-15d8-4276-a6d8-343ec4b547d8,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52a6d15-15')
Aug 14 20:25:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-61826eb0-7034-4bc4-aaae-50d5254977d0 req-612bc22c-429b-4c52-a4ae-763c83227851 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received event network-vif-plugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:25:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-61826eb0-7034-4bc4-aaae-50d5254977d0 req-612bc22c-429b-4c52-a4ae-763c83227851 service nova] Acquiring lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:25:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-61826eb0-7034-4bc4-aaae-50d5254977d0 req-612bc22c-429b-4c52-a4ae-763c83227851 service nova] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:25:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-61826eb0-7034-4bc4-aaae-50d5254977d0 req-612bc22c-429b-4c52-a4ae-763c83227851 service nova] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:25:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-61826eb0-7034-4bc4-aaae-50d5254977d0 req-612bc22c-429b-4c52-a4ae-763c83227851 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] No waiting events found dispatching network-vif-plugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:25:37 user nova-compute[72782]: WARNING nova.compute.manager [req-61826eb0-7034-4bc4-aaae-50d5254977d0 req-612bc22c-429b-4c52-a4ae-763c83227851 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received unexpected event network-vif-plugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 for instance with vm_state active and task_state reboot_started_hard.
Aug 14 20:25:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Removed pending event for 1229d145-40ad-487c-8141-60b9cdefc4ab due to event {{(pid=72782) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 20:25:39 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044739.7607534, 1229d145-40ad-487c-8141-60b9cdefc4ab => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:25:39 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] VM Resumed (Lifecycle Event)
Aug 14 20:25:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:25:39 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Instance rebooted successfully.
Aug 14 20:25:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:25:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:25:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:25:39 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 14 20:25:39 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044739.762841, 1229d145-40ad-487c-8141-60b9cdefc4ab => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:25:39 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] VM Started (Lifecycle Event)
Aug 14 20:25:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:25:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-34efad61-1f5d-41ad-843f-a515d6f639b5 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.566s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:25:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:25:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-e5268dd4-193c-47da-a6e9-b93927605a1a req-65eb059c-e3f9-4855-8135-4bbdd4ede7f2 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received event network-vif-plugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:25:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e5268dd4-193c-47da-a6e9-b93927605a1a req-65eb059c-e3f9-4855-8135-4bbdd4ede7f2 service nova] Acquiring lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:25:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e5268dd4-193c-47da-a6e9-b93927605a1a req-65eb059c-e3f9-4855-8135-4bbdd4ede7f2 service nova] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:25:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e5268dd4-193c-47da-a6e9-b93927605a1a req-65eb059c-e3f9-4855-8135-4bbdd4ede7f2 service nova] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:25:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-e5268dd4-193c-47da-a6e9-b93927605a1a req-65eb059c-e3f9-4855-8135-4bbdd4ede7f2 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] No waiting events found dispatching network-vif-plugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:25:39 user nova-compute[72782]: WARNING nova.compute.manager [req-e5268dd4-193c-47da-a6e9-b93927605a1a req-65eb059c-e3f9-4855-8135-4bbdd4ede7f2 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received unexpected event network-vif-plugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 for instance with vm_state active and task_state None.
Aug 14 20:25:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:25:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:19 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:26:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:23 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:26:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:26:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:26:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:26:23 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:26:23 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updating instance_info_cache with network_info: [{"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:26:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:26:23 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:26:23 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:26:24 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:26:26 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:26:26 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:26:26 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:26:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:29 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:26:30 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:26:30 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 20:26:30 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] There are 0 instances to clean {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 20:26:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:32 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:26:33 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:26:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:26:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:26:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:26:33 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:26:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:26:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:26:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:26:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:26:33 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:26:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:26:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:26:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:26:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:26:34 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:26:34 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:26:34 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8666MB free_disk=25.267414093017578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:26:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:26:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:26:34 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 1229d145-40ad-487c-8141-60b9cdefc4ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:26:34 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance b4c69b22-f628-40c1-ab95-983d6005b10c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:26:34 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:26:34 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:26:34 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing inventories for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 20:26:34 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating ProviderTree inventory for provider d26c9e3b-40e6-476e-9664-3119ebf5873b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 20:26:34 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 20:26:34 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing aggregate associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, aggregates: None {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 20:26:34 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing trait associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 20:26:34 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:26:34 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:26:34 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:26:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:26:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:26:39 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:26:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:26:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:26:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:26:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:26:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:26:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:52 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:26:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72782) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 20:26:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "b4c69b22-f628-40c1-ab95-983d6005b10c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:26:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:26:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:26:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:26:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:26:52 user nova-compute[72782]: INFO nova.compute.manager [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Terminating instance
Aug 14 20:26:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:26:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-7b2c6dd9-d244-4cff-9f95-685797bf138b req-32497ae6-19fb-4649-a22a-5fd11c652721 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received event network-vif-unplugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:26:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7b2c6dd9-d244-4cff-9f95-685797bf138b req-32497ae6-19fb-4649-a22a-5fd11c652721 service nova] Acquiring lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:26:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7b2c6dd9-d244-4cff-9f95-685797bf138b req-32497ae6-19fb-4649-a22a-5fd11c652721 service nova] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:26:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7b2c6dd9-d244-4cff-9f95-685797bf138b req-32497ae6-19fb-4649-a22a-5fd11c652721 service nova] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:26:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-7b2c6dd9-d244-4cff-9f95-685797bf138b req-32497ae6-19fb-4649-a22a-5fd11c652721 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] No waiting events found dispatching network-vif-unplugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:26:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-7b2c6dd9-d244-4cff-9f95-685797bf138b req-32497ae6-19fb-4649-a22a-5fd11c652721 service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received event network-vif-unplugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:26:53 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Instance destroyed successfully.
Aug 14 20:26:53 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lazy-loading 'resources' on Instance uuid b4c69b22-f628-40c1-ab95-983d6005b10c {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:26:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T20:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1261581948',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1261581948',id=41,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUcZm/ixOHXdKaRFGd0Vcj7OPXNUUPuROJ2bl7c+YwYJt2z+sgaboFOA+89jQPGz9pfpXJCdE0Hdl8dwOwfF5lOzsOO7GOn/zukXSHkUntg5Pn/2ZAGAV3Hl6u8h29jwA==',key_name='tempest-keypair-222436759',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:25:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8754bbf7f9945fba2bd1ad571f556f6',ramdisk_id='',reservation_id='r-t0ee9af6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-220778544',owner_user_name='tempest-AttachVolumeShelveTestJSON-220778544-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:25:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3090a5cb6ba34a7fb007d98a351c8313',uuid=b4c69b22-f628-40c1-ab95-983d6005b10c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:26:53 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converting VIF {"id": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "address": "fa:16:3e:12:8e:23", "network": {"id": "3df6c2de-2c9f-4fbc-90d0-6c634955649d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-216987011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8754bbf7f9945fba2bd1ad571f556f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0631cb-7c", "ovs_interfaceid": "fe0631cb-7cfd-40ba-ae3f-e924307c0ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:26:53 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:8e:23,bridge_name='br-int',has_traffic_filtering=True,id=fe0631cb-7cfd-40ba-ae3f-e924307c0ab0,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0631cb-7c') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:26:53 user nova-compute[72782]: DEBUG os_vif [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:8e:23,bridge_name='br-int',has_traffic_filtering=True,id=fe0631cb-7cfd-40ba-ae3f-e924307c0ab0,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0631cb-7c') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:26:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe0631cb-7c, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:26:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:26:53 user nova-compute[72782]: INFO os_vif [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:8e:23,bridge_name='br-int',has_traffic_filtering=True,id=fe0631cb-7cfd-40ba-ae3f-e924307c0ab0,network=Network(3df6c2de-2c9f-4fbc-90d0-6c634955649d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0631cb-7c')
Aug 14 20:26:53 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Deleting instance files /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c_del
Aug 14 20:26:53 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Deletion of /opt/stack/data/nova/instances/b4c69b22-f628-40c1-ab95-983d6005b10c_del complete
Aug 14 20:26:53 user nova-compute[72782]: INFO nova.compute.manager [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 14 20:26:53 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:26:53 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:26:53 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:26:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:26:54 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:26:54 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Took 1.01 seconds to deallocate network for instance.
Aug 14 20:26:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:26:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:26:54 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:26:54 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:26:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:26:54 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Deleted allocations for instance b4c69b22-f628-40c1-ab95-983d6005b10c
Aug 14 20:26:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb387414-fc5d-4c90-a611-46882b8fb5b2 tempest-AttachVolumeShelveTestJSON-220778544 tempest-AttachVolumeShelveTestJSON-220778544-project-member] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.024s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:26:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-677f361d-71c8-41cd-8d76-d9f0656bce5b req-a8f92c6e-8812-4fca-b8a4-ca65c03ef42b service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received event network-vif-plugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:26:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-677f361d-71c8-41cd-8d76-d9f0656bce5b req-a8f92c6e-8812-4fca-b8a4-ca65c03ef42b service nova] Acquiring lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:26:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-677f361d-71c8-41cd-8d76-d9f0656bce5b req-a8f92c6e-8812-4fca-b8a4-ca65c03ef42b service nova] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:26:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-677f361d-71c8-41cd-8d76-d9f0656bce5b req-a8f92c6e-8812-4fca-b8a4-ca65c03ef42b service nova] Lock "b4c69b22-f628-40c1-ab95-983d6005b10c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:26:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-677f361d-71c8-41cd-8d76-d9f0656bce5b req-a8f92c6e-8812-4fca-b8a4-ca65c03ef42b service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] No waiting events found dispatching network-vif-plugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:26:54 user nova-compute[72782]: WARNING nova.compute.manager [req-677f361d-71c8-41cd-8d76-d9f0656bce5b req-a8f92c6e-8812-4fca-b8a4-ca65c03ef42b service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received unexpected event network-vif-plugged-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 for instance with vm_state deleted and task_state None.
Aug 14 20:26:54 user nova-compute[72782]: DEBUG nova.compute.manager [req-677f361d-71c8-41cd-8d76-d9f0656bce5b req-a8f92c6e-8812-4fca-b8a4-ca65c03ef42b service nova] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Received event network-vif-deleted-fe0631cb-7cfd-40ba-ae3f-e924307c0ab0 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:26:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:27:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:27:08 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692044813.1737664, b4c69b22-f628-40c1-ab95-983d6005b10c => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:27:08 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] VM Stopped (Lifecycle Event)
Aug 14 20:27:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-825f3aac-5477-42c3-8795-79edc6e6b757 None None] [instance: b4c69b22-f628-40c1-ab95-983d6005b10c] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:27:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:27:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:27:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:27:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:27:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:27:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:27:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:27:18 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:27:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:27:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:27:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:27:24 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:27:24 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:27:24 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:27:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:27:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:27:24 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:27:24 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 1229d145-40ad-487c-8141-60b9cdefc4ab {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:27:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-eec0b368-0e1d-4910-b5f4-ccf4a906e7b4 req-089355bb-e9ab-4886-a360-f3973aafcf6c service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received event network-changed-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:27:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-eec0b368-0e1d-4910-b5f4-ccf4a906e7b4 req-089355bb-e9ab-4886-a360-f3973aafcf6c service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Refreshing instance network info cache due to event network-changed-f52a6d15-15d8-4276-a6d8-343ec4b547d8. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:27:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eec0b368-0e1d-4910-b5f4-ccf4a906e7b4 req-089355bb-e9ab-4886-a360-f3973aafcf6c service nova] Acquiring lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:27:24 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updating instance_info_cache with network_info: [{"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:27:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:27:24 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:27:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eec0b368-0e1d-4910-b5f4-ccf4a906e7b4 req-089355bb-e9ab-4886-a360-f3973aafcf6c service nova] Acquired lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:27:24 user nova-compute[72782]: DEBUG nova.network.neutron [req-eec0b368-0e1d-4910-b5f4-ccf4a906e7b4 req-089355bb-e9ab-4886-a360-f3973aafcf6c service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Refreshing network info cache for port f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:27:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-ed1b2860-8c4a-41bb-bf3e-2471ba99e1aa req-39974939-e8a9-4b45-aea5-327b566b527d service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received event network-changed-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:27:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-ed1b2860-8c4a-41bb-bf3e-2471ba99e1aa req-39974939-e8a9-4b45-aea5-327b566b527d service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Refreshing instance network info cache due to event network-changed-f52a6d15-15d8-4276-a6d8-343ec4b547d8. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:27:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ed1b2860-8c4a-41bb-bf3e-2471ba99e1aa req-39974939-e8a9-4b45-aea5-327b566b527d service nova] Acquiring lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG nova.network.neutron [req-eec0b368-0e1d-4910-b5f4-ccf4a906e7b4 req-089355bb-e9ab-4886-a360-f3973aafcf6c service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updated VIF entry in instance network info cache for port f52a6d15-15d8-4276-a6d8-343ec4b547d8. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG nova.network.neutron [req-eec0b368-0e1d-4910-b5f4-ccf4a906e7b4 req-089355bb-e9ab-4886-a360-f3973aafcf6c service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updating instance_info_cache with network_info: [{"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "1229d145-40ad-487c-8141-60b9cdefc4ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eec0b368-0e1d-4910-b5f4-ccf4a906e7b4 req-089355bb-e9ab-4886-a360-f3973aafcf6c service nova] Releasing lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ed1b2860-8c4a-41bb-bf3e-2471ba99e1aa req-39974939-e8a9-4b45-aea5-327b566b527d service nova] Acquired lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG nova.network.neutron [req-ed1b2860-8c4a-41bb-bf3e-2471ba99e1aa req-39974939-e8a9-4b45-aea5-327b566b527d service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Refreshing network info cache for port f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:27:25 user nova-compute[72782]: INFO nova.compute.manager [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Detaching volume aa026731-5e12-4c31-8e64-fb2a5cdcada3
Aug 14 20:27:25 user nova-compute[72782]: INFO nova.virt.block_device [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Attempting to driver detach volume aa026731-5e12-4c31-8e64-fb2a5cdcada3 from mountpoint /dev/vdb
Aug 14 20:27:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Attempting to detach device vdb from instance 1229d145-40ad-487c-8141-60b9cdefc4ab from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:27:25 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:27:25 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:27:25 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:27:25 user nova-compute[72782]:   <serial>aa026731-5e12-4c31-8e64-fb2a5cdcada3</serial>
Aug 14 20:27:25 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 20:27:25 user nova-compute[72782]: </disk>
Aug 14 20:27:25 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:27:25 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Successfully detached device vdb from instance 1229d145-40ad-487c-8141-60b9cdefc4ab from the persistent domain config.
Aug 14 20:27:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1229d145-40ad-487c-8141-60b9cdefc4ab from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:27:25 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:27:25 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:27:25 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:27:25 user nova-compute[72782]:   <serial>aa026731-5e12-4c31-8e64-fb2a5cdcada3</serial>
Aug 14 20:27:25 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 20:27:25 user nova-compute[72782]: </disk>
Aug 14 20:27:25 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG nova.network.neutron [req-ed1b2860-8c4a-41bb-bf3e-2471ba99e1aa req-39974939-e8a9-4b45-aea5-327b566b527d service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updated VIF entry in instance network info cache for port f52a6d15-15d8-4276-a6d8-343ec4b547d8. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG nova.network.neutron [req-ed1b2860-8c4a-41bb-bf3e-2471ba99e1aa req-39974939-e8a9-4b45-aea5-327b566b527d service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updating instance_info_cache with network_info: [{"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ed1b2860-8c4a-41bb-bf3e-2471ba99e1aa req-39974939-e8a9-4b45-aea5-327b566b527d service nova] Releasing lock "refresh_cache-1229d145-40ad-487c-8141-60b9cdefc4ab" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692044845.7084196, 1229d145-40ad-487c-8141-60b9cdefc4ab => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1229d145-40ad-487c-8141-60b9cdefc4ab {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 20:27:25 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Successfully detached device vdb from instance 1229d145-40ad-487c-8141-60b9cdefc4ab from the live domain config.
Aug 14 20:27:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zptZXvBU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:27:25 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:27:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58da9ae-6a34-4ecb-be81-6163d86a4bee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8e5270-b8ad-4d0f-a4ca-f40b1558cdae]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 (non-flash)
Aug 14 20:27:25 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 (non-flash)
Aug 14 20:27:25 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e8461f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[38057380-8b63-450c-bae8-3e3c7d30fd90]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc851ef0-43e2-4613-81ce-9dab850a3df7]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed983aa7-6156-44fc-a772-f31585643153]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.030s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60eacd7-3652-4e14-bb65-b8612fdf603b]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2994a923-5b4c-4879-ade8-4acd170a7ffa]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a2bcfa-c451-4737-9548-b25e006f393e]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3, portal: 172.16.0.220,3260]
Aug 14 20:27:25 user nova-compute[72782]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3, portal: 172.16.0.220,3260] successful.
Aug 14 20:27:25 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa026731-5e12-4c31-8e64-fb2a5cdcada3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d66872-cb76-4641-ae06-bcd270c198c7]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.247s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] <== disconnect_volume: return (248ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:27:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:27:26 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:27:26 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:27:26 user nova-compute[72782]: DEBUG nova.objects.instance [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lazy-loading 'flavor' on Instance uuid 1229d145-40ad-487c-8141-60b9cdefc4ab {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:27:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-d7b77bb0-8bcf-4887-91e5-e8b8f1d36dec tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.538s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:27:28 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:27:28 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:27:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:27:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:27:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:27:31 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:27:33 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:27:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:27:34 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:27:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:27:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:27:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:27:34 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:27:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:27:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:27:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:27:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:27:34 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:27:34 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:27:34 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8722MB free_disk=25.294464111328125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:27:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:27:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:27:34 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 1229d145-40ad-487c-8141-60b9cdefc4ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:27:34 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:27:34 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:27:35 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:27:35 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:27:35 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:27:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:27:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:27:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:27:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:27:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:27:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:27:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:27:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:28:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:28:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:28:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:28:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:28:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:28:09 user nova-compute[72782]: INFO nova.compute.claims [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Claim successful on node user
Aug 14 20:28:09 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:28:09 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:28:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:28:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:28:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:28:09 user nova-compute[72782]: DEBUG nova.network.neutron [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:28:09 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:28:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:28:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:28:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:28:09 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Creating image(s)
Aug 14 20:28:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:28:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "/opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:28:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "/opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:28:09 user nova-compute[72782]: DEBUG nova.policy [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7aeb23a424fd4eabb174c5630f36956d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ca996ad34a4a55994ae92a688f349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:28:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.169s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk 1073741824" returned: 0 in 0.048s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.168s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG nova.network.neutron [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Successfully created port: 28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Cannot resize image /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG nova.objects.instance [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'migration_context' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Ensure instance console log exists: /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:28:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.network.neutron [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Successfully updated port: 28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquired lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.network.neutron [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.network.neutron [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-ce2c78d8-583a-4d8e-9b4e-71a2b155bac2 req-51c1eda8-54d2-44e3-8537-2ce78226ffb2 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-changed-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-ce2c78d8-583a-4d8e-9b4e-71a2b155bac2 req-51c1eda8-54d2-44e3-8537-2ce78226ffb2 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Refreshing instance network info cache due to event network-changed-28c18d55-ae94-446a-a394-f686216e197d. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ce2c78d8-583a-4d8e-9b4e-71a2b155bac2 req-51c1eda8-54d2-44e3-8537-2ce78226ffb2 service nova] Acquiring lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.network.neutron [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updating instance_info_cache with network_info: [{"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Releasing lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Instance network_info: |[{"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ce2c78d8-583a-4d8e-9b4e-71a2b155bac2 req-51c1eda8-54d2-44e3-8537-2ce78226ffb2 service nova] Acquired lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.network.neutron [req-ce2c78d8-583a-4d8e-9b4e-71a2b155bac2 req-51c1eda8-54d2-44e3-8537-2ce78226ffb2 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Refreshing network info cache for port 28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Start _get_guest_xml network_info=[{"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:28:11 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:28:11 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:28:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1438697692',display_name='tempest-AttachVolumeTestJSON-server-1438697692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1438697692',id=43,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIZMdrvcAObDrQOnw6Z4cKMh8UkLd6T6hnSQkZurL1/AHHX+HwCM+yXwzFIxmNtn58wn91JRRMK8D/OvNJqPJOxQJGzDkEoynLrq1UHzUwGYj+LHuUngHZijLDOQbeXkw==',key_name='tempest-keypair-314886705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21ca996ad34a4a55994ae92a688f349f',ramdisk_id='',reservation_id='r-kxmp5hcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-434447893',owner_user_name='tempest-AttachVolumeTestJSON-434447893-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:28:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeb23a424fd4eabb174c5630f36956d',uuid=1ddcf095-6362-4b8f-82a1-e39eb6aa6661,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converting VIF {"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.objects.instance [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:28:11 user nova-compute[72782]:   <uuid>1ddcf095-6362-4b8f-82a1-e39eb6aa6661</uuid>
Aug 14 20:28:11 user nova-compute[72782]:   <name>instance-0000002b</name>
Aug 14 20:28:11 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:28:11 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:28:11 user nova-compute[72782]:   <metadata>
Aug 14 20:28:11 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:28:11 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:28:11 user nova-compute[72782]:       <nova:name>tempest-AttachVolumeTestJSON-server-1438697692</nova:name>
Aug 14 20:28:11 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:28:11</nova:creationTime>
Aug 14 20:28:11 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:28:11 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:28:11 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:28:11 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:28:11 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:28:11 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:28:11 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:28:11 user nova-compute[72782]:       <nova:owner>
Aug 14 20:28:11 user nova-compute[72782]:         <nova:user uuid="7aeb23a424fd4eabb174c5630f36956d">tempest-AttachVolumeTestJSON-434447893-project-member</nova:user>
Aug 14 20:28:11 user nova-compute[72782]:         <nova:project uuid="21ca996ad34a4a55994ae92a688f349f">tempest-AttachVolumeTestJSON-434447893</nova:project>
Aug 14 20:28:11 user nova-compute[72782]:       </nova:owner>
Aug 14 20:28:11 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 20:28:11 user nova-compute[72782]:       <nova:ports>
Aug 14 20:28:11 user nova-compute[72782]:         <nova:port uuid="28c18d55-ae94-446a-a394-f686216e197d">
Aug 14 20:28:11 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 20:28:11 user nova-compute[72782]:         </nova:port>
Aug 14 20:28:11 user nova-compute[72782]:       </nova:ports>
Aug 14 20:28:11 user nova-compute[72782]:     </nova:instance>
Aug 14 20:28:11 user nova-compute[72782]:   </metadata>
Aug 14 20:28:11 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:28:11 user nova-compute[72782]:     <system>
Aug 14 20:28:11 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:28:11 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:28:11 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:28:11 user nova-compute[72782]:       <entry name="serial">1ddcf095-6362-4b8f-82a1-e39eb6aa6661</entry>
Aug 14 20:28:11 user nova-compute[72782]:       <entry name="uuid">1ddcf095-6362-4b8f-82a1-e39eb6aa6661</entry>
Aug 14 20:28:11 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:28:11 user nova-compute[72782]:     </system>
Aug 14 20:28:11 user nova-compute[72782]:   </sysinfo>
Aug 14 20:28:11 user nova-compute[72782]:   <os>
Aug 14 20:28:11 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:28:11 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:28:11 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:28:11 user nova-compute[72782]:   </os>
Aug 14 20:28:11 user nova-compute[72782]:   <features>
Aug 14 20:28:11 user nova-compute[72782]:     <acpi/>
Aug 14 20:28:11 user nova-compute[72782]:     <apic/>
Aug 14 20:28:11 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:28:11 user nova-compute[72782]:   </features>
Aug 14 20:28:11 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:28:11 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:28:11 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:28:11 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:28:11 user nova-compute[72782]:   </clock>
Aug 14 20:28:11 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:28:11 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:28:11 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:28:11 user nova-compute[72782]:   </cpu>
Aug 14 20:28:11 user nova-compute[72782]:   <devices>
Aug 14 20:28:11 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:28:11 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:28:11 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk"/>
Aug 14 20:28:11 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:28:11 user nova-compute[72782]:     </disk>
Aug 14 20:28:11 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:28:11 user nova-compute[72782]:       <mac address="fa:16:3e:24:a9:dc"/>
Aug 14 20:28:11 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:28:11 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:28:11 user nova-compute[72782]:       <target dev="tap28c18d55-ae"/>
Aug 14 20:28:11 user nova-compute[72782]:     </interface>
Aug 14 20:28:11 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:28:11 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/console.log" append="off"/>
Aug 14 20:28:11 user nova-compute[72782]:     </serial>
Aug 14 20:28:11 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:28:11 user nova-compute[72782]:     <video>
Aug 14 20:28:11 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:28:11 user nova-compute[72782]:     </video>
Aug 14 20:28:11 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:28:11 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:28:11 user nova-compute[72782]:     </rng>
Aug 14 20:28:11 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:28:11 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:28:11 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:28:11 user nova-compute[72782]:     </memballoon>
Aug 14 20:28:11 user nova-compute[72782]:   </devices>
Aug 14 20:28:11 user nova-compute[72782]: </domain>
Aug 14 20:28:11 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:28:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1438697692',display_name='tempest-AttachVolumeTestJSON-server-1438697692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1438697692',id=43,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIZMdrvcAObDrQOnw6Z4cKMh8UkLd6T6hnSQkZurL1/AHHX+HwCM+yXwzFIxmNtn58wn91JRRMK8D/OvNJqPJOxQJGzDkEoynLrq1UHzUwGYj+LHuUngHZijLDOQbeXkw==',key_name='tempest-keypair-314886705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21ca996ad34a4a55994ae92a688f349f',ramdisk_id='',reservation_id='r-kxmp5hcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-434447893',owner_user_name='tempest-AttachVolumeTestJSON-434447893-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:28:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeb23a424fd4eabb174c5630f36956d',uuid=1ddcf095-6362-4b8f-82a1-e39eb6aa6661,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converting VIF {"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG os_vif [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28c18d55-ae, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28c18d55-ae, col_values=(('external_ids', {'iface-id': '28c18d55-ae94-446a-a394-f686216e197d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:a9:dc', 'vm-uuid': '1ddcf095-6362-4b8f-82a1-e39eb6aa6661'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:11 user nova-compute[72782]: INFO os_vif [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae')
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] No VIF found with MAC fa:16:3e:24:a9:dc, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.network.neutron [req-ce2c78d8-583a-4d8e-9b4e-71a2b155bac2 req-51c1eda8-54d2-44e3-8537-2ce78226ffb2 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updated VIF entry in instance network info cache for port 28c18d55-ae94-446a-a394-f686216e197d. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG nova.network.neutron [req-ce2c78d8-583a-4d8e-9b4e-71a2b155bac2 req-51c1eda8-54d2-44e3-8537-2ce78226ffb2 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updating instance_info_cache with network_info: [{"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:28:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ce2c78d8-583a-4d8e-9b4e-71a2b155bac2 req-51c1eda8-54d2-44e3-8537-2ce78226ffb2 service nova] Releasing lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:28:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-e1b78118-8317-452f-867a-cdd4f461a6bb req-65e37467-ba26-468e-9b91-576eec987b5d service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:28:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e1b78118-8317-452f-867a-cdd4f461a6bb req-65e37467-ba26-468e-9b91-576eec987b5d service nova] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:28:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e1b78118-8317-452f-867a-cdd4f461a6bb req-65e37467-ba26-468e-9b91-576eec987b5d service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:28:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e1b78118-8317-452f-867a-cdd4f461a6bb req-65e37467-ba26-468e-9b91-576eec987b5d service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:28:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-e1b78118-8317-452f-867a-cdd4f461a6bb req-65e37467-ba26-468e-9b91-576eec987b5d service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] No waiting events found dispatching network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:28:13 user nova-compute[72782]: WARNING nova.compute.manager [req-e1b78118-8317-452f-867a-cdd4f461a6bb req-65e37467-ba26-468e-9b91-576eec987b5d service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received unexpected event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d for instance with vm_state building and task_state spawning.
Aug 14 20:28:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:15 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044895.0598993, 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:28:15 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] VM Resumed (Lifecycle Event)
Aug 14 20:28:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:28:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:28:15 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Instance spawned successfully.
Aug 14 20:28:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:28:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:28:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:28:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:28:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:28:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:28:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:28:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:28:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:28:15 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:28:15 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044895.0614579, 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:28:15 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] VM Started (Lifecycle Event)
Aug 14 20:28:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:28:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:28:15 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:28:15 user nova-compute[72782]: INFO nova.compute.manager [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Took 5.31 seconds to spawn the instance on the hypervisor.
Aug 14 20:28:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:28:15 user nova-compute[72782]: DEBUG nova.compute.manager [req-d6cb1363-bd40-426f-b983-9bbb6fe5980d req-4fd40d58-bd49-4239-bb3a-188eaf36ac79 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:28:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d6cb1363-bd40-426f-b983-9bbb6fe5980d req-4fd40d58-bd49-4239-bb3a-188eaf36ac79 service nova] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:28:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d6cb1363-bd40-426f-b983-9bbb6fe5980d req-4fd40d58-bd49-4239-bb3a-188eaf36ac79 service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:28:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d6cb1363-bd40-426f-b983-9bbb6fe5980d req-4fd40d58-bd49-4239-bb3a-188eaf36ac79 service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:28:15 user nova-compute[72782]: DEBUG nova.compute.manager [req-d6cb1363-bd40-426f-b983-9bbb6fe5980d req-4fd40d58-bd49-4239-bb3a-188eaf36ac79 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] No waiting events found dispatching network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:28:15 user nova-compute[72782]: WARNING nova.compute.manager [req-d6cb1363-bd40-426f-b983-9bbb6fe5980d req-4fd40d58-bd49-4239-bb3a-188eaf36ac79 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received unexpected event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d for instance with vm_state building and task_state spawning.
Aug 14 20:28:15 user nova-compute[72782]: INFO nova.compute.manager [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Took 5.87 seconds to build instance.
Aug 14 20:28:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ffb69df5-0e6b-4f7a-a584-c651a668b0e3 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.976s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:28:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "1229d145-40ad-487c-8141-60b9cdefc4ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:28:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:28:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:28:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:28:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:28:20 user nova-compute[72782]: INFO nova.compute.manager [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Terminating instance
Aug 14 20:28:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-ff98b542-bfb9-42a6-8e26-299f20411029 req-61a39b1a-8044-4253-9ea9-5c41fa23dfff service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received event network-vif-unplugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ff98b542-bfb9-42a6-8e26-299f20411029 req-61a39b1a-8044-4253-9ea9-5c41fa23dfff service nova] Acquiring lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ff98b542-bfb9-42a6-8e26-299f20411029 req-61a39b1a-8044-4253-9ea9-5c41fa23dfff service nova] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ff98b542-bfb9-42a6-8e26-299f20411029 req-61a39b1a-8044-4253-9ea9-5c41fa23dfff service nova] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-ff98b542-bfb9-42a6-8e26-299f20411029 req-61a39b1a-8044-4253-9ea9-5c41fa23dfff service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] No waiting events found dispatching network-vif-unplugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-ff98b542-bfb9-42a6-8e26-299f20411029 req-61a39b1a-8044-4253-9ea9-5c41fa23dfff service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received event network-vif-unplugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Instance destroyed successfully.
Aug 14 20:28:21 user nova-compute[72782]: DEBUG nova.objects.instance [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lazy-loading 'resources' on Instance uuid 1229d145-40ad-487c-8141-60b9cdefc4ab {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1878285010',display_name='tempest-TestMinimumBasicScenario-server-1878285010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1878285010',id=42,image_ref='f4dfda46-204c-4e40-b331-bbffdb05f66b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpCAqehdG5k+XsMcQDlaCnyAACwBFUQbys9aS48u9Mcp87Yj7TN/RfnjxlfddFCCwoX2OhkTUj7fGV0qraPeDv1jGHMzhy/NpSkETZiu3jdA4hu1+CPxqzk0W/m1z3aWw==',key_name='tempest-TestMinimumBasicScenario-1506570524',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:23:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fc168d9c3794a2e8c7934151ecc3d2e',ramdisk_id='',reservation_id='r-4mch9rs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f4dfda46-204c-4e40-b331-bbffdb05f66b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-77953630',owner_user_name='tempest-TestMinimumBasicScenario-77953630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:25:40Z,user_data=None,user_id='f4eedf2578e64fdd8f1a761e5ba1c626',uuid=1229d145-40ad-487c-8141-60b9cdefc4ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Converting VIF {"id": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "address": "fa:16:3e:2c:64:54", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52a6d15-15", "ovs_interfaceid": "f52a6d15-15d8-4276-a6d8-343ec4b547d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:64:54,bridge_name='br-int',has_traffic_filtering=True,id=f52a6d15-15d8-4276-a6d8-343ec4b547d8,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52a6d15-15') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG os_vif [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:64:54,bridge_name='br-int',has_traffic_filtering=True,id=f52a6d15-15d8-4276-a6d8-343ec4b547d8,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52a6d15-15') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf52a6d15-15, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:28:21 user nova-compute[72782]: INFO os_vif [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:64:54,bridge_name='br-int',has_traffic_filtering=True,id=f52a6d15-15d8-4276-a6d8-343ec4b547d8,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52a6d15-15')
Aug 14 20:28:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Deleting instance files /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab_del
Aug 14 20:28:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Deletion of /opt/stack/data/nova/instances/1229d145-40ad-487c-8141-60b9cdefc4ab_del complete
Aug 14 20:28:21 user nova-compute[72782]: INFO nova.compute.manager [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 20:28:21 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:28:21 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:28:22 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:28:22 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Took 0.44 seconds to deallocate network for instance.
Aug 14 20:28:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:28:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:28:22 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:28:22 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:28:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:28:22 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Deleted allocations for instance 1229d145-40ad-487c-8141-60b9cdefc4ab
Aug 14 20:28:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4cb0d24-e265-474f-a334-c4610e5e9154 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.720s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:28:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-5cf7b649-efed-46c5-9e31-355604ddb41e req-4d350f93-ed89-4eee-8443-f67b478d5997 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received event network-vif-plugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:28:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5cf7b649-efed-46c5-9e31-355604ddb41e req-4d350f93-ed89-4eee-8443-f67b478d5997 service nova] Acquiring lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:28:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5cf7b649-efed-46c5-9e31-355604ddb41e req-4d350f93-ed89-4eee-8443-f67b478d5997 service nova] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:28:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5cf7b649-efed-46c5-9e31-355604ddb41e req-4d350f93-ed89-4eee-8443-f67b478d5997 service nova] Lock "1229d145-40ad-487c-8141-60b9cdefc4ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:28:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-5cf7b649-efed-46c5-9e31-355604ddb41e req-4d350f93-ed89-4eee-8443-f67b478d5997 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] No waiting events found dispatching network-vif-plugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:28:23 user nova-compute[72782]: WARNING nova.compute.manager [req-5cf7b649-efed-46c5-9e31-355604ddb41e req-4d350f93-ed89-4eee-8443-f67b478d5997 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received unexpected event network-vif-plugged-f52a6d15-15d8-4276-a6d8-343ec4b547d8 for instance with vm_state deleted and task_state None.
Aug 14 20:28:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-5cf7b649-efed-46c5-9e31-355604ddb41e req-4d350f93-ed89-4eee-8443-f67b478d5997 service nova] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Received event network-vif-deleted-f52a6d15-15d8-4276-a6d8-343ec4b547d8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:28:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:26 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:28:26 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:28:26 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:28:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:28:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:28:26 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:28:26 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:28:26 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updating instance_info_cache with network_info: [{"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:28:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:28:26 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:28:26 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:28:26 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:28:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:27 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:28:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:29 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:28:29 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:28:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:33 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:28:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:34 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:28:36 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:28:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:28:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:28:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:28:36 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:28:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:28:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:28:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:28:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:28:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:36 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692044901.7476506, 1229d145-40ad-487c-8141-60b9cdefc4ab => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:28:36 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] VM Stopped (Lifecycle Event)
Aug 14 20:28:36 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:28:36 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:28:36 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8634MB free_disk=25.285552978515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:28:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:28:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:28:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-e42d9a86-a9ee-4210-b0e7-557b6f9e5a72 None None] [instance: 1229d145-40ad-487c-8141-60b9cdefc4ab] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:28:37 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:28:37 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:28:37 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:28:37 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:28:37 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:28:37 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:28:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:28:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:28:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:29:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:29:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:29:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:29:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:29:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:29:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:29:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:29:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:29:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:29:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:29:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:29:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:29:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:29:15 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:29:15 user nova-compute[72782]: INFO nova.compute.claims [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Claim successful on node user
Aug 14 20:29:15 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:29:15 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:29:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.240s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:29:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:29:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:29:15 user nova-compute[72782]: DEBUG nova.network.neutron [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:29:15 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:29:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:29:15 user nova-compute[72782]: DEBUG nova.policy [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4eedf2578e64fdd8f1a761e5ba1c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc168d9c3794a2e8c7934151ecc3d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:29:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:29:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:29:15 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Creating image(s)
Aug 14 20:29:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "/opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:29:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "/opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:29:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "/opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:29:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "c7a73938604df90d7bb825f338818817a5834b37" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:29:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "c7a73938604df90d7bb825f338818817a5834b37" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:29:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37.part --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:29:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37.part --force-share --output=json" returned: 0 in 0.194s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:29:16 user nova-compute[72782]: DEBUG nova.virt.images [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] 45ede556-d162-4be6-81fe-230e9ee1a1f4 was qcow2, converting to raw {{(pid=72782) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 20:29:16 user nova-compute[72782]: DEBUG nova.privsep.utils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72782) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 20:29:16 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37.part /opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37.converted {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:29:16 user nova-compute[72782]: DEBUG nova.network.neutron [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Successfully created port: 96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:29:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37.part /opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37.converted" returned: 0 in 0.531s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37.converted --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "c7a73938604df90d7bb825f338818817a5834b37" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.362s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37 --force-share --output=json" returned: 0 in 0.220s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "c7a73938604df90d7bb825f338818817a5834b37" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "c7a73938604df90d7bb825f338818817a5834b37" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG nova.network.neutron [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Successfully updated port: 96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquired lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG nova.network.neutron [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG nova.compute.manager [req-ae7fb2db-cde7-464d-a19e-bcf3d0dac8ac req-b40acfbe-0812-4c8e-b52e-be8939d6863d service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received event network-changed-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG nova.compute.manager [req-ae7fb2db-cde7-464d-a19e-bcf3d0dac8ac req-b40acfbe-0812-4c8e-b52e-be8939d6863d service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Refreshing instance network info cache due to event network-changed-96448bcf-3e27-40af-823f-bdd227eb1e67. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ae7fb2db-cde7-464d-a19e-bcf3d0dac8ac req-b40acfbe-0812-4c8e-b52e-be8939d6863d service nova] Acquiring lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37 --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37,backing_fmt=raw /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG nova.network.neutron [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37,backing_fmt=raw /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk 1073741824" returned: 0 in 0.055s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "c7a73938604df90d7bb825f338818817a5834b37" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37 --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 20:29:17 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.network.neutron [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updating instance_info_cache with network_info: [{"id": "96448bcf-3e27-40af-823f-bdd227eb1e67", "address": "fa:16:3e:79:5a:1d", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96448bcf-3e", "ovs_interfaceid": "96448bcf-3e27-40af-823f-bdd227eb1e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Releasing lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Instance network_info: |[{"id": "96448bcf-3e27-40af-823f-bdd227eb1e67", "address": "fa:16:3e:79:5a:1d", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96448bcf-3e", "ovs_interfaceid": "96448bcf-3e27-40af-823f-bdd227eb1e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ae7fb2db-cde7-464d-a19e-bcf3d0dac8ac req-b40acfbe-0812-4c8e-b52e-be8939d6863d service nova] Acquired lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.network.neutron [req-ae7fb2db-cde7-464d-a19e-bcf3d0dac8ac req-b40acfbe-0812-4c8e-b52e-be8939d6863d service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Refreshing network info cache for port 96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Cannot resize image /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.objects.instance [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lazy-loading 'migration_context' on Instance uuid efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Ensure instance console log exists: /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Start _get_guest_xml network_info=[{"id": "96448bcf-3e27-40af-823f-bdd227eb1e67", "address": "fa:16:3e:79:5a:1d", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96448bcf-3e", "ovs_interfaceid": "96448bcf-3e27-40af-823f-bdd227eb1e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T20:29:13Z,direct_url=<?>,disk_format='qcow2',id=45ede556-d162-4be6-81fe-230e9ee1a1f4,min_disk=0,min_ram=0,name='tempest-scenario-img--103057412',owner='9fc168d9c3794a2e8c7934151ecc3d2e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T20:29:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '45ede556-d162-4be6-81fe-230e9ee1a1f4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:29:18 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:29:18 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T20:29:13Z,direct_url=<?>,disk_format='qcow2',id=45ede556-d162-4be6-81fe-230e9ee1a1f4,min_disk=0,min_ram=0,name='tempest-scenario-img--103057412',owner='9fc168d9c3794a2e8c7934151ecc3d2e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T20:29:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-45125061',display_name='tempest-TestMinimumBasicScenario-server-45125061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-45125061',id=44,image_ref='45ede556-d162-4be6-81fe-230e9ee1a1f4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYWCtQPth2WP0eZfEROm1lU/xSlwUhY8VZdk92FxXE43xujZNVYsw+Ff8WW4ED91gWsnLcrODhN2QOWNGqijJ6w8bjbx8RPZ+goA1acGaDkHw9zVdMhYLxKd34VZ9XYqA==',key_name='tempest-TestMinimumBasicScenario-1142682677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fc168d9c3794a2e8c7934151ecc3d2e',ramdisk_id='',reservation_id='r-sk11n0k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='45ede556-d162-4be6-81fe-230e9ee1a1f4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-77953630',owner_user_name='tempest-TestMinimumBasicScenario-77953630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:29:16Z,user_data=None,user_id='f4eedf2578e64fdd8f1a761e5ba1c626',uuid=efe0784c-4af1-4f57-ad3b-b3c21eeb02e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96448bcf-3e27-40af-823f-bdd227eb1e67", "address": "fa:16:3e:79:5a:1d", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96448bcf-3e", "ovs_interfaceid": "96448bcf-3e27-40af-823f-bdd227eb1e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Converting VIF {"id": "96448bcf-3e27-40af-823f-bdd227eb1e67", "address": "fa:16:3e:79:5a:1d", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96448bcf-3e", "ovs_interfaceid": "96448bcf-3e27-40af-823f-bdd227eb1e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:5a:1d,bridge_name='br-int',has_traffic_filtering=True,id=96448bcf-3e27-40af-823f-bdd227eb1e67,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96448bcf-3e') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.objects.instance [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lazy-loading 'pci_devices' on Instance uuid efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:29:18 user nova-compute[72782]:   <uuid>efe0784c-4af1-4f57-ad3b-b3c21eeb02e3</uuid>
Aug 14 20:29:18 user nova-compute[72782]:   <name>instance-0000002c</name>
Aug 14 20:29:18 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:29:18 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:29:18 user nova-compute[72782]:   <metadata>
Aug 14 20:29:18 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:29:18 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:29:18 user nova-compute[72782]:       <nova:name>tempest-TestMinimumBasicScenario-server-45125061</nova:name>
Aug 14 20:29:18 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:29:18</nova:creationTime>
Aug 14 20:29:18 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:29:18 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:29:18 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:29:18 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:29:18 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:29:18 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:29:18 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:29:18 user nova-compute[72782]:       <nova:owner>
Aug 14 20:29:18 user nova-compute[72782]:         <nova:user uuid="f4eedf2578e64fdd8f1a761e5ba1c626">tempest-TestMinimumBasicScenario-77953630-project-member</nova:user>
Aug 14 20:29:18 user nova-compute[72782]:         <nova:project uuid="9fc168d9c3794a2e8c7934151ecc3d2e">tempest-TestMinimumBasicScenario-77953630</nova:project>
Aug 14 20:29:18 user nova-compute[72782]:       </nova:owner>
Aug 14 20:29:18 user nova-compute[72782]:       <nova:root type="image" uuid="45ede556-d162-4be6-81fe-230e9ee1a1f4"/>
Aug 14 20:29:18 user nova-compute[72782]:       <nova:ports>
Aug 14 20:29:18 user nova-compute[72782]:         <nova:port uuid="96448bcf-3e27-40af-823f-bdd227eb1e67">
Aug 14 20:29:18 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 20:29:18 user nova-compute[72782]:         </nova:port>
Aug 14 20:29:18 user nova-compute[72782]:       </nova:ports>
Aug 14 20:29:18 user nova-compute[72782]:     </nova:instance>
Aug 14 20:29:18 user nova-compute[72782]:   </metadata>
Aug 14 20:29:18 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:29:18 user nova-compute[72782]:     <system>
Aug 14 20:29:18 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:29:18 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:29:18 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:29:18 user nova-compute[72782]:       <entry name="serial">efe0784c-4af1-4f57-ad3b-b3c21eeb02e3</entry>
Aug 14 20:29:18 user nova-compute[72782]:       <entry name="uuid">efe0784c-4af1-4f57-ad3b-b3c21eeb02e3</entry>
Aug 14 20:29:18 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:29:18 user nova-compute[72782]:     </system>
Aug 14 20:29:18 user nova-compute[72782]:   </sysinfo>
Aug 14 20:29:18 user nova-compute[72782]:   <os>
Aug 14 20:29:18 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:29:18 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:29:18 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:29:18 user nova-compute[72782]:   </os>
Aug 14 20:29:18 user nova-compute[72782]:   <features>
Aug 14 20:29:18 user nova-compute[72782]:     <acpi/>
Aug 14 20:29:18 user nova-compute[72782]:     <apic/>
Aug 14 20:29:18 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:29:18 user nova-compute[72782]:   </features>
Aug 14 20:29:18 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:29:18 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:29:18 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:29:18 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:29:18 user nova-compute[72782]:   </clock>
Aug 14 20:29:18 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:29:18 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:29:18 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:29:18 user nova-compute[72782]:   </cpu>
Aug 14 20:29:18 user nova-compute[72782]:   <devices>
Aug 14 20:29:18 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:29:18 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:29:18 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk"/>
Aug 14 20:29:18 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:29:18 user nova-compute[72782]:     </disk>
Aug 14 20:29:18 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:29:18 user nova-compute[72782]:       <mac address="fa:16:3e:79:5a:1d"/>
Aug 14 20:29:18 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:29:18 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:29:18 user nova-compute[72782]:       <target dev="tap96448bcf-3e"/>
Aug 14 20:29:18 user nova-compute[72782]:     </interface>
Aug 14 20:29:18 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:29:18 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/console.log" append="off"/>
Aug 14 20:29:18 user nova-compute[72782]:     </serial>
Aug 14 20:29:18 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:29:18 user nova-compute[72782]:     <video>
Aug 14 20:29:18 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:29:18 user nova-compute[72782]:     </video>
Aug 14 20:29:18 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:29:18 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:29:18 user nova-compute[72782]:     </rng>
Aug 14 20:29:18 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:29:18 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:29:18 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:29:18 user nova-compute[72782]:     </memballoon>
Aug 14 20:29:18 user nova-compute[72782]:   </devices>
Aug 14 20:29:18 user nova-compute[72782]: </domain>
Aug 14 20:29:18 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-45125061',display_name='tempest-TestMinimumBasicScenario-server-45125061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-45125061',id=44,image_ref='45ede556-d162-4be6-81fe-230e9ee1a1f4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYWCtQPth2WP0eZfEROm1lU/xSlwUhY8VZdk92FxXE43xujZNVYsw+Ff8WW4ED91gWsnLcrODhN2QOWNGqijJ6w8bjbx8RPZ+goA1acGaDkHw9zVdMhYLxKd34VZ9XYqA==',key_name='tempest-TestMinimumBasicScenario-1142682677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fc168d9c3794a2e8c7934151ecc3d2e',ramdisk_id='',reservation_id='r-sk11n0k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='45ede556-d162-4be6-81fe-230e9ee1a1f4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-77953630',owner_user_name='tempest-TestMinimumBasicScenario-77953630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:29:16Z,user_data=None,user_id='f4eedf2578e64fdd8f1a761e5ba1c626',uuid=efe0784c-4af1-4f57-ad3b-b3c21eeb02e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96448bcf-3e27-40af-823f-bdd227eb1e67", "address": "fa:16:3e:79:5a:1d", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96448bcf-3e", "ovs_interfaceid": "96448bcf-3e27-40af-823f-bdd227eb1e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Converting VIF {"id": "96448bcf-3e27-40af-823f-bdd227eb1e67", "address": "fa:16:3e:79:5a:1d", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96448bcf-3e", "ovs_interfaceid": "96448bcf-3e27-40af-823f-bdd227eb1e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:5a:1d,bridge_name='br-int',has_traffic_filtering=True,id=96448bcf-3e27-40af-823f-bdd227eb1e67,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96448bcf-3e') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG os_vif [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:5a:1d,bridge_name='br-int',has_traffic_filtering=True,id=96448bcf-3e27-40af-823f-bdd227eb1e67,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96448bcf-3e') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96448bcf-3e, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96448bcf-3e, col_values=(('external_ids', {'iface-id': '96448bcf-3e27-40af-823f-bdd227eb1e67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:5a:1d', 'vm-uuid': 'efe0784c-4af1-4f57-ad3b-b3c21eeb02e3'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:18 user nova-compute[72782]: INFO os_vif [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:5a:1d,bridge_name='br-int',has_traffic_filtering=True,id=96448bcf-3e27-40af-823f-bdd227eb1e67,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96448bcf-3e')
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] No VIF found with MAC fa:16:3e:79:5a:1d, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.network.neutron [req-ae7fb2db-cde7-464d-a19e-bcf3d0dac8ac req-b40acfbe-0812-4c8e-b52e-be8939d6863d service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updated VIF entry in instance network info cache for port 96448bcf-3e27-40af-823f-bdd227eb1e67. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG nova.network.neutron [req-ae7fb2db-cde7-464d-a19e-bcf3d0dac8ac req-b40acfbe-0812-4c8e-b52e-be8939d6863d service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updating instance_info_cache with network_info: [{"id": "96448bcf-3e27-40af-823f-bdd227eb1e67", "address": "fa:16:3e:79:5a:1d", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96448bcf-3e", "ovs_interfaceid": "96448bcf-3e27-40af-823f-bdd227eb1e67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:29:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ae7fb2db-cde7-464d-a19e-bcf3d0dac8ac req-b40acfbe-0812-4c8e-b52e-be8939d6863d service nova] Releasing lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:29:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-4a7c2e8c-5bff-4bd1-951a-6ca3e2ef682e req-9e83a40c-4da7-4c4b-b5bb-5b7ff813d176 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received event network-vif-plugged-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:29:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4a7c2e8c-5bff-4bd1-951a-6ca3e2ef682e req-9e83a40c-4da7-4c4b-b5bb-5b7ff813d176 service nova] Acquiring lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:29:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4a7c2e8c-5bff-4bd1-951a-6ca3e2ef682e req-9e83a40c-4da7-4c4b-b5bb-5b7ff813d176 service nova] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:29:19 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4a7c2e8c-5bff-4bd1-951a-6ca3e2ef682e req-9e83a40c-4da7-4c4b-b5bb-5b7ff813d176 service nova] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:29:19 user nova-compute[72782]: DEBUG nova.compute.manager [req-4a7c2e8c-5bff-4bd1-951a-6ca3e2ef682e req-9e83a40c-4da7-4c4b-b5bb-5b7ff813d176 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] No waiting events found dispatching network-vif-plugged-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:29:19 user nova-compute[72782]: WARNING nova.compute.manager [req-4a7c2e8c-5bff-4bd1-951a-6ca3e2ef682e req-9e83a40c-4da7-4c4b-b5bb-5b7ff813d176 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received unexpected event network-vif-plugged-96448bcf-3e27-40af-823f-bdd227eb1e67 for instance with vm_state building and task_state spawning.
Aug 14 20:29:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:21 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:29:21 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044961.7150137, efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:29:21 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] VM Resumed (Lifecycle Event)
Aug 14 20:29:21 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:29:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:29:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Instance spawned successfully.
Aug 14 20:29:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:29:21 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:29:21 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:29:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:29:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:29:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:29:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:29:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:29:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:29:21 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:29:21 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692044961.7193205, efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:29:21 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] VM Started (Lifecycle Event)
Aug 14 20:29:21 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:29:21 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:29:21 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:29:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-bb7bbf4b-755e-4ead-8a0c-dfc8e59b8429 req-e468613b-99a4-4179-b21d-ae7c9a3e44e4 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received event network-vif-plugged-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:29:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bb7bbf4b-755e-4ead-8a0c-dfc8e59b8429 req-e468613b-99a4-4179-b21d-ae7c9a3e44e4 service nova] Acquiring lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:29:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bb7bbf4b-755e-4ead-8a0c-dfc8e59b8429 req-e468613b-99a4-4179-b21d-ae7c9a3e44e4 service nova] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:29:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-bb7bbf4b-755e-4ead-8a0c-dfc8e59b8429 req-e468613b-99a4-4179-b21d-ae7c9a3e44e4 service nova] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:29:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-bb7bbf4b-755e-4ead-8a0c-dfc8e59b8429 req-e468613b-99a4-4179-b21d-ae7c9a3e44e4 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] No waiting events found dispatching network-vif-plugged-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:29:21 user nova-compute[72782]: WARNING nova.compute.manager [req-bb7bbf4b-755e-4ead-8a0c-dfc8e59b8429 req-e468613b-99a4-4179-b21d-ae7c9a3e44e4 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received unexpected event network-vif-plugged-96448bcf-3e27-40af-823f-bdd227eb1e67 for instance with vm_state building and task_state spawning.
Aug 14 20:29:21 user nova-compute[72782]: INFO nova.compute.manager [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Took 5.90 seconds to spawn the instance on the hypervisor.
Aug 14 20:29:21 user nova-compute[72782]: DEBUG nova.compute.manager [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:29:21 user nova-compute[72782]: INFO nova.compute.manager [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Took 6.45 seconds to build instance.
Aug 14 20:29:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-6f4f2cd8-da50-4274-84c1-99b40b55b023 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.537s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:29:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:26 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:29:27 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:29:27 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:29:27 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:29:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:29:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:29:27 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:29:27 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:29:27 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updating instance_info_cache with network_info: [{"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:29:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:29:27 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:29:27 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:29:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:29 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:29:31 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:29:31 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:29:33 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:29:33 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:29:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:29:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:29:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:29:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:29:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:36 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:29:37 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:29:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:29:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:29:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:29:37 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:29:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:29:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:29:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:29:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:29:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:29:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:29:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:29:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:29:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:38 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:29:38 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:29:38 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8593MB free_disk=25.23528289794922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:29:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:29:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:29:38 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:29:38 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:29:38 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:29:38 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:29:38 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:29:38 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:29:38 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:29:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:29:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:29:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-65354a53-d112-4bd3-9c76-215c924fd138 req-4e48db7f-654a-443d-bd4e-10ed07934513 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-changed-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:30:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-65354a53-d112-4bd3-9c76-215c924fd138 req-4e48db7f-654a-443d-bd4e-10ed07934513 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Refreshing instance network info cache due to event network-changed-28c18d55-ae94-446a-a394-f686216e197d. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:30:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-65354a53-d112-4bd3-9c76-215c924fd138 req-4e48db7f-654a-443d-bd4e-10ed07934513 service nova] Acquiring lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:30:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-65354a53-d112-4bd3-9c76-215c924fd138 req-4e48db7f-654a-443d-bd4e-10ed07934513 service nova] Acquired lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:30:00 user nova-compute[72782]: DEBUG nova.network.neutron [req-65354a53-d112-4bd3-9c76-215c924fd138 req-4e48db7f-654a-443d-bd4e-10ed07934513 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Refreshing network info cache for port 28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:30:01 user nova-compute[72782]: DEBUG nova.network.neutron [req-65354a53-d112-4bd3-9c76-215c924fd138 req-4e48db7f-654a-443d-bd4e-10ed07934513 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updated VIF entry in instance network info cache for port 28c18d55-ae94-446a-a394-f686216e197d. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:30:01 user nova-compute[72782]: DEBUG nova.network.neutron [req-65354a53-d112-4bd3-9c76-215c924fd138 req-4e48db7f-654a-443d-bd4e-10ed07934513 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updating instance_info_cache with network_info: [{"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:30:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-65354a53-d112-4bd3-9c76-215c924fd138 req-4e48db7f-654a-443d-bd4e-10ed07934513 service nova] Releasing lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:30:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:30:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:30:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:30:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:30:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:30:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:30:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:30:04 user nova-compute[72782]: DEBUG nova.objects.instance [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'flavor' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:30:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:30:05 user nova-compute[72782]: INFO nova.compute.manager [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Attaching volume 0c004fe6-2e66-4d24-b7d9-91bdd85eba3b to /dev/vdb
Aug 14 20:30:05 user nova-compute[72782]: DEBUG os_brick.utils [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ba92f0-f8f8-4192-a66e-aa97209ca8bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[828aa142-22ba-4b08-96e9-942bbe86dcf9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6bd630-94f2-4b3a-8b04-43d76bffeac9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b777de38-f3a6-4fd4-8d52-06c591886120]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:30:05 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:30:05 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a48ab3-bc32-4ac2-a082-1b374f6d27f0]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG os_brick.utils [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:30:05 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updating existing volume attachment record: 94a5b45c-ede2-4850-9ccd-f1d2e240dcb7 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:30:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvlCkaPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:30:13 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:30:13 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:30:13 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ba8147-68dc-45f4-9cff-0a582ceb4d12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:30:13 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e8b28b-e53e-4dd5-9ac0-41a26d18c6fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b] added
Aug 14 20:30:13 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[447e0677-d18b-4336-8eb9-f6c982875ee1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[57939087-3e76-487d-9c13-365b25fe5a2b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvlCkaPe {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvlCkaPe" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8645b4ed-1c81-4f47-bf62-b5d1557869d7]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uvlCkaPe'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec23ca1-3ae1-454e-bbc3-3ffeb6419939]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7445ee2d-d175-49fc-99cc-947443e1aaf5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:30:13 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:30:13 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:30:13 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 20:30:13 user nova-compute[72782]: 
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[769c3389-362e-4f1b-b198-0bb3c54245f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b, portal: 172.16.0.220,3260]
Aug 14 20:30:13 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b, portal: 172.16.0.220,3260] successful.
Aug 14 20:30:13 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b2876d-74b6-4615-9d8c-302aa09c6547]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be23725-4c7a-4abd-8d89-72ef20864d88]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)
Aug 14 20:30:13 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)
Aug 14 20:30:13 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[15342164-5d95-444b-9cb0-2461118337e9]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:30:13 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:30:14 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:30:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvlCkaPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:30:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:30:14 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23631636466396237', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:30:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631636466396237', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:30:14 user nova-compute[72782]: DEBUG nova.objects.instance [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'flavor' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:30:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 20:30:14 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:30:14 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:30:14 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:30:14 user nova-compute[72782]:   <serial>0c004fe6-2e66-4d24-b7d9-91bdd85eba3b</serial>
Aug 14 20:30:14 user nova-compute[72782]: </disk>
Aug 14 20:30:14 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 20:30:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:30:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:30:15 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] No VIF found with MAC fa:16:3e:24:a9:dc, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:30:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-3abb1a5a-e34d-439a-ba88-c04e5ebbc18e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.317s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:30:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-68ac52f1-4f74-48f8-a32c-1146e787607d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:30:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-68ac52f1-4f74-48f8-a32c-1146e787607d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:30:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-68ac52f1-4f74-48f8-a32c-1146e787607d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:30:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-68ac52f1-4f74-48f8-a32c-1146e787607d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72782) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 14 20:30:15 user nova-compute[72782]: DEBUG nova.objects.instance [None req-68ac52f1-4f74-48f8-a32c-1146e787607d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'flavor' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:30:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:16 user nova-compute[72782]: DEBUG nova.compute.manager [req-c2e6f16a-2fce-4433-80ac-8675eeaea4fd req-8d00fda1-11f1-4c80-8d57-2a91b958ad20 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-vif-unplugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:30:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c2e6f16a-2fce-4433-80ac-8675eeaea4fd req-8d00fda1-11f1-4c80-8d57-2a91b958ad20 service nova] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:30:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c2e6f16a-2fce-4433-80ac-8675eeaea4fd req-8d00fda1-11f1-4c80-8d57-2a91b958ad20 service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:30:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-c2e6f16a-2fce-4433-80ac-8675eeaea4fd req-8d00fda1-11f1-4c80-8d57-2a91b958ad20 service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:30:16 user nova-compute[72782]: DEBUG nova.compute.manager [req-c2e6f16a-2fce-4433-80ac-8675eeaea4fd req-8d00fda1-11f1-4c80-8d57-2a91b958ad20 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] No waiting events found dispatching network-vif-unplugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:30:16 user nova-compute[72782]: WARNING nova.compute.manager [req-c2e6f16a-2fce-4433-80ac-8675eeaea4fd req-8d00fda1-11f1-4c80-8d57-2a91b958ad20 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received unexpected event network-vif-unplugged-28c18d55-ae94-446a-a394-f686216e197d for instance with vm_state active and task_state powering-off.
Aug 14 20:30:16 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Instance destroyed successfully.
Aug 14 20:30:16 user nova-compute[72782]: DEBUG nova.compute.manager [None req-68ac52f1-4f74-48f8-a32c-1146e787607d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:30:16 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-68ac52f1-4f74-48f8-a32c-1146e787607d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.858s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:30:18 user nova-compute[72782]: DEBUG nova.compute.manager [req-79904513-a46f-414d-8514-ff2741e805c4 req-ceffd3b0-87e4-42f3-91b0-cba1de41bbbe service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:30:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-79904513-a46f-414d-8514-ff2741e805c4 req-ceffd3b0-87e4-42f3-91b0-cba1de41bbbe service nova] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:30:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-79904513-a46f-414d-8514-ff2741e805c4 req-ceffd3b0-87e4-42f3-91b0-cba1de41bbbe service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:30:18 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-79904513-a46f-414d-8514-ff2741e805c4 req-ceffd3b0-87e4-42f3-91b0-cba1de41bbbe service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:30:18 user nova-compute[72782]: DEBUG nova.compute.manager [req-79904513-a46f-414d-8514-ff2741e805c4 req-ceffd3b0-87e4-42f3-91b0-cba1de41bbbe service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] No waiting events found dispatching network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:30:18 user nova-compute[72782]: WARNING nova.compute.manager [req-79904513-a46f-414d-8514-ff2741e805c4 req-ceffd3b0-87e4-42f3-91b0-cba1de41bbbe service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received unexpected event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d for instance with vm_state stopped and task_state None.
Aug 14 20:30:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:23 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:30:27 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:30:27 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:30:28 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:30:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:30:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:30:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:30:28 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:30:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:30:28 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updating instance_info_cache with network_info: [{"id": "96448bcf-3e27-40af-823f-bdd227eb1e67", "address": "fa:16:3e:79:5a:1d", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96448bcf-3e", "ovs_interfaceid": "96448bcf-3e27-40af-823f-bdd227eb1e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:30:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:30:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:30:30 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:30:31 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692045016.7109327, 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:30:31 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] VM Stopped (Lifecycle Event)
Aug 14 20:30:31 user nova-compute[72782]: DEBUG nova.compute.manager [None req-67a14c0b-dc5d-4018-9e7e-69b799cc3d45 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:30:31 user nova-compute[72782]: DEBUG nova.compute.manager [None req-67a14c0b-dc5d-4018-9e7e-69b799cc3d45 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:30:32 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:30:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:30:33 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:30:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:30:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:36 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:30:38 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:30:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:30:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:30:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:30:38 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:30:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:30:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:30:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:30:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:30:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:30:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:30:39 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:30:39 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:30:39 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8697MB free_disk=25.232501983642578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:30:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:30:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:30:39 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:30:39 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:30:39 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:30:39 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:30:39 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:30:39 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:30:39 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:30:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:30:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:30:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:30:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:30:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:30:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:30:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:30:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:31:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:31:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:31:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:31:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:31:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:31:09 user nova-compute[72782]: DEBUG nova.objects.instance [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lazy-loading 'flavor' on Instance uuid efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:31:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:31:10 user nova-compute[72782]: INFO nova.compute.manager [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Attaching volume 9f8aff08-811c-4289-a7c5-586a422a42fe to /dev/vdb
Aug 14 20:31:10 user nova-compute[72782]: DEBUG os_brick.utils [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[130ee5e2-bc61-4d87-b7e1-862d6336bef8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2ccdbe-dc0d-492b-a13d-93944feffb76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4102f80e-77b0-420e-84dd-1443d57db9f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b81c6f-2980-47ec-aa2b-0de548b39885]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:31:10 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:31:10 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd82619-e6b6-4d75-831b-2868ebb60a12]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG os_brick.utils [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:31:10 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updating existing volume attachment record: f7ba1a20-a004-4543-8334-9270d1c7170f {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:31:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:31:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:31:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:31:23 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFpEfmCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:31:24 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:31:24 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:31:24 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35f1012-b3ba-4c68-ad96-aaaf4a13a746]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:31:24 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[28de456f-e972-487a-89e3-0600270e8e94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe] added
Aug 14 20:31:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c102ea5-91f9-46a3-ad06-2af2cdecf7ed]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c464c23b-7cb6-49e5-8f50-315c69c4c786]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gFpEfmCi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gFpEfmCi" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[365af27b-e712-4969-b288-50e9cb9574c1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gFpEfmCi'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6c7821-296a-485d-aefe-ad48f6467294]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eab4ffd-5aff-4c1e-8276-bda71c8b29bc]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)
Aug 14 20:31:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)
Aug 14 20:31:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d58331-1535-4739-87bc-d1b1fd0f1e01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe, portal: 172.16.0.220,3260]
Aug 14 20:31:24 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe, portal: 172.16.0.220,3260] successful.
Aug 14 20:31:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c02254-0564-4f20-a320-40e341261d06]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0309e141-edba-4cda-9122-35a796a270a7]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)
Aug 14 20:31:24 user nova-compute[72782]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe (non-flash)
Aug 14 20:31:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)
Aug 14 20:31:24 user nova-compute[72782]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe (non-flash)
Aug 14 20:31:24 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d28b81-c986-49d3-b714-d64f9fae68a6]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:31:24 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFpEfmCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:31:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:31:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26638353239393032', 'path': '/dev/sdc'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:31:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638353239393032', 'path': '/dev/sdc'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:31:25 user nova-compute[72782]: DEBUG nova.objects.instance [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lazy-loading 'flavor' on Instance uuid efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:31:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 20:31:25 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:31:25 user nova-compute[72782]:   <source dev="/dev/sdc"/>
Aug 14 20:31:25 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:31:25 user nova-compute[72782]:   <serial>9f8aff08-811c-4289-a7c5-586a422a42fe</serial>
Aug 14 20:31:25 user nova-compute[72782]: </disk>
Aug 14 20:31:25 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 20:31:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:31:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:31:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] No VIF found with MAC fa:16:3e:79:5a:1d, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:31:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-23821742-2662-4bcd-9277-363128a6c904 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.535s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:31:27 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:31:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:29 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:31:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-674ee27e-915f-40d7-bd99-1efad7f817fb req-5d3c048e-6f20-49b5-8e2a-d90042dbb481 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received event network-changed-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:31:29 user nova-compute[72782]: DEBUG nova.compute.manager [req-674ee27e-915f-40d7-bd99-1efad7f817fb req-5d3c048e-6f20-49b5-8e2a-d90042dbb481 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Refreshing instance network info cache due to event network-changed-96448bcf-3e27-40af-823f-bdd227eb1e67. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:31:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-674ee27e-915f-40d7-bd99-1efad7f817fb req-5d3c048e-6f20-49b5-8e2a-d90042dbb481 service nova] Acquiring lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:31:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-674ee27e-915f-40d7-bd99-1efad7f817fb req-5d3c048e-6f20-49b5-8e2a-d90042dbb481 service nova] Acquired lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:31:29 user nova-compute[72782]: DEBUG nova.network.neutron [req-674ee27e-915f-40d7-bd99-1efad7f817fb req-5d3c048e-6f20-49b5-8e2a-d90042dbb481 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Refreshing network info cache for port 96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:31:29 user nova-compute[72782]: DEBUG nova.network.neutron [req-674ee27e-915f-40d7-bd99-1efad7f817fb req-5d3c048e-6f20-49b5-8e2a-d90042dbb481 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updated VIF entry in instance network info cache for port 96448bcf-3e27-40af-823f-bdd227eb1e67. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:31:29 user nova-compute[72782]: DEBUG nova.network.neutron [req-674ee27e-915f-40d7-bd99-1efad7f817fb req-5d3c048e-6f20-49b5-8e2a-d90042dbb481 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updating instance_info_cache with network_info: [{"id": "96448bcf-3e27-40af-823f-bdd227eb1e67", "address": "fa:16:3e:79:5a:1d", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96448bcf-3e", "ovs_interfaceid": "96448bcf-3e27-40af-823f-bdd227eb1e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:31:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-674ee27e-915f-40d7-bd99-1efad7f817fb req-5d3c048e-6f20-49b5-8e2a-d90042dbb481 service nova] Releasing lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:31:30 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:31:30 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:31:30 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:31:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:31:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:31:30 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:31:30 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:31:30 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updating instance_info_cache with network_info: [{"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:31:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:31:30 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:31:31 user nova-compute[72782]: DEBUG nova.compute.manager [req-b84be9ff-c37a-467b-aba9-5af93ab2b4ad req-110a0028-1939-43f3-93bc-a57e903bdcac service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received event network-changed-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:31:31 user nova-compute[72782]: DEBUG nova.compute.manager [req-b84be9ff-c37a-467b-aba9-5af93ab2b4ad req-110a0028-1939-43f3-93bc-a57e903bdcac service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Refreshing instance network info cache due to event network-changed-96448bcf-3e27-40af-823f-bdd227eb1e67. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:31:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b84be9ff-c37a-467b-aba9-5af93ab2b4ad req-110a0028-1939-43f3-93bc-a57e903bdcac service nova] Acquiring lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:31:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b84be9ff-c37a-467b-aba9-5af93ab2b4ad req-110a0028-1939-43f3-93bc-a57e903bdcac service nova] Acquired lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:31:31 user nova-compute[72782]: DEBUG nova.network.neutron [req-b84be9ff-c37a-467b-aba9-5af93ab2b4ad req-110a0028-1939-43f3-93bc-a57e903bdcac service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Refreshing network info cache for port 96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:31:31 user nova-compute[72782]: DEBUG nova.network.neutron [req-b84be9ff-c37a-467b-aba9-5af93ab2b4ad req-110a0028-1939-43f3-93bc-a57e903bdcac service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updated VIF entry in instance network info cache for port 96448bcf-3e27-40af-823f-bdd227eb1e67. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:31:31 user nova-compute[72782]: DEBUG nova.network.neutron [req-b84be9ff-c37a-467b-aba9-5af93ab2b4ad req-110a0028-1939-43f3-93bc-a57e903bdcac service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updating instance_info_cache with network_info: [{"id": "96448bcf-3e27-40af-823f-bdd227eb1e67", "address": "fa:16:3e:79:5a:1d", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96448bcf-3e", "ovs_interfaceid": "96448bcf-3e27-40af-823f-bdd227eb1e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:31:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e5aa0ef3-077b-419c-a913-ba6cd52cbac0 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:31:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e5aa0ef3-077b-419c-a913-ba6cd52cbac0 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:31:31 user nova-compute[72782]: INFO nova.compute.manager [None req-e5aa0ef3-077b-419c-a913-ba6cd52cbac0 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Rebooting instance
Aug 14 20:31:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b84be9ff-c37a-467b-aba9-5af93ab2b4ad req-110a0028-1939-43f3-93bc-a57e903bdcac service nova] Releasing lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:31:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e5aa0ef3-077b-419c-a913-ba6cd52cbac0 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:31:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e5aa0ef3-077b-419c-a913-ba6cd52cbac0 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquired lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:31:32 user nova-compute[72782]: DEBUG nova.network.neutron [None req-e5aa0ef3-077b-419c-a913-ba6cd52cbac0 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:31:32 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:31:32 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:31:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:31:32 user nova-compute[72782]: DEBUG nova.network.neutron [None req-e5aa0ef3-077b-419c-a913-ba6cd52cbac0 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updating instance_info_cache with network_info: [{"id": "96448bcf-3e27-40af-823f-bdd227eb1e67", "address": "fa:16:3e:79:5a:1d", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96448bcf-3e", "ovs_interfaceid": "96448bcf-3e27-40af-823f-bdd227eb1e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:31:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e5aa0ef3-077b-419c-a913-ba6cd52cbac0 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Releasing lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:31:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-e5aa0ef3-077b-419c-a913-ba6cd52cbac0 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:31:33 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:31:33 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:31:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:31:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:31:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:31:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:31:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:34 user nova-compute[72782]: DEBUG nova.compute.manager [req-8145d20d-0970-4e7e-8654-59796e5be5ee req-6b937531-62b4-44db-9f0a-fc792ab61e7a service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received event network-vif-unplugged-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:31:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8145d20d-0970-4e7e-8654-59796e5be5ee req-6b937531-62b4-44db-9f0a-fc792ab61e7a service nova] Acquiring lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:31:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8145d20d-0970-4e7e-8654-59796e5be5ee req-6b937531-62b4-44db-9f0a-fc792ab61e7a service nova] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:31:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8145d20d-0970-4e7e-8654-59796e5be5ee req-6b937531-62b4-44db-9f0a-fc792ab61e7a service nova] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:31:34 user nova-compute[72782]: DEBUG nova.compute.manager [req-8145d20d-0970-4e7e-8654-59796e5be5ee req-6b937531-62b4-44db-9f0a-fc792ab61e7a service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] No waiting events found dispatching network-vif-unplugged-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:31:34 user nova-compute[72782]: WARNING nova.compute.manager [req-8145d20d-0970-4e7e-8654-59796e5be5ee req-6b937531-62b4-44db-9f0a-fc792ab61e7a service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received unexpected event network-vif-unplugged-96448bcf-3e27-40af-823f-bdd227eb1e67 for instance with vm_state active and task_state reboot_started.
Aug 14 20:31:35 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-e5aa0ef3-077b-419c-a913-ba6cd52cbac0 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Instance shutdown successfully.
Aug 14 20:31:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-7a357082-44cd-4c68-9cf4-d131b1cc0ea4 req-33cfa566-7842-40ba-a179-0a80427edc53 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received event network-vif-plugged-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:31:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7a357082-44cd-4c68-9cf4-d131b1cc0ea4 req-33cfa566-7842-40ba-a179-0a80427edc53 service nova] Acquiring lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:31:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7a357082-44cd-4c68-9cf4-d131b1cc0ea4 req-33cfa566-7842-40ba-a179-0a80427edc53 service nova] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:31:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7a357082-44cd-4c68-9cf4-d131b1cc0ea4 req-33cfa566-7842-40ba-a179-0a80427edc53 service nova] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:31:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-7a357082-44cd-4c68-9cf4-d131b1cc0ea4 req-33cfa566-7842-40ba-a179-0a80427edc53 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] No waiting events found dispatching network-vif-plugged-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:31:36 user nova-compute[72782]: WARNING nova.compute.manager [req-7a357082-44cd-4c68-9cf4-d131b1cc0ea4 req-33cfa566-7842-40ba-a179-0a80427edc53 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received unexpected event network-vif-plugged-96448bcf-3e27-40af-823f-bdd227eb1e67 for instance with vm_state active and task_state reboot_started.
Aug 14 20:31:37 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:31:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Removed pending event for efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 due to event {{(pid=72782) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 20:31:38 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692045098.9230835, efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:31:38 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] VM Resumed (Lifecycle Event)
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-190b20a4-d15d-4edc-9ca5-442f560db521 req-71124d00-d9a8-480f-b14c-b16dde75e12e service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received event network-vif-plugged-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-190b20a4-d15d-4edc-9ca5-442f560db521 req-71124d00-d9a8-480f-b14c-b16dde75e12e service nova] Acquiring lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-190b20a4-d15d-4edc-9ca5-442f560db521 req-71124d00-d9a8-480f-b14c-b16dde75e12e service nova] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-190b20a4-d15d-4edc-9ca5-442f560db521 req-71124d00-d9a8-480f-b14c-b16dde75e12e service nova] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-190b20a4-d15d-4edc-9ca5-442f560db521 req-71124d00-d9a8-480f-b14c-b16dde75e12e service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] No waiting events found dispatching network-vif-plugged-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:31:39 user nova-compute[72782]: WARNING nova.compute.manager [req-190b20a4-d15d-4edc-9ca5-442f560db521 req-71124d00-d9a8-480f-b14c-b16dde75e12e service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received unexpected event network-vif-plugged-96448bcf-3e27-40af-823f-bdd227eb1e67 for instance with vm_state active and task_state reboot_started.
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-190b20a4-d15d-4edc-9ca5-442f560db521 req-71124d00-d9a8-480f-b14c-b16dde75e12e service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received event network-vif-plugged-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-190b20a4-d15d-4edc-9ca5-442f560db521 req-71124d00-d9a8-480f-b14c-b16dde75e12e service nova] Acquiring lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-190b20a4-d15d-4edc-9ca5-442f560db521 req-71124d00-d9a8-480f-b14c-b16dde75e12e service nova] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-190b20a4-d15d-4edc-9ca5-442f560db521 req-71124d00-d9a8-480f-b14c-b16dde75e12e service nova] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-190b20a4-d15d-4edc-9ca5-442f560db521 req-71124d00-d9a8-480f-b14c-b16dde75e12e service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] No waiting events found dispatching network-vif-plugged-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:31:39 user nova-compute[72782]: WARNING nova.compute.manager [req-190b20a4-d15d-4edc-9ca5-442f560db521 req-71124d00-d9a8-480f-b14c-b16dde75e12e service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received unexpected event network-vif-plugged-96448bcf-3e27-40af-823f-bdd227eb1e67 for instance with vm_state active and task_state reboot_started.
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:31:39 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Instance running successfully.
Aug 14 20:31:39 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-e5aa0ef3-077b-419c-a913-ba6cd52cbac0 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Instance soft rebooted successfully.
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-e5aa0ef3-077b-419c-a913-ba6cd52cbac0 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:31:39 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:31:39 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8772MB free_disk=25.230857849121094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:31:39 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692045098.9249947, efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:31:39 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] VM Started (Lifecycle Event)
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-e5aa0ef3-077b-419c-a913-ba6cd52cbac0 tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.414s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing inventories for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating ProviderTree inventory for provider d26c9e3b-40e6-476e-9664-3119ebf5873b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing aggregate associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, aggregates: None {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing trait associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 20:31:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] There are 0 instances to clean {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 20:31:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:47 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:31:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:56 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:31:56 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 20:31:56 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 20:31:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:31:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:31:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:31:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:31:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:31:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:31:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:31:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:03 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:32:03 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72782) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 20:32:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:06 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'flavor' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:32:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:32:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquired lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:32:06 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:32:06 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'info_cache' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updating instance_info_cache with network_info: [{"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Releasing lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:32:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Instance destroyed successfully.
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'resources' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:28:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1438697692',display_name='tempest-AttachVolumeTestJSON-server-1438697692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1438697692',id=43,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIZMdrvcAObDrQOnw6Z4cKMh8UkLd6T6hnSQkZurL1/AHHX+HwCM+yXwzFIxmNtn58wn91JRRMK8D/OvNJqPJOxQJGzDkEoynLrq1UHzUwGYj+LHuUngHZijLDOQbeXkw==',key_name='tempest-keypair-314886705',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:28:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='21ca996ad34a4a55994ae92a688f349f',ramdisk_id='',reservation_id='r-kxmp5hcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-434447893',owner_user_name='tempest-AttachVolumeTestJSON-434447893-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:30:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeb23a424fd4eabb174c5630f36956d',uuid=1ddcf095-6362-4b8f-82a1-e39eb6aa6661,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converting VIF {"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_vif [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28c18d55-ae, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:32:07 user nova-compute[72782]: INFO os_vif [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae')
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvlCkaPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:32:07 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e84d71-6fb1-44e2-a21c-e788725ba60e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6988ed7-630e-437d-8c1d-c583fb4f093a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)
Aug 14 20:32:07 user nova-compute[72782]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe (non-flash)
Aug 14 20:32:07 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)
Aug 14 20:32:07 user nova-compute[72782]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe (non-flash)
Aug 14 20:32:07 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f64084d04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4606f4bb-d485-455e-b075-ea2c20c9665a]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a38c9f6-0582-4c17-9214-4ac56dc0521f]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0385b04d-c697-40df-99c0-b2261e565438]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcfc456-4f37-42d5-a85a-89cd5058e959]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c806172b-ccba-4ef7-a401-58050e4f1feb]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ddb41c-1d9a-47cd-a637-687e8c9af204]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b, portal: 172.16.0.220,3260]
Aug 14 20:32:07 user nova-compute[72782]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b, portal: 172.16.0.220,3260] successful.
Aug 14 20:32:07 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1000363-1761-4a2d-a43a-3288bad02dfc]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] <== disconnect_volume: return (285ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Start _get_guest_xml network_info=[{"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '94a5b45c-ede2-4850-9ccd-f1d2e240dcb7', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvlCkaPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1ddcf095-6362-4b8f-82a1-e39eb6aa6661', 'attached_at': '', 'detached_at': '', 'volume_id': '0c004fe6-2e66-4d24-b7d9-91bdd85eba3b', 'serial': '0c004fe6-2e66-4d24-b7d9-91bdd85eba3b'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'numa_topology' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:32:07 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:32:07 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvlCkaPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:32:07 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:32:07 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:32:07 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8e2f43-d09f-4885-995f-91ddebde9b6a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:32:07 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3df260-9beb-44a4-85a7-4868450b0ba3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b] added
Aug 14 20:32:07 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb9fac3-132d-4f3f-8148-a8e0c926fb55]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b1ce4a-63ce-48d2-b2fc-a3810a06f70a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvlCkaPe {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvlCkaPe" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9d8eb4-6b39-405e-9a45-2b78952ec956]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uvlCkaPe'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9fd9e2-79e5-4b7d-86bc-5af6c1f42625]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3e99fe-e84a-44ce-b25f-820b9582c627]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe (non-flash)
Aug 14 20:32:07 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe (non-flash)
Aug 14 20:32:07 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e01ec4c-606d-47da-93f0-cf546e4ae952]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b, portal: 172.16.0.220,3260]
Aug 14 20:32:07 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b, portal: 172.16.0.220,3260] successful.
Aug 14 20:32:07 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3bfb4e-3e09-4ac4-a182-8beebaf33fb4]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a866d69-0c8c-4ad0-a810-bd45976560d5]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe (non-flash)
Aug 14 20:32:07 user nova-compute[72782]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)
Aug 14 20:32:07 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe (non-flash)
Aug 14 20:32:07 user nova-compute[72782]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)
Aug 14 20:32:07 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:32:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:08 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[91549c84-8d5b-4764-8dcd-4d3791decbff]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:32:08 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:32:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvlCkaPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23631636466396237', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631636466396237', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:28:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1438697692',display_name='tempest-AttachVolumeTestJSON-server-1438697692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1438697692',id=43,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIZMdrvcAObDrQOnw6Z4cKMh8UkLd6T6hnSQkZurL1/AHHX+HwCM+yXwzFIxmNtn58wn91JRRMK8D/OvNJqPJOxQJGzDkEoynLrq1UHzUwGYj+LHuUngHZijLDOQbeXkw==',key_name='tempest-keypair-314886705',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:28:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='21ca996ad34a4a55994ae92a688f349f',ramdisk_id='',reservation_id='r-kxmp5hcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-434447893',owner_user_name='tempest-AttachVolumeTestJSON-434447893-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:30:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeb23a424fd4eabb174c5630f36956d',uuid=1ddcf095-6362-4b8f-82a1-e39eb6aa6661,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converting VIF {"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:32:09 user nova-compute[72782]:   <uuid>1ddcf095-6362-4b8f-82a1-e39eb6aa6661</uuid>
Aug 14 20:32:09 user nova-compute[72782]:   <name>instance-0000002b</name>
Aug 14 20:32:09 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:32:09 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:32:09 user nova-compute[72782]:   <metadata>
Aug 14 20:32:09 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:32:09 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:32:09 user nova-compute[72782]:       <nova:name>tempest-AttachVolumeTestJSON-server-1438697692</nova:name>
Aug 14 20:32:09 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:32:07</nova:creationTime>
Aug 14 20:32:09 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:32:09 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:32:09 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:32:09 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:32:09 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:32:09 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:32:09 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:32:09 user nova-compute[72782]:       <nova:owner>
Aug 14 20:32:09 user nova-compute[72782]:         <nova:user uuid="7aeb23a424fd4eabb174c5630f36956d">tempest-AttachVolumeTestJSON-434447893-project-member</nova:user>
Aug 14 20:32:09 user nova-compute[72782]:         <nova:project uuid="21ca996ad34a4a55994ae92a688f349f">tempest-AttachVolumeTestJSON-434447893</nova:project>
Aug 14 20:32:09 user nova-compute[72782]:       </nova:owner>
Aug 14 20:32:09 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 20:32:09 user nova-compute[72782]:       <nova:ports>
Aug 14 20:32:09 user nova-compute[72782]:         <nova:port uuid="28c18d55-ae94-446a-a394-f686216e197d">
Aug 14 20:32:09 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 20:32:09 user nova-compute[72782]:         </nova:port>
Aug 14 20:32:09 user nova-compute[72782]:       </nova:ports>
Aug 14 20:32:09 user nova-compute[72782]:     </nova:instance>
Aug 14 20:32:09 user nova-compute[72782]:   </metadata>
Aug 14 20:32:09 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:32:09 user nova-compute[72782]:     <system>
Aug 14 20:32:09 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:32:09 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:32:09 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:32:09 user nova-compute[72782]:       <entry name="serial">1ddcf095-6362-4b8f-82a1-e39eb6aa6661</entry>
Aug 14 20:32:09 user nova-compute[72782]:       <entry name="uuid">1ddcf095-6362-4b8f-82a1-e39eb6aa6661</entry>
Aug 14 20:32:09 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:32:09 user nova-compute[72782]:     </system>
Aug 14 20:32:09 user nova-compute[72782]:   </sysinfo>
Aug 14 20:32:09 user nova-compute[72782]:   <os>
Aug 14 20:32:09 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:32:09 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:32:09 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:32:09 user nova-compute[72782]:   </os>
Aug 14 20:32:09 user nova-compute[72782]:   <features>
Aug 14 20:32:09 user nova-compute[72782]:     <acpi/>
Aug 14 20:32:09 user nova-compute[72782]:     <apic/>
Aug 14 20:32:09 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:32:09 user nova-compute[72782]:   </features>
Aug 14 20:32:09 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:32:09 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:32:09 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:32:09 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:32:09 user nova-compute[72782]:   </clock>
Aug 14 20:32:09 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:32:09 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:32:09 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:32:09 user nova-compute[72782]:   </cpu>
Aug 14 20:32:09 user nova-compute[72782]:   <devices>
Aug 14 20:32:09 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:32:09 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:32:09 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk"/>
Aug 14 20:32:09 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:32:09 user nova-compute[72782]:     </disk>
Aug 14 20:32:09 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 20:32:09 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:32:09 user nova-compute[72782]:       <source dev="/dev/sdb"/>
Aug 14 20:32:09 user nova-compute[72782]:       <target dev="vdb" bus="virtio"/>
Aug 14 20:32:09 user nova-compute[72782]:       <serial>0c004fe6-2e66-4d24-b7d9-91bdd85eba3b</serial>
Aug 14 20:32:09 user nova-compute[72782]:     </disk>
Aug 14 20:32:09 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:32:09 user nova-compute[72782]:       <mac address="fa:16:3e:24:a9:dc"/>
Aug 14 20:32:09 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:32:09 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:32:09 user nova-compute[72782]:       <target dev="tap28c18d55-ae"/>
Aug 14 20:32:09 user nova-compute[72782]:     </interface>
Aug 14 20:32:09 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:32:09 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/console.log" append="off"/>
Aug 14 20:32:09 user nova-compute[72782]:     </serial>
Aug 14 20:32:09 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:32:09 user nova-compute[72782]:     <video>
Aug 14 20:32:09 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:32:09 user nova-compute[72782]:     </video>
Aug 14 20:32:09 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:32:09 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:32:09 user nova-compute[72782]:     </rng>
Aug 14 20:32:09 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:32:09 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:32:09 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:32:09 user nova-compute[72782]:     </memballoon>
Aug 14 20:32:09 user nova-compute[72782]:   </devices>
Aug 14 20:32:09 user nova-compute[72782]: </domain>
Aug 14 20:32:09 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Cannot resize image /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'migration_context' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:28:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1438697692',display_name='tempest-AttachVolumeTestJSON-server-1438697692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1438697692',id=43,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIZMdrvcAObDrQOnw6Z4cKMh8UkLd6T6hnSQkZurL1/AHHX+HwCM+yXwzFIxmNtn58wn91JRRMK8D/OvNJqPJOxQJGzDkEoynLrq1UHzUwGYj+LHuUngHZijLDOQbeXkw==',key_name='tempest-keypair-314886705',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:28:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='21ca996ad34a4a55994ae92a688f349f',ramdisk_id='',reservation_id='r-kxmp5hcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-434447893',owner_user_name='tempest-AttachVolumeTestJSON-434447893-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:30:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeb23a424fd4eabb174c5630f36956d',uuid=1ddcf095-6362-4b8f-82a1-e39eb6aa6661,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converting VIF {"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG os_vif [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28c18d55-ae, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28c18d55-ae, col_values=(('external_ids', {'iface-id': '28c18d55-ae94-446a-a394-f686216e197d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:a9:dc', 'vm-uuid': '1ddcf095-6362-4b8f-82a1-e39eb6aa6661'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:32:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:09 user nova-compute[72782]: INFO os_vif [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae')
Aug 14 20:32:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-565635fa-b366-4a53-b55a-3dc6758a6ea9 req-b14b5584-650a-40d4-98ee-4e7bbfb46c17 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:32:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-565635fa-b366-4a53-b55a-3dc6758a6ea9 req-b14b5584-650a-40d4-98ee-4e7bbfb46c17 service nova] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:32:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-565635fa-b366-4a53-b55a-3dc6758a6ea9 req-b14b5584-650a-40d4-98ee-4e7bbfb46c17 service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:32:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-565635fa-b366-4a53-b55a-3dc6758a6ea9 req-b14b5584-650a-40d4-98ee-4e7bbfb46c17 service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:32:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-565635fa-b366-4a53-b55a-3dc6758a6ea9 req-b14b5584-650a-40d4-98ee-4e7bbfb46c17 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] No waiting events found dispatching network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:32:11 user nova-compute[72782]: WARNING nova.compute.manager [req-565635fa-b366-4a53-b55a-3dc6758a6ea9 req-b14b5584-650a-40d4-98ee-4e7bbfb46c17 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received unexpected event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d for instance with vm_state stopped and task_state powering-on.
Aug 14 20:32:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:13 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692045133.2874904, 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:32:13 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] VM Resumed (Lifecycle Event)
Aug 14 20:32:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:32:13 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Instance rebooted successfully.
Aug 14 20:32:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5dd1f4df-f0a4-4b8d-ba67-2e5e710bc35d tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:32:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:32:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:32:13 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 14 20:32:13 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692045133.2910464, 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:32:13 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] VM Started (Lifecycle Event)
Aug 14 20:32:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:32:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:32:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-629fb4ed-6479-4d3b-99c3-f3aebcea32c4 req-32986375-a4e0-4389-9d46-1442057afcd6 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:32:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-629fb4ed-6479-4d3b-99c3-f3aebcea32c4 req-32986375-a4e0-4389-9d46-1442057afcd6 service nova] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:32:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-629fb4ed-6479-4d3b-99c3-f3aebcea32c4 req-32986375-a4e0-4389-9d46-1442057afcd6 service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:32:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-629fb4ed-6479-4d3b-99c3-f3aebcea32c4 req-32986375-a4e0-4389-9d46-1442057afcd6 service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:32:13 user nova-compute[72782]: DEBUG nova.compute.manager [req-629fb4ed-6479-4d3b-99c3-f3aebcea32c4 req-32986375-a4e0-4389-9d46-1442057afcd6 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] No waiting events found dispatching network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:32:13 user nova-compute[72782]: WARNING nova.compute.manager [req-629fb4ed-6479-4d3b-99c3-f3aebcea32c4 req-32986375-a4e0-4389-9d46-1442057afcd6 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received unexpected event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d for instance with vm_state active and task_state None.
Aug 14 20:32:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:32:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:32:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:32:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:32:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:24 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:32:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:32:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:32:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:32:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:32:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:32:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:27 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:32:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:29 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:32:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:30 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:32:30 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:32:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:32:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:32:30 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:32:30 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updating instance_info_cache with network_info: [{"id": "96448bcf-3e27-40af-823f-bdd227eb1e67", "address": "fa:16:3e:79:5a:1d", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96448bcf-3e", "ovs_interfaceid": "96448bcf-3e27-40af-823f-bdd227eb1e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:32:30 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:32:30 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:32:32 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:32:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:32:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:34 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:32:34 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:32:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:37 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:32:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:39 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:32:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:32:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:32:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:32:39 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:32:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:32:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:32:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:32:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:32:40 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:32:40 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:32:40 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8614MB free_disk=25.221080780029297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:32:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:32:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:32:40 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:32:40 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:32:40 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:32:40 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:32:40 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:32:40 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:32:40 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:32:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:32:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:32:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:32:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:32:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:32:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:32:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:32:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:32:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:32:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:32:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:32:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:32:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:32:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:32:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:32:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:33:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:33:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:33:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:33:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:33:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:33:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:33:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:33:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:33:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:33:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:33:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:33:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:33:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:33:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:33:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:33:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:33:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:33:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:33:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:33:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:33:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:33:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-1826be0d-418b-4ba6-8865-43a5f7f6f681 req-8616012e-fb40-4a12-8bf5-b74df8678406 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received event network-changed-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:33:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-1826be0d-418b-4ba6-8865-43a5f7f6f681 req-8616012e-fb40-4a12-8bf5-b74df8678406 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Refreshing instance network info cache due to event network-changed-96448bcf-3e27-40af-823f-bdd227eb1e67. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:33:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1826be0d-418b-4ba6-8865-43a5f7f6f681 req-8616012e-fb40-4a12-8bf5-b74df8678406 service nova] Acquiring lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:33:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1826be0d-418b-4ba6-8865-43a5f7f6f681 req-8616012e-fb40-4a12-8bf5-b74df8678406 service nova] Acquired lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:33:23 user nova-compute[72782]: DEBUG nova.network.neutron [req-1826be0d-418b-4ba6-8865-43a5f7f6f681 req-8616012e-fb40-4a12-8bf5-b74df8678406 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Refreshing network info cache for port 96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:33:24 user nova-compute[72782]: DEBUG nova.network.neutron [req-1826be0d-418b-4ba6-8865-43a5f7f6f681 req-8616012e-fb40-4a12-8bf5-b74df8678406 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updated VIF entry in instance network info cache for port 96448bcf-3e27-40af-823f-bdd227eb1e67. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:33:24 user nova-compute[72782]: DEBUG nova.network.neutron [req-1826be0d-418b-4ba6-8865-43a5f7f6f681 req-8616012e-fb40-4a12-8bf5-b74df8678406 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updating instance_info_cache with network_info: [{"id": "96448bcf-3e27-40af-823f-bdd227eb1e67", "address": "fa:16:3e:79:5a:1d", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96448bcf-3e", "ovs_interfaceid": "96448bcf-3e27-40af-823f-bdd227eb1e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:33:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1826be0d-418b-4ba6-8865-43a5f7f6f681 req-8616012e-fb40-4a12-8bf5-b74df8678406 service nova] Releasing lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:33:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-ba2e3c9a-1625-4aad-9cb8-3c76a48d507f req-710a2222-550b-43e0-9e76-88f481648178 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received event network-changed-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:33:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-ba2e3c9a-1625-4aad-9cb8-3c76a48d507f req-710a2222-550b-43e0-9e76-88f481648178 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Refreshing instance network info cache due to event network-changed-96448bcf-3e27-40af-823f-bdd227eb1e67. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:33:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ba2e3c9a-1625-4aad-9cb8-3c76a48d507f req-710a2222-550b-43e0-9e76-88f481648178 service nova] Acquiring lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:33:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ba2e3c9a-1625-4aad-9cb8-3c76a48d507f req-710a2222-550b-43e0-9e76-88f481648178 service nova] Acquired lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:33:24 user nova-compute[72782]: DEBUG nova.network.neutron [req-ba2e3c9a-1625-4aad-9cb8-3c76a48d507f req-710a2222-550b-43e0-9e76-88f481648178 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Refreshing network info cache for port 96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:33:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:33:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:33:24 user nova-compute[72782]: INFO nova.compute.manager [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Detaching volume 9f8aff08-811c-4289-a7c5-586a422a42fe
Aug 14 20:33:24 user nova-compute[72782]: INFO nova.virt.block_device [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Attempting to driver detach volume 9f8aff08-811c-4289-a7c5-586a422a42fe from mountpoint /dev/vdb
Aug 14 20:33:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Attempting to detach device vdb from instance efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 20:33:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:33:24 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:33:24 user nova-compute[72782]:   <source dev="/dev/sdc"/>
Aug 14 20:33:24 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:33:24 user nova-compute[72782]:   <serial>9f8aff08-811c-4289-a7c5-586a422a42fe</serial>
Aug 14 20:33:24 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 20:33:24 user nova-compute[72782]: </disk>
Aug 14 20:33:24 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:33:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:33:24 user nova-compute[72782]: DEBUG nova.network.neutron [req-ba2e3c9a-1625-4aad-9cb8-3c76a48d507f req-710a2222-550b-43e0-9e76-88f481648178 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updated VIF entry in instance network info cache for port 96448bcf-3e27-40af-823f-bdd227eb1e67. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:33:24 user nova-compute[72782]: DEBUG nova.network.neutron [req-ba2e3c9a-1625-4aad-9cb8-3c76a48d507f req-710a2222-550b-43e0-9e76-88f481648178 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updating instance_info_cache with network_info: [{"id": "96448bcf-3e27-40af-823f-bdd227eb1e67", "address": "fa:16:3e:79:5a:1d", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96448bcf-3e", "ovs_interfaceid": "96448bcf-3e27-40af-823f-bdd227eb1e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:33:24 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Successfully detached device vdb from instance efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 from the persistent domain config.
Aug 14 20:33:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 20:33:24 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:33:24 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:33:24 user nova-compute[72782]:   <source dev="/dev/sdc"/>
Aug 14 20:33:24 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:33:24 user nova-compute[72782]:   <serial>9f8aff08-811c-4289-a7c5-586a422a42fe</serial>
Aug 14 20:33:24 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 20:33:24 user nova-compute[72782]: </disk>
Aug 14 20:33:24 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ba2e3c9a-1625-4aad-9cb8-3c76a48d507f req-710a2222-550b-43e0-9e76-88f481648178 service nova] Releasing lock "refresh_cache-efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692045205.4379506, efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 20:33:25 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Successfully detached device vdb from instance efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 from the live domain config.
Aug 14 20:33:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFpEfmCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:33:25 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:33:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8fe31b-71f8-41d0-b789-3b92b7a6d2e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[43879865-2b5c-4aae-904a-4c56aabedcbb]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe (non-flash)
Aug 14 20:33:25 user nova-compute[72782]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)
Aug 14 20:33:25 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe (non-flash)
Aug 14 20:33:25 user nova-compute[72782]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)
Aug 14 20:33:25 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f641c3da290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe'): ({'sdc'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Removing single pathed devices sdc {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[295366d7-8a15-4d2c-9421-02fd171fef3b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8643a3-c9ab-416e-9222-945edbc5c754]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Flushing IO for device /dev/sdc {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b9e835-1775-44c1-913e-c21fd84e0f9a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e027ceeb-4670-4c8f-b523-9d1a4996cf5d]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] SCSI volumes sdc have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dae619-5727-4e3c-aa99-0661388bb9ab]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7239750a-aa7c-4db8-a096-ff579aa08305]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe, portal: 172.16.0.220,3260]
Aug 14 20:33:25 user nova-compute[72782]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe, portal: 172.16.0.220,3260] successful.
Aug 14 20:33:25 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f8aff08-811c-4289-a7c5-586a422a42fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a25a9d-49aa-44dd-8901-a4a816f0a8ef]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] <== disconnect_volume: return (264ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:33:25 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:33:26 user nova-compute[72782]: DEBUG nova.objects.instance [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lazy-loading 'flavor' on Instance uuid efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:33:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-62b1d25f-e313-45e5-88a3-889287c1389a tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.783s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:33:27 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:33:29 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:33:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:33:31 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:33:31 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:33:31 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:33:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:33:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:33:31 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:33:31 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:33:31 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updating instance_info_cache with network_info: [{"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:33:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:33:31 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:33:31 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:33:33 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:33:34 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:33:34 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:33:34 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:33:34 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:33:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:33:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:33:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:33:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:33:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:33:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:33:39 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:33:39 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:33:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:33:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:33:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:33:39 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:33:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:33:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:33:40 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:33:40 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:33:40 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8646MB free_disk=25.220260620117188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:33:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:33:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:33:40 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:33:40 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:33:40 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:33:40 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:33:40 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:33:40 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:33:40 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:33:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:33:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:33:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:33:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:33:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:33:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:33:57 user nova-compute[72782]: INFO nova.compute.manager [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Detaching volume 0c004fe6-2e66-4d24-b7d9-91bdd85eba3b
Aug 14 20:33:57 user nova-compute[72782]: INFO nova.virt.block_device [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Attempting to driver detach volume 0c004fe6-2e66-4d24-b7d9-91bdd85eba3b from mountpoint /dev/vdb
Aug 14 20:33:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Attempting to detach device vdb from instance 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 20:33:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:33:57 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:33:57 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:33:57 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:33:57 user nova-compute[72782]:   <serial>0c004fe6-2e66-4d24-b7d9-91bdd85eba3b</serial>
Aug 14 20:33:57 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 20:33:57 user nova-compute[72782]: </disk>
Aug 14 20:33:57 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:33:57 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Successfully detached device vdb from instance 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 from the persistent domain config.
Aug 14 20:33:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 20:33:57 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:33:57 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:33:57 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:33:57 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:33:57 user nova-compute[72782]:   <serial>0c004fe6-2e66-4d24-b7d9-91bdd85eba3b</serial>
Aug 14 20:33:57 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 20:33:57 user nova-compute[72782]: </disk>
Aug 14 20:33:57 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692045238.320856, 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 20:33:58 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Successfully detached device vdb from instance 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 from the live domain config.
Aug 14 20:33:58 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvlCkaPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:33:58 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:33:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ba48e2-42e9-450f-b163-a16af0f6e159]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5981171a-b86e-4db1-a751-0b775d02768e]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)
Aug 14 20:33:58 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b (non-flash)
Aug 14 20:33:58 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e8461fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22231c3-8a97-40be-b332-06d3a52e8e9f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[32426956-860a-43ab-a28a-4914e73d6c0d]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[842f0ccb-eebc-48bd-8eea-b7b4d9658e03]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bd3804-b374-4f80-ad26-916a2f0779a9]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c88ba22-31bc-443d-896e-b10405b9689c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b72659-e3f5-4d20-bdd7-224a7fb847c1]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b, portal: 172.16.0.220,3260]
Aug 14 20:33:58 user nova-compute[72782]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b, portal: 172.16.0.220,3260] successful.
Aug 14 20:33:58 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c004fe6-2e66-4d24-b7d9-91bdd85eba3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6b6c44-ff72-4c25-a27e-9a7367e3e5ba]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] <== disconnect_volume: return (272ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:33:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:33:59 user nova-compute[72782]: DEBUG nova.objects.instance [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'flavor' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:33:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-206dfd97-78ec-4961-aa22-6767829a9844 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.606s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-739fe142-9b92-4fb9-801e-f507577eba9b tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-739fe142-9b92-4fb9-801e-f507577eba9b tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-739fe142-9b92-4fb9-801e-f507577eba9b tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-739fe142-9b92-4fb9-801e-f507577eba9b tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72782) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG nova.objects.instance [None req-739fe142-9b92-4fb9-801e-f507577eba9b tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'flavor' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-5543c3bc-dbc8-4799-b867-c99cf7b88e4a req-88b6460c-a2e2-4077-8770-5988fca1cc1c service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-vif-unplugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5543c3bc-dbc8-4799-b867-c99cf7b88e4a req-88b6460c-a2e2-4077-8770-5988fca1cc1c service nova] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5543c3bc-dbc8-4799-b867-c99cf7b88e4a req-88b6460c-a2e2-4077-8770-5988fca1cc1c service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5543c3bc-dbc8-4799-b867-c99cf7b88e4a req-88b6460c-a2e2-4077-8770-5988fca1cc1c service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-5543c3bc-dbc8-4799-b867-c99cf7b88e4a req-88b6460c-a2e2-4077-8770-5988fca1cc1c service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] No waiting events found dispatching network-vif-unplugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:34:00 user nova-compute[72782]: WARNING nova.compute.manager [req-5543c3bc-dbc8-4799-b867-c99cf7b88e4a req-88b6460c-a2e2-4077-8770-5988fca1cc1c service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received unexpected event network-vif-unplugged-28c18d55-ae94-446a-a394-f686216e197d for instance with vm_state active and task_state powering-off.
Aug 14 20:34:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:00 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Instance destroyed successfully.
Aug 14 20:34:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-739fe142-9b92-4fb9-801e-f507577eba9b tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-739fe142-9b92-4fb9-801e-f507577eba9b tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.851s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:34:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] No waiting events found dispatching network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:34:02 user nova-compute[72782]: WARNING nova.compute.manager [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received unexpected event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d for instance with vm_state stopped and task_state None.
Aug 14 20:34:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] No waiting events found dispatching network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:34:02 user nova-compute[72782]: WARNING nova.compute.manager [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received unexpected event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d for instance with vm_state stopped and task_state None.
Aug 14 20:34:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] No waiting events found dispatching network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:34:02 user nova-compute[72782]: WARNING nova.compute.manager [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received unexpected event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d for instance with vm_state stopped and task_state None.
Aug 14 20:34:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-vif-unplugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] No waiting events found dispatching network-vif-unplugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:34:02 user nova-compute[72782]: WARNING nova.compute.manager [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received unexpected event network-vif-unplugged-28c18d55-ae94-446a-a394-f686216e197d for instance with vm_state stopped and task_state None.
Aug 14 20:34:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:34:02 user nova-compute[72782]: DEBUG nova.compute.manager [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] No waiting events found dispatching network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:34:02 user nova-compute[72782]: WARNING nova.compute.manager [req-cd124401-9c83-474c-bffe-a09fac29f076 req-ea02936e-fbb7-45a3-a365-48b3114b928e service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received unexpected event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d for instance with vm_state stopped and task_state None.
Aug 14 20:34:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:34:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:15 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692045240.8359997, 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:34:15 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] VM Stopped (Lifecycle Event)
Aug 14 20:34:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-bda0aeaa-c9f1-49f1-892c-529e3f886011 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:34:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-bda0aeaa-c9f1-49f1-892c-529e3f886011 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:34:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:34:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:34:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:34:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:34:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:34:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:34:20 user nova-compute[72782]: INFO nova.compute.manager [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Terminating instance
Aug 14 20:34:20 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:34:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-398693ac-6c01-4d45-a82a-756e1109c673 req-da59921b-0040-4a89-8894-6956a73d90a5 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received event network-vif-unplugged-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:34:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-398693ac-6c01-4d45-a82a-756e1109c673 req-da59921b-0040-4a89-8894-6956a73d90a5 service nova] Acquiring lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:34:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-398693ac-6c01-4d45-a82a-756e1109c673 req-da59921b-0040-4a89-8894-6956a73d90a5 service nova] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:34:20 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-398693ac-6c01-4d45-a82a-756e1109c673 req-da59921b-0040-4a89-8894-6956a73d90a5 service nova] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:34:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-398693ac-6c01-4d45-a82a-756e1109c673 req-da59921b-0040-4a89-8894-6956a73d90a5 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] No waiting events found dispatching network-vif-unplugged-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:34:20 user nova-compute[72782]: DEBUG nova.compute.manager [req-398693ac-6c01-4d45-a82a-756e1109c673 req-da59921b-0040-4a89-8894-6956a73d90a5 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received event network-vif-unplugged-96448bcf-3e27-40af-823f-bdd227eb1e67 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Instance destroyed successfully.
Aug 14 20:34:21 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lazy-loading 'resources' on Instance uuid efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-45125061',display_name='tempest-TestMinimumBasicScenario-server-45125061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-45125061',id=44,image_ref='45ede556-d162-4be6-81fe-230e9ee1a1f4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYWCtQPth2WP0eZfEROm1lU/xSlwUhY8VZdk92FxXE43xujZNVYsw+Ff8WW4ED91gWsnLcrODhN2QOWNGqijJ6w8bjbx8RPZ+goA1acGaDkHw9zVdMhYLxKd34VZ9XYqA==',key_name='tempest-TestMinimumBasicScenario-1142682677',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:29:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fc168d9c3794a2e8c7934151ecc3d2e',ramdisk_id='',reservation_id='r-sk11n0k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='45ede556-d162-4be6-81fe-230e9ee1a1f4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-77953630',owner_user_name='tempest-TestMinimumBasicScenario-77953630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:31:39Z,user_data=None,user_id='f4eedf2578e64fdd8f1a761e5ba1c626',uuid=efe0784c-4af1-4f57-ad3b-b3c21eeb02e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96448bcf-3e27-40af-823f-bdd227eb1e67", "address": "fa:16:3e:79:5a:1d", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96448bcf-3e", "ovs_interfaceid": "96448bcf-3e27-40af-823f-bdd227eb1e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Converting VIF {"id": "96448bcf-3e27-40af-823f-bdd227eb1e67", "address": "fa:16:3e:79:5a:1d", "network": {"id": "dd5bae3f-c8d0-4e1c-834d-daab5e6aae70", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1624910378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc168d9c3794a2e8c7934151ecc3d2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96448bcf-3e", "ovs_interfaceid": "96448bcf-3e27-40af-823f-bdd227eb1e67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:5a:1d,bridge_name='br-int',has_traffic_filtering=True,id=96448bcf-3e27-40af-823f-bdd227eb1e67,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96448bcf-3e') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG os_vif [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:5a:1d,bridge_name='br-int',has_traffic_filtering=True,id=96448bcf-3e27-40af-823f-bdd227eb1e67,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96448bcf-3e') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96448bcf-3e, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:21 user nova-compute[72782]: INFO os_vif [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:5a:1d,bridge_name='br-int',has_traffic_filtering=True,id=96448bcf-3e27-40af-823f-bdd227eb1e67,network=Network(dd5bae3f-c8d0-4e1c-834d-daab5e6aae70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96448bcf-3e')
Aug 14 20:34:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Deleting instance files /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3_del
Aug 14 20:34:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Deletion of /opt/stack/data/nova/instances/efe0784c-4af1-4f57-ad3b-b3c21eeb02e3_del complete
Aug 14 20:34:21 user nova-compute[72782]: INFO nova.compute.manager [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 20:34:21 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:21 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Took 0.55 seconds to deallocate network for instance.
Aug 14 20:34:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-e83f290a-4bfc-4bb0-a23e-e76d94047401 req-cffb1768-fb84-4dec-b2b0-30030d9fde71 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received event network-vif-deleted-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:34:21 user nova-compute[72782]: INFO nova.compute.manager [req-e83f290a-4bfc-4bb0-a23e-e76d94047401 req-cffb1768-fb84-4dec-b2b0-30030d9fde71 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Neutron deleted interface 96448bcf-3e27-40af-823f-bdd227eb1e67; detaching it from the instance and deleting it from the info cache
Aug 14 20:34:21 user nova-compute[72782]: DEBUG nova.network.neutron [req-e83f290a-4bfc-4bb0-a23e-e76d94047401 req-cffb1768-fb84-4dec-b2b0-30030d9fde71 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-e83f290a-4bfc-4bb0-a23e-e76d94047401 req-cffb1768-fb84-4dec-b2b0-30030d9fde71 service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Detach interface failed, port_id=96448bcf-3e27-40af-823f-bdd227eb1e67, reason: Instance efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:22 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:34:22 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:34:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:34:22 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Deleted allocations for instance efe0784c-4af1-4f57-ad3b-b3c21eeb02e3
Aug 14 20:34:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4fd9bfb5-ae13-455f-b4e3-c1295e0e24ba tempest-TestMinimumBasicScenario-77953630 tempest-TestMinimumBasicScenario-77953630-project-member] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.748s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:34:22 user nova-compute[72782]: DEBUG nova.compute.manager [req-3c784526-85a9-41c5-bcd8-9c38614527b0 req-101da89c-3f26-40ac-b3e9-5a4c1d70389e service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received event network-vif-plugged-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:34:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3c784526-85a9-41c5-bcd8-9c38614527b0 req-101da89c-3f26-40ac-b3e9-5a4c1d70389e service nova] Acquiring lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:34:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3c784526-85a9-41c5-bcd8-9c38614527b0 req-101da89c-3f26-40ac-b3e9-5a4c1d70389e service nova] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:34:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3c784526-85a9-41c5-bcd8-9c38614527b0 req-101da89c-3f26-40ac-b3e9-5a4c1d70389e service nova] Lock "efe0784c-4af1-4f57-ad3b-b3c21eeb02e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:34:22 user nova-compute[72782]: DEBUG nova.compute.manager [req-3c784526-85a9-41c5-bcd8-9c38614527b0 req-101da89c-3f26-40ac-b3e9-5a4c1d70389e service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] No waiting events found dispatching network-vif-plugged-96448bcf-3e27-40af-823f-bdd227eb1e67 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:34:22 user nova-compute[72782]: WARNING nova.compute.manager [req-3c784526-85a9-41c5-bcd8-9c38614527b0 req-101da89c-3f26-40ac-b3e9-5a4c1d70389e service nova] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Received unexpected event network-vif-plugged-96448bcf-3e27-40af-823f-bdd227eb1e67 for instance with vm_state deleted and task_state None.
Aug 14 20:34:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:27 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:34:30 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:34:31 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:34:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:34:32 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:34:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:34:32 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 20:34:34 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:34:36 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:34:36 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:34:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:34:36 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692045261.2168627, efe0784c-4af1-4f57-ad3b-b3c21eeb02e3 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:34:36 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] VM Stopped (Lifecycle Event)
Aug 14 20:34:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-2cebffbf-d987-4ccc-aa90-cb3090809e44 None None] [instance: efe0784c-4af1-4f57-ad3b-b3c21eeb02e3] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:34:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:34:40 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:34:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:34:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:34:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:34:40 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:34:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:34:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:34:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:34:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:34:40 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:34:40 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:34:40 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8806MB free_disk=25.247207641601562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:34:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:34:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:34:41 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:34:41 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:34:41 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:34:41 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:34:41 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:34:41 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:34:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:34:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:34:42 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:34:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:34:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:34:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:34:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:34:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:34:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:35:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:35:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:35:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:35:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:35:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:35:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:35:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:28 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:35:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:30 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:35:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:32 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:35:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Acquiring lock "1c89dbd3-f4f3-4850-90de-df1bb0725428" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:35:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:35:33 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:35:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:35:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:35:33 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:35:33 user nova-compute[72782]: INFO nova.compute.claims [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Claim successful on node user
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Skipping network cache update for instance because it is Building. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.201s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG nova.network.neutron [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:35:34 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:35:34 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG nova.policy [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8d3b9482d4e4262905a91b9c8401523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a48d3656de48e5867d19ffad4029d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:35:34 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Creating image(s)
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "/opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "/opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updating instance_info_cache with network_info: [{"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.171s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk 1073741824" returned: 0 in 0.063s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:35:34 user nova-compute[72782]: DEBUG nova.network.neutron [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Successfully created port: d52fbb0c-fde6-466b-a7e4-457a61cb1a54 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:35:35 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:35:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:35:35 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Cannot resize image /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 20:35:35 user nova-compute[72782]: DEBUG nova.objects.instance [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lazy-loading 'migration_context' on Instance uuid 1c89dbd3-f4f3-4850-90de-df1bb0725428 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:35:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:35:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Ensure instance console log exists: /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:35:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:35:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:35:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:35:35 user nova-compute[72782]: DEBUG nova.network.neutron [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Successfully updated port: d52fbb0c-fde6-466b-a7e4-457a61cb1a54 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:35:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Acquiring lock "refresh_cache-1c89dbd3-f4f3-4850-90de-df1bb0725428" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:35:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Acquired lock "refresh_cache-1c89dbd3-f4f3-4850-90de-df1bb0725428" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:35:35 user nova-compute[72782]: DEBUG nova.network.neutron [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:35:35 user nova-compute[72782]: DEBUG nova.network.neutron [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:35:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-b133c3dc-c1c6-480e-878e-276e94476990 req-9cfe3d1f-4cf6-4286-af49-cf99a4a264f3 service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Received event network-changed-d52fbb0c-fde6-466b-a7e4-457a61cb1a54 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:35:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-b133c3dc-c1c6-480e-878e-276e94476990 req-9cfe3d1f-4cf6-4286-af49-cf99a4a264f3 service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Refreshing instance network info cache due to event network-changed-d52fbb0c-fde6-466b-a7e4-457a61cb1a54. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:35:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b133c3dc-c1c6-480e-878e-276e94476990 req-9cfe3d1f-4cf6-4286-af49-cf99a4a264f3 service nova] Acquiring lock "refresh_cache-1c89dbd3-f4f3-4850-90de-df1bb0725428" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:35:35 user nova-compute[72782]: DEBUG nova.network.neutron [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Updating instance_info_cache with network_info: [{"id": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "address": "fa:16:3e:79:59:52", "network": {"id": "3950917a-144a-478a-8c45-2fa6b3d32be9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1798634352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a48d3656de48e5867d19ffad4029d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd52fbb0c-fd", "ovs_interfaceid": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Releasing lock "refresh_cache-1c89dbd3-f4f3-4850-90de-df1bb0725428" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Instance network_info: |[{"id": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "address": "fa:16:3e:79:59:52", "network": {"id": "3950917a-144a-478a-8c45-2fa6b3d32be9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1798634352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a48d3656de48e5867d19ffad4029d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd52fbb0c-fd", "ovs_interfaceid": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b133c3dc-c1c6-480e-878e-276e94476990 req-9cfe3d1f-4cf6-4286-af49-cf99a4a264f3 service nova] Acquired lock "refresh_cache-1c89dbd3-f4f3-4850-90de-df1bb0725428" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.network.neutron [req-b133c3dc-c1c6-480e-878e-276e94476990 req-9cfe3d1f-4cf6-4286-af49-cf99a4a264f3 service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Refreshing network info cache for port d52fbb0c-fde6-466b-a7e4-457a61cb1a54 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Start _get_guest_xml network_info=[{"id": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "address": "fa:16:3e:79:59:52", "network": {"id": "3950917a-144a-478a-8c45-2fa6b3d32be9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1798634352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a48d3656de48e5867d19ffad4029d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd52fbb0c-fd", "ovs_interfaceid": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:35:36 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:35:36 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-959340175',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-959340175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9593401',id=45,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa0kFhRXaxwRKKId4bejRAGxr7vS2GmHoEryXhRK3O5+dCK/Wgm3cyjvRXIqpj4wla7NoP1CbdZ+pVnTbQG8649u84CFEQJ92YhFXu5hn5Y1owej3Se0WklXTCD+uEXRg==',key_name='tempest-keypair-1629698876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16a48d3656de48e5867d19ffad4029d1',ramdisk_id='',reservation_id='r-w10hr5vs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-207096709',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:35:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8d3b9482d4e4262905a91b9c8401523',uuid=1c89dbd3-f4f3-4850-90de-df1bb0725428,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "address": "fa:16:3e:79:59:52", "network": {"id": "3950917a-144a-478a-8c45-2fa6b3d32be9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1798634352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a48d3656de48e5867d19ffad4029d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd52fbb0c-fd", "ovs_interfaceid": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Converting VIF {"id": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "address": "fa:16:3e:79:59:52", "network": {"id": "3950917a-144a-478a-8c45-2fa6b3d32be9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1798634352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a48d3656de48e5867d19ffad4029d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd52fbb0c-fd", "ovs_interfaceid": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:59:52,bridge_name='br-int',has_traffic_filtering=True,id=d52fbb0c-fde6-466b-a7e4-457a61cb1a54,network=Network(3950917a-144a-478a-8c45-2fa6b3d32be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd52fbb0c-fd') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.objects.instance [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c89dbd3-f4f3-4850-90de-df1bb0725428 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:35:36 user nova-compute[72782]:   <uuid>1c89dbd3-f4f3-4850-90de-df1bb0725428</uuid>
Aug 14 20:35:36 user nova-compute[72782]:   <name>instance-0000002d</name>
Aug 14 20:35:36 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:35:36 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:35:36 user nova-compute[72782]:   <metadata>
Aug 14 20:35:36 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:35:36 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:35:36 user nova-compute[72782]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-959340175</nova:name>
Aug 14 20:35:36 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:35:36</nova:creationTime>
Aug 14 20:35:36 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:35:36 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:35:36 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:35:36 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:35:36 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:35:36 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:35:36 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:35:36 user nova-compute[72782]:       <nova:owner>
Aug 14 20:35:36 user nova-compute[72782]:         <nova:user uuid="c8d3b9482d4e4262905a91b9c8401523">tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member</nova:user>
Aug 14 20:35:36 user nova-compute[72782]:         <nova:project uuid="16a48d3656de48e5867d19ffad4029d1">tempest-TestServerVolumeAttachScenarioOldVersion-207096709</nova:project>
Aug 14 20:35:36 user nova-compute[72782]:       </nova:owner>
Aug 14 20:35:36 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 20:35:36 user nova-compute[72782]:       <nova:ports>
Aug 14 20:35:36 user nova-compute[72782]:         <nova:port uuid="d52fbb0c-fde6-466b-a7e4-457a61cb1a54">
Aug 14 20:35:36 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 20:35:36 user nova-compute[72782]:         </nova:port>
Aug 14 20:35:36 user nova-compute[72782]:       </nova:ports>
Aug 14 20:35:36 user nova-compute[72782]:     </nova:instance>
Aug 14 20:35:36 user nova-compute[72782]:   </metadata>
Aug 14 20:35:36 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:35:36 user nova-compute[72782]:     <system>
Aug 14 20:35:36 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:35:36 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:35:36 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:35:36 user nova-compute[72782]:       <entry name="serial">1c89dbd3-f4f3-4850-90de-df1bb0725428</entry>
Aug 14 20:35:36 user nova-compute[72782]:       <entry name="uuid">1c89dbd3-f4f3-4850-90de-df1bb0725428</entry>
Aug 14 20:35:36 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:35:36 user nova-compute[72782]:     </system>
Aug 14 20:35:36 user nova-compute[72782]:   </sysinfo>
Aug 14 20:35:36 user nova-compute[72782]:   <os>
Aug 14 20:35:36 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:35:36 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:35:36 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:35:36 user nova-compute[72782]:   </os>
Aug 14 20:35:36 user nova-compute[72782]:   <features>
Aug 14 20:35:36 user nova-compute[72782]:     <acpi/>
Aug 14 20:35:36 user nova-compute[72782]:     <apic/>
Aug 14 20:35:36 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:35:36 user nova-compute[72782]:   </features>
Aug 14 20:35:36 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:35:36 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:35:36 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:35:36 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:35:36 user nova-compute[72782]:   </clock>
Aug 14 20:35:36 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:35:36 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:35:36 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:35:36 user nova-compute[72782]:   </cpu>
Aug 14 20:35:36 user nova-compute[72782]:   <devices>
Aug 14 20:35:36 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:35:36 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:35:36 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk"/>
Aug 14 20:35:36 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:35:36 user nova-compute[72782]:     </disk>
Aug 14 20:35:36 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:35:36 user nova-compute[72782]:       <mac address="fa:16:3e:79:59:52"/>
Aug 14 20:35:36 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:35:36 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:35:36 user nova-compute[72782]:       <target dev="tapd52fbb0c-fd"/>
Aug 14 20:35:36 user nova-compute[72782]:     </interface>
Aug 14 20:35:36 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:35:36 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/console.log" append="off"/>
Aug 14 20:35:36 user nova-compute[72782]:     </serial>
Aug 14 20:35:36 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:35:36 user nova-compute[72782]:     <video>
Aug 14 20:35:36 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:35:36 user nova-compute[72782]:     </video>
Aug 14 20:35:36 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:35:36 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:35:36 user nova-compute[72782]:     </rng>
Aug 14 20:35:36 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:35:36 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:35:36 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:35:36 user nova-compute[72782]:     </memballoon>
Aug 14 20:35:36 user nova-compute[72782]:   </devices>
Aug 14 20:35:36 user nova-compute[72782]: </domain>
Aug 14 20:35:36 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-959340175',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-959340175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9593401',id=45,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa0kFhRXaxwRKKId4bejRAGxr7vS2GmHoEryXhRK3O5+dCK/Wgm3cyjvRXIqpj4wla7NoP1CbdZ+pVnTbQG8649u84CFEQJ92YhFXu5hn5Y1owej3Se0WklXTCD+uEXRg==',key_name='tempest-keypair-1629698876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16a48d3656de48e5867d19ffad4029d1',ramdisk_id='',reservation_id='r-w10hr5vs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-207096709',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:35:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8d3b9482d4e4262905a91b9c8401523',uuid=1c89dbd3-f4f3-4850-90de-df1bb0725428,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "address": "fa:16:3e:79:59:52", "network": {"id": "3950917a-144a-478a-8c45-2fa6b3d32be9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1798634352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a48d3656de48e5867d19ffad4029d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd52fbb0c-fd", "ovs_interfaceid": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Converting VIF {"id": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "address": "fa:16:3e:79:59:52", "network": {"id": "3950917a-144a-478a-8c45-2fa6b3d32be9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1798634352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a48d3656de48e5867d19ffad4029d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd52fbb0c-fd", "ovs_interfaceid": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:59:52,bridge_name='br-int',has_traffic_filtering=True,id=d52fbb0c-fde6-466b-a7e4-457a61cb1a54,network=Network(3950917a-144a-478a-8c45-2fa6b3d32be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd52fbb0c-fd') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG os_vif [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:59:52,bridge_name='br-int',has_traffic_filtering=True,id=d52fbb0c-fde6-466b-a7e4-457a61cb1a54,network=Network(3950917a-144a-478a-8c45-2fa6b3d32be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd52fbb0c-fd') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd52fbb0c-fd, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd52fbb0c-fd, col_values=(('external_ids', {'iface-id': 'd52fbb0c-fde6-466b-a7e4-457a61cb1a54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:59:52', 'vm-uuid': '1c89dbd3-f4f3-4850-90de-df1bb0725428'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:36 user nova-compute[72782]: INFO os_vif [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:59:52,bridge_name='br-int',has_traffic_filtering=True,id=d52fbb0c-fde6-466b-a7e4-457a61cb1a54,network=Network(3950917a-144a-478a-8c45-2fa6b3d32be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd52fbb0c-fd')
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] No VIF found with MAC fa:16:3e:79:59:52, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.network.neutron [req-b133c3dc-c1c6-480e-878e-276e94476990 req-9cfe3d1f-4cf6-4286-af49-cf99a4a264f3 service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Updated VIF entry in instance network info cache for port d52fbb0c-fde6-466b-a7e4-457a61cb1a54. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG nova.network.neutron [req-b133c3dc-c1c6-480e-878e-276e94476990 req-9cfe3d1f-4cf6-4286-af49-cf99a4a264f3 service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Updating instance_info_cache with network_info: [{"id": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "address": "fa:16:3e:79:59:52", "network": {"id": "3950917a-144a-478a-8c45-2fa6b3d32be9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1798634352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a48d3656de48e5867d19ffad4029d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd52fbb0c-fd", "ovs_interfaceid": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:35:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b133c3dc-c1c6-480e-878e-276e94476990 req-9cfe3d1f-4cf6-4286-af49-cf99a4a264f3 service nova] Releasing lock "refresh_cache-1c89dbd3-f4f3-4850-90de-df1bb0725428" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:35:37 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:35:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-b0e9a329-13e4-4c7f-9ffb-8520ece935b8 req-07926036-54cb-4e31-8843-1c74f991836b service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Received event network-vif-plugged-d52fbb0c-fde6-466b-a7e4-457a61cb1a54 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:35:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b0e9a329-13e4-4c7f-9ffb-8520ece935b8 req-07926036-54cb-4e31-8843-1c74f991836b service nova] Acquiring lock "1c89dbd3-f4f3-4850-90de-df1bb0725428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:35:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b0e9a329-13e4-4c7f-9ffb-8520ece935b8 req-07926036-54cb-4e31-8843-1c74f991836b service nova] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:35:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b0e9a329-13e4-4c7f-9ffb-8520ece935b8 req-07926036-54cb-4e31-8843-1c74f991836b service nova] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:35:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-b0e9a329-13e4-4c7f-9ffb-8520ece935b8 req-07926036-54cb-4e31-8843-1c74f991836b service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] No waiting events found dispatching network-vif-plugged-d52fbb0c-fde6-466b-a7e4-457a61cb1a54 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:35:37 user nova-compute[72782]: WARNING nova.compute.manager [req-b0e9a329-13e4-4c7f-9ffb-8520ece935b8 req-07926036-54cb-4e31-8843-1c74f991836b service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Received unexpected event network-vif-plugged-d52fbb0c-fde6-466b-a7e4-457a61cb1a54 for instance with vm_state building and task_state spawning.
Aug 14 20:35:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:38 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:35:38 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:35:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:39 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692045339.5118299, 1c89dbd3-f4f3-4850-90de-df1bb0725428 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:35:39 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] VM Resumed (Lifecycle Event)
Aug 14 20:35:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:35:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:35:39 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Instance spawned successfully.
Aug 14 20:35:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:35:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:35:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:35:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:35:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:35:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:35:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:35:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:35:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:35:39 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:35:39 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692045339.5129793, 1c89dbd3-f4f3-4850-90de-df1bb0725428 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:35:39 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] VM Started (Lifecycle Event)
Aug 14 20:35:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:35:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:35:39 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:35:39 user nova-compute[72782]: INFO nova.compute.manager [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Took 5.31 seconds to spawn the instance on the hypervisor.
Aug 14 20:35:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:35:39 user nova-compute[72782]: INFO nova.compute.manager [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Took 5.82 seconds to build instance.
Aug 14 20:35:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-f30c7db1-38c7-4d24-8f95-f5b3e9bfd292 req-82adc582-d200-4207-941f-d602075a6bab service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Received event network-vif-plugged-d52fbb0c-fde6-466b-a7e4-457a61cb1a54 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:35:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f30c7db1-38c7-4d24-8f95-f5b3e9bfd292 req-82adc582-d200-4207-941f-d602075a6bab service nova] Acquiring lock "1c89dbd3-f4f3-4850-90de-df1bb0725428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:35:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f30c7db1-38c7-4d24-8f95-f5b3e9bfd292 req-82adc582-d200-4207-941f-d602075a6bab service nova] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:35:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f30c7db1-38c7-4d24-8f95-f5b3e9bfd292 req-82adc582-d200-4207-941f-d602075a6bab service nova] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:35:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-f30c7db1-38c7-4d24-8f95-f5b3e9bfd292 req-82adc582-d200-4207-941f-d602075a6bab service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] No waiting events found dispatching network-vif-plugged-d52fbb0c-fde6-466b-a7e4-457a61cb1a54 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:35:39 user nova-compute[72782]: WARNING nova.compute.manager [req-f30c7db1-38c7-4d24-8f95-f5b3e9bfd292 req-82adc582-d200-4207-941f-d602075a6bab service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Received unexpected event network-vif-plugged-d52fbb0c-fde6-466b-a7e4-457a61cb1a54 for instance with vm_state active and task_state None.
Aug 14 20:35:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-cf6c1619-e69b-45e2-8678-656916d75db8 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.921s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:35:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:42 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:35:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:35:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:35:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:35:42 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:35:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:35:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:35:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:35:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:35:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:35:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:35:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:35:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:35:43 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:35:43 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:35:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8766MB free_disk=25.283935546875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:35:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:35:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:35:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:35:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 1c89dbd3-f4f3-4850-90de-df1bb0725428 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:35:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:35:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:35:43 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:35:43 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:35:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:35:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:35:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:44 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:35:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:50 user nova-compute[72782]: DEBUG nova.objects.instance [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'flavor' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:35:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:35:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquired lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:35:50 user nova-compute[72782]: DEBUG nova.network.neutron [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:35:50 user nova-compute[72782]: DEBUG nova.objects.instance [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'info_cache' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.network.neutron [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updating instance_info_cache with network_info: [{"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Releasing lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:35:51 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Instance destroyed successfully.
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'resources' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:28:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1438697692',display_name='tempest-AttachVolumeTestJSON-server-1438697692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1438697692',id=43,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIZMdrvcAObDrQOnw6Z4cKMh8UkLd6T6hnSQkZurL1/AHHX+HwCM+yXwzFIxmNtn58wn91JRRMK8D/OvNJqPJOxQJGzDkEoynLrq1UHzUwGYj+LHuUngHZijLDOQbeXkw==',key_name='tempest-keypair-314886705',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:28:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='21ca996ad34a4a55994ae92a688f349f',ramdisk_id='',reservation_id='r-kxmp5hcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-434447893',owner_user_name='tempest-AttachVolumeTestJSON-434447893-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeb23a424fd4eabb174c5630f36956d',uuid=1ddcf095-6362-4b8f-82a1-e39eb6aa6661,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converting VIF {"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG os_vif [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28c18d55-ae, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:35:51 user nova-compute[72782]: INFO os_vif [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae')
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Start _get_guest_xml network_info=[{"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'numa_topology' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:35:51 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:35:51 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:28:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1438697692',display_name='tempest-AttachVolumeTestJSON-server-1438697692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1438697692',id=43,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIZMdrvcAObDrQOnw6Z4cKMh8UkLd6T6hnSQkZurL1/AHHX+HwCM+yXwzFIxmNtn58wn91JRRMK8D/OvNJqPJOxQJGzDkEoynLrq1UHzUwGYj+LHuUngHZijLDOQbeXkw==',key_name='tempest-keypair-314886705',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:28:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='21ca996ad34a4a55994ae92a688f349f',ramdisk_id='',reservation_id='r-kxmp5hcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-434447893',owner_user_name='tempest-AttachVolumeTestJSON-434447893-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeb23a424fd4eabb174c5630f36956d',uuid=1ddcf095-6362-4b8f-82a1-e39eb6aa6661,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converting VIF {"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:35:51 user nova-compute[72782]:   <uuid>1ddcf095-6362-4b8f-82a1-e39eb6aa6661</uuid>
Aug 14 20:35:51 user nova-compute[72782]:   <name>instance-0000002b</name>
Aug 14 20:35:51 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:35:51 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:35:51 user nova-compute[72782]:   <metadata>
Aug 14 20:35:51 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:35:51 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:35:51 user nova-compute[72782]:       <nova:name>tempest-AttachVolumeTestJSON-server-1438697692</nova:name>
Aug 14 20:35:51 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:35:51</nova:creationTime>
Aug 14 20:35:51 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:35:51 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:35:51 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:35:51 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:35:51 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:35:51 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:35:51 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:35:51 user nova-compute[72782]:       <nova:owner>
Aug 14 20:35:51 user nova-compute[72782]:         <nova:user uuid="7aeb23a424fd4eabb174c5630f36956d">tempest-AttachVolumeTestJSON-434447893-project-member</nova:user>
Aug 14 20:35:51 user nova-compute[72782]:         <nova:project uuid="21ca996ad34a4a55994ae92a688f349f">tempest-AttachVolumeTestJSON-434447893</nova:project>
Aug 14 20:35:51 user nova-compute[72782]:       </nova:owner>
Aug 14 20:35:51 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 20:35:51 user nova-compute[72782]:       <nova:ports>
Aug 14 20:35:51 user nova-compute[72782]:         <nova:port uuid="28c18d55-ae94-446a-a394-f686216e197d">
Aug 14 20:35:51 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 20:35:51 user nova-compute[72782]:         </nova:port>
Aug 14 20:35:51 user nova-compute[72782]:       </nova:ports>
Aug 14 20:35:51 user nova-compute[72782]:     </nova:instance>
Aug 14 20:35:51 user nova-compute[72782]:   </metadata>
Aug 14 20:35:51 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:35:51 user nova-compute[72782]:     <system>
Aug 14 20:35:51 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:35:51 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:35:51 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:35:51 user nova-compute[72782]:       <entry name="serial">1ddcf095-6362-4b8f-82a1-e39eb6aa6661</entry>
Aug 14 20:35:51 user nova-compute[72782]:       <entry name="uuid">1ddcf095-6362-4b8f-82a1-e39eb6aa6661</entry>
Aug 14 20:35:51 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:35:51 user nova-compute[72782]:     </system>
Aug 14 20:35:51 user nova-compute[72782]:   </sysinfo>
Aug 14 20:35:51 user nova-compute[72782]:   <os>
Aug 14 20:35:51 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:35:51 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:35:51 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:35:51 user nova-compute[72782]:   </os>
Aug 14 20:35:51 user nova-compute[72782]:   <features>
Aug 14 20:35:51 user nova-compute[72782]:     <acpi/>
Aug 14 20:35:51 user nova-compute[72782]:     <apic/>
Aug 14 20:35:51 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:35:51 user nova-compute[72782]:   </features>
Aug 14 20:35:51 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:35:51 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:35:51 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:35:51 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:35:51 user nova-compute[72782]:   </clock>
Aug 14 20:35:51 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:35:51 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:35:51 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:35:51 user nova-compute[72782]:   </cpu>
Aug 14 20:35:51 user nova-compute[72782]:   <devices>
Aug 14 20:35:51 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:35:51 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:35:51 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk"/>
Aug 14 20:35:51 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:35:51 user nova-compute[72782]:     </disk>
Aug 14 20:35:51 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:35:51 user nova-compute[72782]:       <mac address="fa:16:3e:24:a9:dc"/>
Aug 14 20:35:51 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:35:51 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:35:51 user nova-compute[72782]:       <target dev="tap28c18d55-ae"/>
Aug 14 20:35:51 user nova-compute[72782]:     </interface>
Aug 14 20:35:51 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:35:51 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/console.log" append="off"/>
Aug 14 20:35:51 user nova-compute[72782]:     </serial>
Aug 14 20:35:51 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:35:51 user nova-compute[72782]:     <video>
Aug 14 20:35:51 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:35:51 user nova-compute[72782]:     </video>
Aug 14 20:35:51 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:35:51 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:35:51 user nova-compute[72782]:     </rng>
Aug 14 20:35:51 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:35:51 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:35:51 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:35:51 user nova-compute[72782]:     </memballoon>
Aug 14 20:35:51 user nova-compute[72782]:   </devices>
Aug 14 20:35:51 user nova-compute[72782]: </domain>
Aug 14 20:35:51 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:35:51 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.169s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Cannot resize image /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG nova.objects.instance [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'migration_context' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:28:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1438697692',display_name='tempest-AttachVolumeTestJSON-server-1438697692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1438697692',id=43,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIZMdrvcAObDrQOnw6Z4cKMh8UkLd6T6hnSQkZurL1/AHHX+HwCM+yXwzFIxmNtn58wn91JRRMK8D/OvNJqPJOxQJGzDkEoynLrq1UHzUwGYj+LHuUngHZijLDOQbeXkw==',key_name='tempest-keypair-314886705',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:28:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='21ca996ad34a4a55994ae92a688f349f',ramdisk_id='',reservation_id='r-kxmp5hcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-434447893',owner_user_name='tempest-AttachVolumeTestJSON-434447893-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeb23a424fd4eabb174c5630f36956d',uuid=1ddcf095-6362-4b8f-82a1-e39eb6aa6661,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converting VIF {"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG os_vif [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28c18d55-ae, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28c18d55-ae, col_values=(('external_ids', {'iface-id': '28c18d55-ae94-446a-a394-f686216e197d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:a9:dc', 'vm-uuid': '1ddcf095-6362-4b8f-82a1-e39eb6aa6661'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:35:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:52 user nova-compute[72782]: INFO os_vif [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae')
Aug 14 20:35:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:53 user nova-compute[72782]: DEBUG nova.compute.manager [req-e458f9fc-2026-42a4-a26d-1e595936709a req-6b91f63f-06d7-4c67-8e7b-e01f7fcc041a service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:35:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e458f9fc-2026-42a4-a26d-1e595936709a req-6b91f63f-06d7-4c67-8e7b-e01f7fcc041a service nova] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:35:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e458f9fc-2026-42a4-a26d-1e595936709a req-6b91f63f-06d7-4c67-8e7b-e01f7fcc041a service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:35:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e458f9fc-2026-42a4-a26d-1e595936709a req-6b91f63f-06d7-4c67-8e7b-e01f7fcc041a service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:35:53 user nova-compute[72782]: DEBUG nova.compute.manager [req-e458f9fc-2026-42a4-a26d-1e595936709a req-6b91f63f-06d7-4c67-8e7b-e01f7fcc041a service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] No waiting events found dispatching network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:35:53 user nova-compute[72782]: WARNING nova.compute.manager [req-e458f9fc-2026-42a4-a26d-1e595936709a req-6b91f63f-06d7-4c67-8e7b-e01f7fcc041a service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received unexpected event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d for instance with vm_state stopped and task_state powering-on.
Aug 14 20:35:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:55 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692045355.8162255, 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:35:55 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] VM Resumed (Lifecycle Event)
Aug 14 20:35:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:35:55 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Instance rebooted successfully.
Aug 14 20:35:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-45ce2bf3-e2f4-4803-a8e9-b0d612a02b0e tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:35:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:35:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:35:55 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 14 20:35:55 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692045355.817514, 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:35:55 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] VM Started (Lifecycle Event)
Aug 14 20:35:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:35:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:35:56 user nova-compute[72782]: DEBUG nova.compute.manager [req-1f2fb59f-5721-40c1-85ff-84c94259ad67 req-6d6ea82b-53c5-4b18-a74d-985dfe53ae4c service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:35:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1f2fb59f-5721-40c1-85ff-84c94259ad67 req-6d6ea82b-53c5-4b18-a74d-985dfe53ae4c service nova] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:35:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1f2fb59f-5721-40c1-85ff-84c94259ad67 req-6d6ea82b-53c5-4b18-a74d-985dfe53ae4c service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:35:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1f2fb59f-5721-40c1-85ff-84c94259ad67 req-6d6ea82b-53c5-4b18-a74d-985dfe53ae4c service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:35:56 user nova-compute[72782]: DEBUG nova.compute.manager [req-1f2fb59f-5721-40c1-85ff-84c94259ad67 req-6d6ea82b-53c5-4b18-a74d-985dfe53ae4c service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] No waiting events found dispatching network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:35:56 user nova-compute[72782]: WARNING nova.compute.manager [req-1f2fb59f-5721-40c1-85ff-84c94259ad67 req-6d6ea82b-53c5-4b18-a74d-985dfe53ae4c service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received unexpected event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d for instance with vm_state active and task_state None.
Aug 14 20:35:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:35:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:36:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:36:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:36:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:36:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:36:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:36:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:36:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:36:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:36:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:36:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:36:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:36:30 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:36:31 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:36:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:36:33 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:36:36 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:36:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:36:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:36:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:36:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:36:36 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:36:36 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:36:36 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updating instance_info_cache with network_info: [{"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:36:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-1ddcf095-6362-4b8f-82a1-e39eb6aa6661" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:36:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:36:36 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:36:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:36:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:36:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:36:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:36:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:36:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:36:39 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:36:39 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:36:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:36:42 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:36:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:36:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:36:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:36:42 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:36:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:36:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:36:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:36:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:36:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:36:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:36:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:36:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:36:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:36:43 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:36:43 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:36:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8619MB free_disk=25.254695892333984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:36:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:36:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:36:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:36:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 1c89dbd3-f4f3-4850-90de-df1bb0725428 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:36:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:36:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:36:43 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing inventories for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 20:36:43 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating ProviderTree inventory for provider d26c9e3b-40e6-476e-9664-3119ebf5873b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 20:36:43 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 20:36:43 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing aggregate associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, aggregates: None {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 20:36:43 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing trait associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 20:36:43 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:36:43 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:36:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:36:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:36:45 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:36:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:36:52 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:36:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:36:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:36:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:36:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:36:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:36:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:36:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:36:53 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 20:36:53 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] There are 0 instances to clean {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 20:36:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:36:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:36:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:36:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:36:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:36:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:37:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:37:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:37:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:37:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:37:15 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:37:15 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72782) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 20:37:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:37:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:37:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:37:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:37:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-27d84bfd-584a-4e60-ad05-9ef1f52d1d6b req-eebe8f06-fa40-4181-8ae6-1a7b1977b6b5 service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Received event network-changed-d52fbb0c-fde6-466b-a7e4-457a61cb1a54 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:37:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-27d84bfd-584a-4e60-ad05-9ef1f52d1d6b req-eebe8f06-fa40-4181-8ae6-1a7b1977b6b5 service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Refreshing instance network info cache due to event network-changed-d52fbb0c-fde6-466b-a7e4-457a61cb1a54. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:37:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-27d84bfd-584a-4e60-ad05-9ef1f52d1d6b req-eebe8f06-fa40-4181-8ae6-1a7b1977b6b5 service nova] Acquiring lock "refresh_cache-1c89dbd3-f4f3-4850-90de-df1bb0725428" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:37:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-27d84bfd-584a-4e60-ad05-9ef1f52d1d6b req-eebe8f06-fa40-4181-8ae6-1a7b1977b6b5 service nova] Acquired lock "refresh_cache-1c89dbd3-f4f3-4850-90de-df1bb0725428" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:37:24 user nova-compute[72782]: DEBUG nova.network.neutron [req-27d84bfd-584a-4e60-ad05-9ef1f52d1d6b req-eebe8f06-fa40-4181-8ae6-1a7b1977b6b5 service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Refreshing network info cache for port d52fbb0c-fde6-466b-a7e4-457a61cb1a54 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:37:25 user nova-compute[72782]: DEBUG nova.network.neutron [req-27d84bfd-584a-4e60-ad05-9ef1f52d1d6b req-eebe8f06-fa40-4181-8ae6-1a7b1977b6b5 service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Updated VIF entry in instance network info cache for port d52fbb0c-fde6-466b-a7e4-457a61cb1a54. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:37:25 user nova-compute[72782]: DEBUG nova.network.neutron [req-27d84bfd-584a-4e60-ad05-9ef1f52d1d6b req-eebe8f06-fa40-4181-8ae6-1a7b1977b6b5 service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Updating instance_info_cache with network_info: [{"id": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "address": "fa:16:3e:79:59:52", "network": {"id": "3950917a-144a-478a-8c45-2fa6b3d32be9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1798634352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a48d3656de48e5867d19ffad4029d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd52fbb0c-fd", "ovs_interfaceid": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:37:25 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-27d84bfd-584a-4e60-ad05-9ef1f52d1d6b req-eebe8f06-fa40-4181-8ae6-1a7b1977b6b5 service nova] Releasing lock "refresh_cache-1c89dbd3-f4f3-4850-90de-df1bb0725428" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:37:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Acquiring lock "1c89dbd3-f4f3-4850-90de-df1bb0725428" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:37:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:37:28 user nova-compute[72782]: DEBUG nova.objects.instance [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lazy-loading 'flavor' on Instance uuid 1c89dbd3-f4f3-4850-90de-df1bb0725428 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:37:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Acquiring lock "1c89dbd3-f4f3-4850-90de-df1bb0725428" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:37:29 user nova-compute[72782]: INFO nova.compute.manager [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Attaching volume db1c02b4-4804-4a22-915f-2cc566d95ee1 to /dev/vdb
Aug 14 20:37:29 user nova-compute[72782]: DEBUG os_brick.utils [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[698c7364-cf41-4278-84cc-f67c1754e97d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df85bdd-619f-4536-8aee-4863f33864a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc3e74d-9c25-41a3-a81b-deea7785ea16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5188d4f6-e7dd-47d5-a955-7e2fdde482d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:37:29 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:37:29 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a650f89b-8de7-4ddf-8917-0ef422fb4b11]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG os_brick.utils [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:37:29 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Updating existing volume attachment record: 3eb3caf6-56dd-4d1e-83a6-becc5e5cb5ce {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:37:32 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:37:32 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:37:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:33 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:37:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:36 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qleCgGvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:37:37 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:37:37 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:37:37 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47574d9-85c5-432c-b1ba-a5515961325c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:37:37 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8386c0-be00-4204-a011-e0e665be57b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1] added
Aug 14 20:37:37 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6f8b3b-601b-4232-bf8a-ad96df2cc412]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[711b4dce-342e-4d53-92ca-e20362f95651]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qleCgGvK {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qleCgGvK" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9befd1-a41d-4c05-b8ce-71e7e1d19d84]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qleCgGvK'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[610de5d6-cb1d-4c58-897d-ec940208a3c9]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5ebda6-f581-4976-a61f-621a387986fd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:37:37 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:37:37 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:37:37 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 20:37:37 user nova-compute[72782]: 
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e8a2e3-d2cf-43e3-aa8d-fa7c1b65af8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1, portal: 172.16.0.220,3260]
Aug 14 20:37:37 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1, portal: 172.16.0.220,3260] successful.
Aug 14 20:37:37 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc046c0-2e28-4f55-bbf8-9ba3c57a877e]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dcfc12-d8e7-40c5-9911-552a32528f88]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 (non-flash)
Aug 14 20:37:37 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 (non-flash)
Aug 14 20:37:37 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc166908-c3c6-4989-8ffa-ae26b5e4c8dd]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:37 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:37:38 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:37:38 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:37:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-1c89dbd3-f4f3-4850-90de-df1bb0725428" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:37:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-1c89dbd3-f4f3-4850-90de-df1bb0725428" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:37:38 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:37:38 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:37:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qleCgGvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:37:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:37:38 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26535643061666438', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:37:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535643061666438', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:37:38 user nova-compute[72782]: DEBUG nova.objects.instance [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lazy-loading 'flavor' on Instance uuid 1c89dbd3-f4f3-4850-90de-df1bb0725428 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:37:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 20:37:38 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:37:38 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:37:38 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:37:38 user nova-compute[72782]:   <serial>db1c02b4-4804-4a22-915f-2cc566d95ee1</serial>
Aug 14 20:37:38 user nova-compute[72782]: </disk>
Aug 14 20:37:38 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 20:37:38 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Updating instance_info_cache with network_info: [{"id": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "address": "fa:16:3e:79:59:52", "network": {"id": "3950917a-144a-478a-8c45-2fa6b3d32be9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1798634352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a48d3656de48e5867d19ffad4029d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd52fbb0c-fd", "ovs_interfaceid": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:37:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-1c89dbd3-f4f3-4850-90de-df1bb0725428" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:37:38 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:37:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:37:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:37:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] No VIF found with MAC fa:16:3e:79:59:52, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:37:39 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:37:39 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:37:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:37:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-08546098-2beb-4cc5-956a-1d5fbf3d9b6d tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.058s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:37:40 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:37:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Acquiring lock "1c89dbd3-f4f3-4850-90de-df1bb0725428" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:37:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:37:40 user nova-compute[72782]: INFO nova.compute.manager [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Detaching volume db1c02b4-4804-4a22-915f-2cc566d95ee1
Aug 14 20:37:40 user nova-compute[72782]: INFO nova.virt.block_device [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Attempting to driver detach volume db1c02b4-4804-4a22-915f-2cc566d95ee1 from mountpoint /dev/vdb
Aug 14 20:37:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Attempting to detach device vdb from instance 1c89dbd3-f4f3-4850-90de-df1bb0725428 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 20:37:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:37:40 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:37:40 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:37:40 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:37:40 user nova-compute[72782]:   <serial>db1c02b4-4804-4a22-915f-2cc566d95ee1</serial>
Aug 14 20:37:40 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 20:37:40 user nova-compute[72782]: </disk>
Aug 14 20:37:40 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:37:40 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Successfully detached device vdb from instance 1c89dbd3-f4f3-4850-90de-df1bb0725428 from the persistent domain config.
Aug 14 20:37:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1c89dbd3-f4f3-4850-90de-df1bb0725428 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 20:37:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:37:40 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:37:40 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:37:40 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:37:40 user nova-compute[72782]:   <serial>db1c02b4-4804-4a22-915f-2cc566d95ee1</serial>
Aug 14 20:37:40 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 20:37:40 user nova-compute[72782]: </disk>
Aug 14 20:37:40 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692045461.4037693, 1c89dbd3-f4f3-4850-90de-df1bb0725428 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1c89dbd3-f4f3-4850-90de-df1bb0725428 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 20:37:41 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Successfully detached device vdb from instance 1c89dbd3-f4f3-4850-90de-df1bb0725428 from the live domain config.
Aug 14 20:37:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qleCgGvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:37:41 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:37:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4946218d-f39a-434b-ae58-44b1eaee339e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[188ca747-fa85-4c9e-b5a5-b2c7d235ec14]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 (non-flash)
Aug 14 20:37:41 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 (non-flash)
Aug 14 20:37:41 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f64087d8550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6ab62c-ff5f-431f-9336-0669b6e7497e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1eb98d-08d2-4eea-9bd7-030a1bb24a1c]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[da35b4aa-72db-451f-86e6-00739c68ada4]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b66469-ce30-4049-af41-2ee405f642fc]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4c0172-d24a-42c8-8663-efcb3f1d184a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a3b42a-1535-4a52-88da-c6fb011762b8]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1, portal: 172.16.0.220,3260]
Aug 14 20:37:41 user nova-compute[72782]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1, portal: 172.16.0.220,3260] successful.
Aug 14 20:37:41 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c02b4-4804-4a22-915f-2cc566d95ee1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[348cc520-6aaa-40a9-af61-aa76d4b75c81]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] <== disconnect_volume: return (267ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:37:41 user nova-compute[72782]: INFO nova.compute.manager [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Terminating instance
Aug 14 20:37:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG nova.compute.manager [req-130f4a54-17cf-4818-b3e2-5246b75a2474 req-3dbcc35f-c563-4e2b-9596-77c3c2e726ca service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-vif-unplugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-130f4a54-17cf-4818-b3e2-5246b75a2474 req-3dbcc35f-c563-4e2b-9596-77c3c2e726ca service nova] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-130f4a54-17cf-4818-b3e2-5246b75a2474 req-3dbcc35f-c563-4e2b-9596-77c3c2e726ca service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-130f4a54-17cf-4818-b3e2-5246b75a2474 req-3dbcc35f-c563-4e2b-9596-77c3c2e726ca service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG nova.compute.manager [req-130f4a54-17cf-4818-b3e2-5246b75a2474 req-3dbcc35f-c563-4e2b-9596-77c3c2e726ca service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] No waiting events found dispatching network-vif-unplugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG nova.compute.manager [req-130f4a54-17cf-4818-b3e2-5246b75a2474 req-3dbcc35f-c563-4e2b-9596-77c3c2e726ca service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-vif-unplugged-28c18d55-ae94-446a-a394-f686216e197d for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG nova.objects.instance [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lazy-loading 'flavor' on Instance uuid 1c89dbd3-f4f3-4850-90de-df1bb0725428 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-10c1b387-fa98-42d4-b7f3-713ea0bd1d1c tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.627s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:37:42 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Instance destroyed successfully.
Aug 14 20:37:42 user nova-compute[72782]: DEBUG nova.objects.instance [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'resources' on Instance uuid 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:28:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1438697692',display_name='tempest-AttachVolumeTestJSON-server-1438697692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1438697692',id=43,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIZMdrvcAObDrQOnw6Z4cKMh8UkLd6T6hnSQkZurL1/AHHX+HwCM+yXwzFIxmNtn58wn91JRRMK8D/OvNJqPJOxQJGzDkEoynLrq1UHzUwGYj+LHuUngHZijLDOQbeXkw==',key_name='tempest-keypair-314886705',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:28:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21ca996ad34a4a55994ae92a688f349f',ramdisk_id='',reservation_id='r-kxmp5hcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-434447893',owner_user_name='tempest-AttachVolumeTestJSON-434447893-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:35:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeb23a424fd4eabb174c5630f36956d',uuid=1ddcf095-6362-4b8f-82a1-e39eb6aa6661,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converting VIF {"id": "28c18d55-ae94-446a-a394-f686216e197d", "address": "fa:16:3e:24:a9:dc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c18d55-ae", "ovs_interfaceid": "28c18d55-ae94-446a-a394-f686216e197d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG os_vif [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28c18d55-ae, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:37:42 user nova-compute[72782]: INFO os_vif [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:a9:dc,bridge_name='br-int',has_traffic_filtering=True,id=28c18d55-ae94-446a-a394-f686216e197d,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c18d55-ae')
Aug 14 20:37:42 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Deleting instance files /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661_del
Aug 14 20:37:42 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Deletion of /opt/stack/data/nova/instances/1ddcf095-6362-4b8f-82a1-e39eb6aa6661_del complete
Aug 14 20:37:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:42 user nova-compute[72782]: INFO nova.compute.manager [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 14 20:37:42 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:42 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:37:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:37:43 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Error from libvirt while getting description of instance-0000002b: [Error Code 42] Domain not found: no domain with matching uuid '1ddcf095-6362-4b8f-82a1-e39eb6aa6661' (instance-0000002b): libvirt.libvirtError: Domain not found: no domain with matching uuid '1ddcf095-6362-4b8f-82a1-e39eb6aa6661' (instance-0000002b)
Aug 14 20:37:43 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:37:43 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:37:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8677MB free_disk=25.253459930419922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:37:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:37:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:37:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:37:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 1c89dbd3-f4f3-4850-90de-df1bb0725428 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:37:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:37:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:37:43 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:37:43 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:37:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:37:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:37:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:43 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:37:43 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Took 1.15 seconds to deallocate network for instance.
Aug 14 20:37:44 user nova-compute[72782]: DEBUG nova.compute.manager [req-f01b2bc8-a736-4cbb-9ccf-efadea2a812a req-d44ddcab-1b82-4d96-8edf-c6152bf05e5c service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-vif-deleted-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:37:44 user nova-compute[72782]: INFO nova.compute.manager [req-f01b2bc8-a736-4cbb-9ccf-efadea2a812a req-d44ddcab-1b82-4d96-8edf-c6152bf05e5c service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Neutron deleted interface 28c18d55-ae94-446a-a394-f686216e197d; detaching it from the instance and deleting it from the info cache
Aug 14 20:37:44 user nova-compute[72782]: DEBUG nova.network.neutron [req-f01b2bc8-a736-4cbb-9ccf-efadea2a812a req-d44ddcab-1b82-4d96-8edf-c6152bf05e5c service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:37:44 user nova-compute[72782]: DEBUG nova.compute.manager [req-f01b2bc8-a736-4cbb-9ccf-efadea2a812a req-d44ddcab-1b82-4d96-8edf-c6152bf05e5c service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Detach interface failed, port_id=28c18d55-ae94-446a-a394-f686216e197d, reason: Instance 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 20:37:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:37:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:37:44 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:37:44 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:37:44 user nova-compute[72782]: DEBUG nova.compute.manager [req-6365fe24-06a5-4e9d-8356-220ad3eb9cc1 req-36a765c6-8e29-4a54-b16e-4eef317d0f58 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:37:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6365fe24-06a5-4e9d-8356-220ad3eb9cc1 req-36a765c6-8e29-4a54-b16e-4eef317d0f58 service nova] Acquiring lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:37:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6365fe24-06a5-4e9d-8356-220ad3eb9cc1 req-36a765c6-8e29-4a54-b16e-4eef317d0f58 service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:37:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6365fe24-06a5-4e9d-8356-220ad3eb9cc1 req-36a765c6-8e29-4a54-b16e-4eef317d0f58 service nova] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:37:44 user nova-compute[72782]: DEBUG nova.compute.manager [req-6365fe24-06a5-4e9d-8356-220ad3eb9cc1 req-36a765c6-8e29-4a54-b16e-4eef317d0f58 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] No waiting events found dispatching network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:37:44 user nova-compute[72782]: WARNING nova.compute.manager [req-6365fe24-06a5-4e9d-8356-220ad3eb9cc1 req-36a765c6-8e29-4a54-b16e-4eef317d0f58 service nova] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Received unexpected event network-vif-plugged-28c18d55-ae94-446a-a394-f686216e197d for instance with vm_state deleted and task_state None.
Aug 14 20:37:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:37:44 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Deleted allocations for instance 1ddcf095-6362-4b8f-82a1-e39eb6aa6661
Aug 14 20:37:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-bffe2785-085d-46ff-bb90-a4f026a2d8a7 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "1ddcf095-6362-4b8f-82a1-e39eb6aa6661" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.486s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:37:47 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:37:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:37:57 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692045462.6774611, 1ddcf095-6362-4b8f-82a1-e39eb6aa6661 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:37:57 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] VM Stopped (Lifecycle Event)
Aug 14 20:37:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-065849a7-c9d1-41ea-89fb-b21c0283601f None None] [instance: 1ddcf095-6362-4b8f-82a1-e39eb6aa6661] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:37:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:37:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:37:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:37:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:37:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:37:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:37:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:38:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:38:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:38:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:38:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:38:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:38:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:32 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:38:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:33 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:38:34 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:38:36 user nova-compute[72782]: INFO nova.compute.claims [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Claim successful on node user
Aug 14 20:38:36 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG nova.network.neutron [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:38:36 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:38:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Acquiring lock "1c89dbd3-f4f3-4850-90de-df1bb0725428" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Acquiring lock "1c89dbd3-f4f3-4850-90de-df1bb0725428-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:38:36 user nova-compute[72782]: INFO nova.compute.manager [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Terminating instance
Aug 14 20:38:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG nova.policy [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7aeb23a424fd4eabb174c5630f36956d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ca996ad34a4a55994ae92a688f349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:38:36 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Creating image(s)
Aug 14 20:38:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "/opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "/opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:38:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.187s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-d3cacaed-f5c9-445e-a374-958c22693238 req-1fa8ee28-1062-4e6c-aba6-f096007f8ee8 service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Received event network-vif-unplugged-d52fbb0c-fde6-466b-a7e4-457a61cb1a54 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d3cacaed-f5c9-445e-a374-958c22693238 req-1fa8ee28-1062-4e6c-aba6-f096007f8ee8 service nova] Acquiring lock "1c89dbd3-f4f3-4850-90de-df1bb0725428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d3cacaed-f5c9-445e-a374-958c22693238 req-1fa8ee28-1062-4e6c-aba6-f096007f8ee8 service nova] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d3cacaed-f5c9-445e-a374-958c22693238 req-1fa8ee28-1062-4e6c-aba6-f096007f8ee8 service nova] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-d3cacaed-f5c9-445e-a374-958c22693238 req-1fa8ee28-1062-4e6c-aba6-f096007f8ee8 service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] No waiting events found dispatching network-vif-unplugged-d52fbb0c-fde6-466b-a7e4-457a61cb1a54 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-d3cacaed-f5c9-445e-a374-958c22693238 req-1fa8ee28-1062-4e6c-aba6-f096007f8ee8 service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Received event network-vif-unplugged-d52fbb0c-fde6-466b-a7e4-457a61cb1a54 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.203s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk 1073741824" returned: 0 in 0.058s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG nova.network.neutron [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Successfully created port: 1476238e-b61a-40bd-bcbd-424a83f30ee3 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:38:37 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Instance destroyed successfully.
Aug 14 20:38:37 user nova-compute[72782]: DEBUG nova.objects.instance [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lazy-loading 'resources' on Instance uuid 1c89dbd3-f4f3-4850-90de-df1bb0725428 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-959340175',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-959340175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9593401',id=45,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa0kFhRXaxwRKKId4bejRAGxr7vS2GmHoEryXhRK3O5+dCK/Wgm3cyjvRXIqpj4wla7NoP1CbdZ+pVnTbQG8649u84CFEQJ92YhFXu5hn5Y1owej3Se0WklXTCD+uEXRg==',key_name='tempest-keypair-1629698876',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:35:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16a48d3656de48e5867d19ffad4029d1',ramdisk_id='',reservation_id='r-w10hr5vs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-207096709',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:35:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8d3b9482d4e4262905a91b9c8401523',uuid=1c89dbd3-f4f3-4850-90de-df1bb0725428,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "address": "fa:16:3e:79:59:52", "network": {"id": "3950917a-144a-478a-8c45-2fa6b3d32be9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1798634352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a48d3656de48e5867d19ffad4029d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd52fbb0c-fd", "ovs_interfaceid": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Converting VIF {"id": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "address": "fa:16:3e:79:59:52", "network": {"id": "3950917a-144a-478a-8c45-2fa6b3d32be9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1798634352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a48d3656de48e5867d19ffad4029d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd52fbb0c-fd", "ovs_interfaceid": "d52fbb0c-fde6-466b-a7e4-457a61cb1a54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:59:52,bridge_name='br-int',has_traffic_filtering=True,id=d52fbb0c-fde6-466b-a7e4-457a61cb1a54,network=Network(3950917a-144a-478a-8c45-2fa6b3d32be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd52fbb0c-fd') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG os_vif [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:59:52,bridge_name='br-int',has_traffic_filtering=True,id=d52fbb0c-fde6-466b-a7e4-457a61cb1a54,network=Network(3950917a-144a-478a-8c45-2fa6b3d32be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd52fbb0c-fd') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd52fbb0c-fd, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:38:37 user nova-compute[72782]: INFO os_vif [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:59:52,bridge_name='br-int',has_traffic_filtering=True,id=d52fbb0c-fde6-466b-a7e4-457a61cb1a54,network=Network(3950917a-144a-478a-8c45-2fa6b3d32be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd52fbb0c-fd')
Aug 14 20:38:37 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Deleting instance files /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428_del
Aug 14 20:38:37 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Deletion of /opt/stack/data/nova/instances/1c89dbd3-f4f3-4850-90de-df1bb0725428_del complete
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Cannot resize image /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG nova.objects.instance [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'migration_context' on Instance uuid a5aeb519-2bcf-4714-a608-c6fcd918355b {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Ensure instance console log exists: /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:38:37 user nova-compute[72782]: INFO nova.compute.manager [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 14 20:38:37 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:38:37 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:38:38 user nova-compute[72782]: DEBUG nova.network.neutron [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Successfully updated port: 1476238e-b61a-40bd-bcbd-424a83f30ee3 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:38:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "refresh_cache-a5aeb519-2bcf-4714-a608-c6fcd918355b" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:38:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquired lock "refresh_cache-a5aeb519-2bcf-4714-a608-c6fcd918355b" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:38:38 user nova-compute[72782]: DEBUG nova.network.neutron [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:38:38 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:38:38 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Took 0.85 seconds to deallocate network for instance.
Aug 14 20:38:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-50177875-bb32-4621-9c9a-3d4d1567fc8d req-54acb39c-a879-479b-a890-018145443817 service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Received event network-changed-1476238e-b61a-40bd-bcbd-424a83f30ee3 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:38:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-50177875-bb32-4621-9c9a-3d4d1567fc8d req-54acb39c-a879-479b-a890-018145443817 service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Refreshing instance network info cache due to event network-changed-1476238e-b61a-40bd-bcbd-424a83f30ee3. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:38:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-50177875-bb32-4621-9c9a-3d4d1567fc8d req-54acb39c-a879-479b-a890-018145443817 service nova] Acquiring lock "refresh_cache-a5aeb519-2bcf-4714-a608-c6fcd918355b" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:38:38 user nova-compute[72782]: DEBUG nova.network.neutron [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:38:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:38:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:38:38 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:38:38 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:38:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:38:38 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Deleted allocations for instance 1c89dbd3-f4f3-4850-90de-df1bb0725428
Aug 14 20:38:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-778bbc4c-b306-4172-b303-b736e7aeea47 tempest-TestServerVolumeAttachScenarioOldVersion-207096709 tempest-TestServerVolumeAttachScenarioOldVersion-207096709-project-member] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.264s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:38:38 user nova-compute[72782]: DEBUG nova.network.neutron [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Updating instance_info_cache with network_info: [{"id": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "address": "fa:16:3e:23:29:bc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1476238e-b6", "ovs_interfaceid": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Releasing lock "refresh_cache-a5aeb519-2bcf-4714-a608-c6fcd918355b" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Instance network_info: |[{"id": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "address": "fa:16:3e:23:29:bc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1476238e-b6", "ovs_interfaceid": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-50177875-bb32-4621-9c9a-3d4d1567fc8d req-54acb39c-a879-479b-a890-018145443817 service nova] Acquired lock "refresh_cache-a5aeb519-2bcf-4714-a608-c6fcd918355b" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.network.neutron [req-50177875-bb32-4621-9c9a-3d4d1567fc8d req-54acb39c-a879-479b-a890-018145443817 service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Refreshing network info cache for port 1476238e-b61a-40bd-bcbd-424a83f30ee3 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Start _get_guest_xml network_info=[{"id": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "address": "fa:16:3e:23:29:bc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1476238e-b6", "ovs_interfaceid": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:38:39 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:38:39 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Skipping network cache update for instance because it is Building. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:38:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1155773775',display_name='tempest-AttachVolumeTestJSON-server-1155773775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1155773775',id=46,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZLQzzv+ub5k2/7fR+m0OZ+PatJy8MpK0xwWWTIznEM406eHwydJ3QW2uBiJG8apUl01uRT70cIpsByhafaMMDcg+jafvbPeKNmIjcjnbxLhpTLy/tueJ28v3NS+Y5/AA==',key_name='tempest-keypair-58190085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21ca996ad34a4a55994ae92a688f349f',ramdisk_id='',reservation_id='r-fkvdox0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-434447893',owner_user_name='tempest-AttachVolumeTestJSON-434447893-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeb23a424fd4eabb174c5630f36956d',uuid=a5aeb519-2bcf-4714-a608-c6fcd918355b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "address": "fa:16:3e:23:29:bc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1476238e-b6", "ovs_interfaceid": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converting VIF {"id": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "address": "fa:16:3e:23:29:bc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1476238e-b6", "ovs_interfaceid": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:29:bc,bridge_name='br-int',has_traffic_filtering=True,id=1476238e-b61a-40bd-bcbd-424a83f30ee3,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1476238e-b6') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.objects.instance [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'pci_devices' on Instance uuid a5aeb519-2bcf-4714-a608-c6fcd918355b {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:38:39 user nova-compute[72782]:   <uuid>a5aeb519-2bcf-4714-a608-c6fcd918355b</uuid>
Aug 14 20:38:39 user nova-compute[72782]:   <name>instance-0000002e</name>
Aug 14 20:38:39 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:38:39 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:38:39 user nova-compute[72782]:   <metadata>
Aug 14 20:38:39 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:38:39 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:38:39 user nova-compute[72782]:       <nova:name>tempest-AttachVolumeTestJSON-server-1155773775</nova:name>
Aug 14 20:38:39 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:38:39</nova:creationTime>
Aug 14 20:38:39 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:38:39 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:38:39 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:38:39 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:38:39 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:38:39 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:38:39 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:38:39 user nova-compute[72782]:       <nova:owner>
Aug 14 20:38:39 user nova-compute[72782]:         <nova:user uuid="7aeb23a424fd4eabb174c5630f36956d">tempest-AttachVolumeTestJSON-434447893-project-member</nova:user>
Aug 14 20:38:39 user nova-compute[72782]:         <nova:project uuid="21ca996ad34a4a55994ae92a688f349f">tempest-AttachVolumeTestJSON-434447893</nova:project>
Aug 14 20:38:39 user nova-compute[72782]:       </nova:owner>
Aug 14 20:38:39 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 20:38:39 user nova-compute[72782]:       <nova:ports>
Aug 14 20:38:39 user nova-compute[72782]:         <nova:port uuid="1476238e-b61a-40bd-bcbd-424a83f30ee3">
Aug 14 20:38:39 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 20:38:39 user nova-compute[72782]:         </nova:port>
Aug 14 20:38:39 user nova-compute[72782]:       </nova:ports>
Aug 14 20:38:39 user nova-compute[72782]:     </nova:instance>
Aug 14 20:38:39 user nova-compute[72782]:   </metadata>
Aug 14 20:38:39 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:38:39 user nova-compute[72782]:     <system>
Aug 14 20:38:39 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:38:39 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:38:39 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:38:39 user nova-compute[72782]:       <entry name="serial">a5aeb519-2bcf-4714-a608-c6fcd918355b</entry>
Aug 14 20:38:39 user nova-compute[72782]:       <entry name="uuid">a5aeb519-2bcf-4714-a608-c6fcd918355b</entry>
Aug 14 20:38:39 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:38:39 user nova-compute[72782]:     </system>
Aug 14 20:38:39 user nova-compute[72782]:   </sysinfo>
Aug 14 20:38:39 user nova-compute[72782]:   <os>
Aug 14 20:38:39 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:38:39 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:38:39 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:38:39 user nova-compute[72782]:   </os>
Aug 14 20:38:39 user nova-compute[72782]:   <features>
Aug 14 20:38:39 user nova-compute[72782]:     <acpi/>
Aug 14 20:38:39 user nova-compute[72782]:     <apic/>
Aug 14 20:38:39 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:38:39 user nova-compute[72782]:   </features>
Aug 14 20:38:39 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:38:39 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:38:39 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:38:39 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:38:39 user nova-compute[72782]:   </clock>
Aug 14 20:38:39 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:38:39 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:38:39 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:38:39 user nova-compute[72782]:   </cpu>
Aug 14 20:38:39 user nova-compute[72782]:   <devices>
Aug 14 20:38:39 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 20:38:39 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 20:38:39 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk"/>
Aug 14 20:38:39 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:38:39 user nova-compute[72782]:     </disk>
Aug 14 20:38:39 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:38:39 user nova-compute[72782]:       <mac address="fa:16:3e:23:29:bc"/>
Aug 14 20:38:39 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:38:39 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:38:39 user nova-compute[72782]:       <target dev="tap1476238e-b6"/>
Aug 14 20:38:39 user nova-compute[72782]:     </interface>
Aug 14 20:38:39 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:38:39 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/console.log" append="off"/>
Aug 14 20:38:39 user nova-compute[72782]:     </serial>
Aug 14 20:38:39 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:38:39 user nova-compute[72782]:     <video>
Aug 14 20:38:39 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:38:39 user nova-compute[72782]:     </video>
Aug 14 20:38:39 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:38:39 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:38:39 user nova-compute[72782]:     </rng>
Aug 14 20:38:39 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:38:39 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:38:39 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:38:39 user nova-compute[72782]:     </memballoon>
Aug 14 20:38:39 user nova-compute[72782]:   </devices>
Aug 14 20:38:39 user nova-compute[72782]: </domain>
Aug 14 20:38:39 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:38:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1155773775',display_name='tempest-AttachVolumeTestJSON-server-1155773775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1155773775',id=46,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZLQzzv+ub5k2/7fR+m0OZ+PatJy8MpK0xwWWTIznEM406eHwydJ3QW2uBiJG8apUl01uRT70cIpsByhafaMMDcg+jafvbPeKNmIjcjnbxLhpTLy/tueJ28v3NS+Y5/AA==',key_name='tempest-keypair-58190085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21ca996ad34a4a55994ae92a688f349f',ramdisk_id='',reservation_id='r-fkvdox0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-434447893',owner_user_name='tempest-AttachVolumeTestJSON-434447893-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeb23a424fd4eabb174c5630f36956d',uuid=a5aeb519-2bcf-4714-a608-c6fcd918355b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "address": "fa:16:3e:23:29:bc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1476238e-b6", "ovs_interfaceid": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converting VIF {"id": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "address": "fa:16:3e:23:29:bc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1476238e-b6", "ovs_interfaceid": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:29:bc,bridge_name='br-int',has_traffic_filtering=True,id=1476238e-b61a-40bd-bcbd-424a83f30ee3,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1476238e-b6') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG os_vif [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:29:bc,bridge_name='br-int',has_traffic_filtering=True,id=1476238e-b61a-40bd-bcbd-424a83f30ee3,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1476238e-b6') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1476238e-b6, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1476238e-b6, col_values=(('external_ids', {'iface-id': '1476238e-b61a-40bd-bcbd-424a83f30ee3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:29:bc', 'vm-uuid': 'a5aeb519-2bcf-4714-a608-c6fcd918355b'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:39 user nova-compute[72782]: INFO os_vif [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:29:bc,bridge_name='br-int',has_traffic_filtering=True,id=1476238e-b61a-40bd-bcbd-424a83f30ee3,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1476238e-b6')
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] No VIF found with MAC fa:16:3e:23:29:bc, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-2cd04c6f-e266-4ac1-8b0a-5c5405eed469 req-dfb82817-ceff-4936-9bfa-3e6306c25cb1 service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Received event network-vif-plugged-d52fbb0c-fde6-466b-a7e4-457a61cb1a54 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2cd04c6f-e266-4ac1-8b0a-5c5405eed469 req-dfb82817-ceff-4936-9bfa-3e6306c25cb1 service nova] Acquiring lock "1c89dbd3-f4f3-4850-90de-df1bb0725428-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2cd04c6f-e266-4ac1-8b0a-5c5405eed469 req-dfb82817-ceff-4936-9bfa-3e6306c25cb1 service nova] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2cd04c6f-e266-4ac1-8b0a-5c5405eed469 req-dfb82817-ceff-4936-9bfa-3e6306c25cb1 service nova] Lock "1c89dbd3-f4f3-4850-90de-df1bb0725428-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-2cd04c6f-e266-4ac1-8b0a-5c5405eed469 req-dfb82817-ceff-4936-9bfa-3e6306c25cb1 service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] No waiting events found dispatching network-vif-plugged-d52fbb0c-fde6-466b-a7e4-457a61cb1a54 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:38:39 user nova-compute[72782]: WARNING nova.compute.manager [req-2cd04c6f-e266-4ac1-8b0a-5c5405eed469 req-dfb82817-ceff-4936-9bfa-3e6306c25cb1 service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Received unexpected event network-vif-plugged-d52fbb0c-fde6-466b-a7e4-457a61cb1a54 for instance with vm_state deleted and task_state None.
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.compute.manager [req-2cd04c6f-e266-4ac1-8b0a-5c5405eed469 req-dfb82817-ceff-4936-9bfa-3e6306c25cb1 service nova] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Received event network-vif-deleted-d52fbb0c-fde6-466b-a7e4-457a61cb1a54 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.network.neutron [req-50177875-bb32-4621-9c9a-3d4d1567fc8d req-54acb39c-a879-479b-a890-018145443817 service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Updated VIF entry in instance network info cache for port 1476238e-b61a-40bd-bcbd-424a83f30ee3. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG nova.network.neutron [req-50177875-bb32-4621-9c9a-3d4d1567fc8d req-54acb39c-a879-479b-a890-018145443817 service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Updating instance_info_cache with network_info: [{"id": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "address": "fa:16:3e:23:29:bc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1476238e-b6", "ovs_interfaceid": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:38:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-50177875-bb32-4621-9c9a-3d4d1567fc8d req-54acb39c-a879-479b-a890-018145443817 service nova] Releasing lock "refresh_cache-a5aeb519-2bcf-4714-a608-c6fcd918355b" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:38:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:40 user nova-compute[72782]: DEBUG nova.compute.manager [req-9f2a6cc8-46e5-4eac-86a9-7fbbe129b03d req-7a07545e-a106-480d-9ca1-6544e0bcfd2c service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Received event network-vif-plugged-1476238e-b61a-40bd-bcbd-424a83f30ee3 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:38:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9f2a6cc8-46e5-4eac-86a9-7fbbe129b03d req-7a07545e-a106-480d-9ca1-6544e0bcfd2c service nova] Acquiring lock "a5aeb519-2bcf-4714-a608-c6fcd918355b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:38:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9f2a6cc8-46e5-4eac-86a9-7fbbe129b03d req-7a07545e-a106-480d-9ca1-6544e0bcfd2c service nova] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:38:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-9f2a6cc8-46e5-4eac-86a9-7fbbe129b03d req-7a07545e-a106-480d-9ca1-6544e0bcfd2c service nova] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:38:40 user nova-compute[72782]: DEBUG nova.compute.manager [req-9f2a6cc8-46e5-4eac-86a9-7fbbe129b03d req-7a07545e-a106-480d-9ca1-6544e0bcfd2c service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] No waiting events found dispatching network-vif-plugged-1476238e-b61a-40bd-bcbd-424a83f30ee3 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:38:40 user nova-compute[72782]: WARNING nova.compute.manager [req-9f2a6cc8-46e5-4eac-86a9-7fbbe129b03d req-7a07545e-a106-480d-9ca1-6544e0bcfd2c service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Received unexpected event network-vif-plugged-1476238e-b61a-40bd-bcbd-424a83f30ee3 for instance with vm_state building and task_state spawning.
Aug 14 20:38:41 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:38:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:38:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:42 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:38:42 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692045522.5758736, a5aeb519-2bcf-4714-a608-c6fcd918355b => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:38:42 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] VM Resumed (Lifecycle Event)
Aug 14 20:38:42 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:38:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:38:42 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Instance spawned successfully.
Aug 14 20:38:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:38:42 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:38:42 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:38:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:38:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:38:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:38:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:38:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:38:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:38:42 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:38:42 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692045522.5778258, a5aeb519-2bcf-4714-a608-c6fcd918355b => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:38:42 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] VM Started (Lifecycle Event)
Aug 14 20:38:42 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:38:42 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:38:42 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:38:42 user nova-compute[72782]: INFO nova.compute.manager [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 14 20:38:42 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:38:42 user nova-compute[72782]: DEBUG nova.compute.manager [req-e91c7ec4-3f4f-41a6-8c42-14da158f7a64 req-eb58b234-b5c6-4ecf-919d-e7690f704b5b service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Received event network-vif-plugged-1476238e-b61a-40bd-bcbd-424a83f30ee3 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:38:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e91c7ec4-3f4f-41a6-8c42-14da158f7a64 req-eb58b234-b5c6-4ecf-919d-e7690f704b5b service nova] Acquiring lock "a5aeb519-2bcf-4714-a608-c6fcd918355b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:38:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e91c7ec4-3f4f-41a6-8c42-14da158f7a64 req-eb58b234-b5c6-4ecf-919d-e7690f704b5b service nova] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:38:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e91c7ec4-3f4f-41a6-8c42-14da158f7a64 req-eb58b234-b5c6-4ecf-919d-e7690f704b5b service nova] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:38:42 user nova-compute[72782]: DEBUG nova.compute.manager [req-e91c7ec4-3f4f-41a6-8c42-14da158f7a64 req-eb58b234-b5c6-4ecf-919d-e7690f704b5b service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] No waiting events found dispatching network-vif-plugged-1476238e-b61a-40bd-bcbd-424a83f30ee3 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:38:42 user nova-compute[72782]: WARNING nova.compute.manager [req-e91c7ec4-3f4f-41a6-8c42-14da158f7a64 req-eb58b234-b5c6-4ecf-919d-e7690f704b5b service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Received unexpected event network-vif-plugged-1476238e-b61a-40bd-bcbd-424a83f30ee3 for instance with vm_state building and task_state spawning.
Aug 14 20:38:42 user nova-compute[72782]: INFO nova.compute.manager [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Took 6.42 seconds to build instance.
Aug 14 20:38:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b8dd127f-91a8-4ecc-bc95-54ee8798c4f5 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.527s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:38:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:38:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:38:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:38:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:38:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:38:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:38:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:38:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:38:43 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:38:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:43 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:38:43 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:38:43 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8771MB free_disk=25.29950714111328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:38:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:38:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:38:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:44 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance a5aeb519-2bcf-4714-a608-c6fcd918355b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:38:44 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:38:44 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:38:44 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:38:44 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:38:44 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:38:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:38:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:38:49 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:38:52 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692045517.5425463, 1c89dbd3-f4f3-4850-90de-df1bb0725428 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:38:52 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] VM Stopped (Lifecycle Event)
Aug 14 20:38:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-574c6b78-e0c6-472a-a590-763c83f26445 None None] [instance: 1c89dbd3-f4f3-4850-90de-df1bb0725428] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:38:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:38:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:38:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:39:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:39:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:39:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:39:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:39:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:39:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:39:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:39:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:39:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:39:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:39:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:39:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:39:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:39:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:39:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:39:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:39:34 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:39:34 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:39:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:39:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:39:35 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:39:36 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:39:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:39:40 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:39:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:39:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:39:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-a5aeb519-2bcf-4714-a608-c6fcd918355b" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:39:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-a5aeb519-2bcf-4714-a608-c6fcd918355b" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:39:40 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:39:40 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid a5aeb519-2bcf-4714-a608-c6fcd918355b {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:39:40 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Updating instance_info_cache with network_info: [{"id": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "address": "fa:16:3e:23:29:bc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1476238e-b6", "ovs_interfaceid": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:39:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-a5aeb519-2bcf-4714-a608-c6fcd918355b" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:39:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:39:42 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:39:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:39:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:39:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:39:44 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:39:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:39:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:39:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:39:44 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:39:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:39:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:39:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:39:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:39:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:39:44 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:39:44 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:39:44 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8726MB free_disk=25.27039337158203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:39:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:39:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:39:44 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance a5aeb519-2bcf-4714-a608-c6fcd918355b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:39:44 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:39:44 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:39:45 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:39:45 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:39:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:39:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:39:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:39:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:39:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:39:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:40:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:40:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:40:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:40:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:40:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:40:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:40:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:40:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:40:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:40:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:40:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:40:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:40:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:40:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:40:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:40:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-eead8f76-5e18-4cf7-a590-c94a05a9f916 req-7838fa42-bd15-4a40-acea-cd1a0b584e1e service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Received event network-changed-1476238e-b61a-40bd-bcbd-424a83f30ee3 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:40:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-eead8f76-5e18-4cf7-a590-c94a05a9f916 req-7838fa42-bd15-4a40-acea-cd1a0b584e1e service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Refreshing instance network info cache due to event network-changed-1476238e-b61a-40bd-bcbd-424a83f30ee3. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:40:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eead8f76-5e18-4cf7-a590-c94a05a9f916 req-7838fa42-bd15-4a40-acea-cd1a0b584e1e service nova] Acquiring lock "refresh_cache-a5aeb519-2bcf-4714-a608-c6fcd918355b" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:40:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eead8f76-5e18-4cf7-a590-c94a05a9f916 req-7838fa42-bd15-4a40-acea-cd1a0b584e1e service nova] Acquired lock "refresh_cache-a5aeb519-2bcf-4714-a608-c6fcd918355b" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:40:27 user nova-compute[72782]: DEBUG nova.network.neutron [req-eead8f76-5e18-4cf7-a590-c94a05a9f916 req-7838fa42-bd15-4a40-acea-cd1a0b584e1e service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Refreshing network info cache for port 1476238e-b61a-40bd-bcbd-424a83f30ee3 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:40:27 user nova-compute[72782]: DEBUG nova.network.neutron [req-eead8f76-5e18-4cf7-a590-c94a05a9f916 req-7838fa42-bd15-4a40-acea-cd1a0b584e1e service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Updated VIF entry in instance network info cache for port 1476238e-b61a-40bd-bcbd-424a83f30ee3. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:40:27 user nova-compute[72782]: DEBUG nova.network.neutron [req-eead8f76-5e18-4cf7-a590-c94a05a9f916 req-7838fa42-bd15-4a40-acea-cd1a0b584e1e service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Updating instance_info_cache with network_info: [{"id": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "address": "fa:16:3e:23:29:bc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1476238e-b6", "ovs_interfaceid": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:40:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-eead8f76-5e18-4cf7-a590-c94a05a9f916 req-7838fa42-bd15-4a40-acea-cd1a0b584e1e service nova] Releasing lock "refresh_cache-a5aeb519-2bcf-4714-a608-c6fcd918355b" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:40:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:40:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG nova.objects.instance [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'flavor' on Instance uuid a5aeb519-2bcf-4714-a608-c6fcd918355b {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:40:33 user nova-compute[72782]: INFO nova.compute.manager [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Attaching volume c96800aa-af85-46cb-93fa-76cecc270dbe to /dev/vdb
Aug 14 20:40:33 user nova-compute[72782]: DEBUG os_brick.utils [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83a2d53-a926-4de9-ae3c-cabc548aaffc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc81c72-2f78-4e1b-8201-37f504f3df45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b5f62a-c18d-4f36-b78a-ae91d9e4fbdc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c086f2bd-d745-4b7d-a2a8-29e72a62f1d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:40:33 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:40:33 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaf7e09-0d07-4f9f-a8d7-280fa0b60117]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG os_brick.utils [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Updating existing volume attachment record: fb996eab-d481-403c-9e6e-32ccabfa0fb3 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:40:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:40:34 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:40:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:40:35 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:40:36 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:40:38 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:40:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:40:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:40:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:40:40 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:40:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:40:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:40:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-a5aeb519-2bcf-4714-a608-c6fcd918355b" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:40:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-a5aeb519-2bcf-4714-a608-c6fcd918355b" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:40:40 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:40:40 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid a5aeb519-2bcf-4714-a608-c6fcd918355b {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:40:40 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Updating instance_info_cache with network_info: [{"id": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "address": "fa:16:3e:23:29:bc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1476238e-b6", "ovs_interfaceid": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:40:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-a5aeb519-2bcf-4714-a608-c6fcd918355b" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:40:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:40:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:40:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:40:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:40:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:40:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:40:44 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:40:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:40:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:40:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:40:44 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:40:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:40:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:44 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:44 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:40:44 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:40:44 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8762MB free_disk=25.268577575683594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:40:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:40:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance a5aeb519-2bcf-4714-a608-c6fcd918355b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opSYvhBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:40:45 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:40:45 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:40:45 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f3320f-f3be-4227-bbd3-4a514469796f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:40:45 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[32febe70-b972-49a2-ba85-ebc3f70fbe69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe] added
Aug 14 20:40:45 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29586f2-05bc-48c8-9427-2c69cbcb02f0]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38362e0-5de0-49c2-8ab4-35aff0803ada]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opSYvhBI {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opSYvhBI" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c969d1-86a5-4678-8a97-0f9f7fa27877]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'opSYvhBI'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f510a2-61af-4af9-a451-93a452a831b1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f899d72-b3f5-40fa-9dff-13aeb1e617fa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:40:45 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:40:45 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:40:45 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 20:40:45 user nova-compute[72782]: 
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[042c73da-7918-4fdc-b47e-534bb1ab2605]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe, portal: 172.16.0.220,3260]
Aug 14 20:40:45 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe, portal: 172.16.0.220,3260] successful.
Aug 14 20:40:45 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.063s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d18fe5-b518-49a3-80d0-ad7c0266432c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c98839b-d1d1-4c47-b441-2b01b723753e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe (non-flash)
Aug 14 20:40:45 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe (non-flash)
Aug 14 20:40:45 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6728bc2c-d06b-400f-aa08-3b35b83539af]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:40:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opSYvhBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:40:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:40:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26439346435376161', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:40:46 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439346435376161', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:40:46 user nova-compute[72782]: DEBUG nova.objects.instance [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'flavor' on Instance uuid a5aeb519-2bcf-4714-a608-c6fcd918355b {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:40:46 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 20:40:46 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:40:46 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:40:46 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:40:46 user nova-compute[72782]:   <serial>c96800aa-af85-46cb-93fa-76cecc270dbe</serial>
Aug 14 20:40:46 user nova-compute[72782]: </disk>
Aug 14 20:40:46 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 20:40:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:40:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:40:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] No VIF found with MAC fa:16:3e:23:29:bc, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:40:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-c135f49a-2980-420c-939b-345aa3fb98ed tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.945s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:40:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:40:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:40:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:40:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:40:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:40:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:40:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG nova.objects.instance [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'flavor' on Instance uuid a5aeb519-2bcf-4714-a608-c6fcd918355b {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:40:52 user nova-compute[72782]: INFO nova.compute.manager [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Attaching volume 237745f2-76b1-406a-a728-a72e898b642c to /dev/vdc
Aug 14 20:40:52 user nova-compute[72782]: DEBUG os_brick.utils [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac97f2c-90eb-4102-abb8-72ce7e806e1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c864372c-b484-455b-94dd-b3182264abd1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b339afba-605b-4516-8948-fdb0d0a3652e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[690702c2-6d52-4a0f-abec-feb7ccd9b4b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:40:52 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:40:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[25825e1c-fa78-4a5c-820d-20fdaae3d00f]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG os_brick.utils [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:40:52 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Updating existing volume attachment record: 87b53083-af5d-452e-9601-789105994825 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:40:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:40:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:40:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcLqsMIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:41:00 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:41:00 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:41:00 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8055ed56-6f88-49de-867a-bb2d115b89ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:41:00 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ed0331-b732-452a-89e6-370e09e89bbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c] added
Aug 14 20:41:00 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[769dc9d8-7b9b-430c-8ddf-933e85c1a9c9]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[207c16de-4837-49f7-a5d5-d4952bf2b5a6]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcLqsMIV {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcLqsMIV" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6030282-43be-4023-8875-a2c871dbc6e7]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gcLqsMIV'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4faf3a4-610f-47d2-b284-aa063ed041c2]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[293094a2-303d-46a6-b97c-3d416310c09a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe (non-flash)
Aug 14 20:41:00 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe (non-flash)
Aug 14 20:41:00 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[172adfd6-f711-49c0-8059-1a48a0e6c831]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c, portal: 172.16.0.220,3260]
Aug 14 20:41:00 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c, portal: 172.16.0.220,3260] successful.
Aug 14 20:41:00 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f6629d-ae14-44c5-ac52-bda57c4e687b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b58d679-0659-4646-b619-3f1f9f99e67e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe (non-flash)
Aug 14 20:41:00 user nova-compute[72782]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c (non-flash)
Aug 14 20:41:00 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe (non-flash)
Aug 14 20:41:00 user nova-compute[72782]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c (non-flash)
Aug 14 20:41:00 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca9d44e-33be-4b23-aa36-91b7b6a430f3]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:00 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:41:01 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:41:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcLqsMIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:41:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:41:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23065396164343965', 'path': '/dev/sdc'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:41:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065396164343965', 'path': '/dev/sdc'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:41:01 user nova-compute[72782]: DEBUG nova.objects.instance [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'flavor' on Instance uuid a5aeb519-2bcf-4714-a608-c6fcd918355b {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:41:01 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 20:41:01 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:41:01 user nova-compute[72782]:   <source dev="/dev/sdc"/>
Aug 14 20:41:01 user nova-compute[72782]:   <target dev="vdc" bus="virtio"/>
Aug 14 20:41:01 user nova-compute[72782]:   <serial>237745f2-76b1-406a-a728-a72e898b642c</serial>
Aug 14 20:41:01 user nova-compute[72782]: </disk>
Aug 14 20:41:01 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 20:41:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:41:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:41:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:41:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] No VIF found with MAC fa:16:3e:23:29:bc, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:41:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-559e0e10-71fb-41e3-b944-b44138de292a tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.079s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:41:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:41:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:41:03 user nova-compute[72782]: INFO nova.compute.manager [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Detaching volume c96800aa-af85-46cb-93fa-76cecc270dbe
Aug 14 20:41:03 user nova-compute[72782]: INFO nova.virt.block_device [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Attempting to driver detach volume c96800aa-af85-46cb-93fa-76cecc270dbe from mountpoint /dev/vdb
Aug 14 20:41:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Attempting to detach device vdb from instance a5aeb519-2bcf-4714-a608-c6fcd918355b from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 20:41:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:41:03 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:41:03 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:41:03 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:41:03 user nova-compute[72782]:   <serial>c96800aa-af85-46cb-93fa-76cecc270dbe</serial>
Aug 14 20:41:03 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 20:41:03 user nova-compute[72782]: </disk>
Aug 14 20:41:03 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:41:03 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Successfully detached device vdb from instance a5aeb519-2bcf-4714-a608-c6fcd918355b from the persistent domain config.
Aug 14 20:41:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a5aeb519-2bcf-4714-a608-c6fcd918355b from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 20:41:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:41:03 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:41:03 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 20:41:03 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 20:41:03 user nova-compute[72782]:   <serial>c96800aa-af85-46cb-93fa-76cecc270dbe</serial>
Aug 14 20:41:03 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 20:41:03 user nova-compute[72782]: </disk>
Aug 14 20:41:03 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:41:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:41:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692045663.9959981, a5aeb519-2bcf-4714-a608-c6fcd918355b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a5aeb519-2bcf-4714-a608-c6fcd918355b {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 20:41:04 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Successfully detached device vdb from instance a5aeb519-2bcf-4714-a608-c6fcd918355b from the live domain config.
Aug 14 20:41:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opSYvhBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:41:04 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:41:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb643aa-fdbb-4f2b-a241-761e17a8d89a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[594decd2-da03-43e3-9d1c-d55aa1f5f825]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe (non-flash)
Aug 14 20:41:04 user nova-compute[72782]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c (non-flash)
Aug 14 20:41:04 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe (non-flash)
Aug 14 20:41:04 user nova-compute[72782]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c (non-flash)
Aug 14 20:41:04 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e8463010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[368417ef-58f3-4f10-ac20-5b495ff46846]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[93967a0b-022d-47e6-ba48-ed5b3d693131]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c13948-a183-4fc8-b625-65d9665381fa]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f275632-737a-482f-ba18-1b760cb3bdb2]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4dc8ef-feab-4533-87fe-0b6ac8c90d35]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b7371b-0df0-4e12-a1f3-c337186a367b]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe, portal: 172.16.0.220,3260]
Aug 14 20:41:04 user nova-compute[72782]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe, portal: 172.16.0.220,3260] successful.
Aug 14 20:41:04 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96800aa-af85-46cb-93fa-76cecc270dbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d62354-e610-4db1-8319-1aa69601eed4]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] <== disconnect_volume: return (282ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:41:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:41:05 user nova-compute[72782]: DEBUG nova.objects.instance [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'flavor' on Instance uuid a5aeb519-2bcf-4714-a608-c6fcd918355b {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:41:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f973d2dd-be6d-4253-a22b-b043b6f66d83 tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.618s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:41:06 user nova-compute[72782]: INFO nova.compute.manager [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Detaching volume 237745f2-76b1-406a-a728-a72e898b642c
Aug 14 20:41:06 user nova-compute[72782]: INFO nova.virt.block_device [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Attempting to driver detach volume 237745f2-76b1-406a-a728-a72e898b642c from mountpoint /dev/vdc
Aug 14 20:41:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Attempting to detach device vdc from instance a5aeb519-2bcf-4714-a608-c6fcd918355b from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:41:06 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:41:06 user nova-compute[72782]:   <source dev="/dev/sdc"/>
Aug 14 20:41:06 user nova-compute[72782]:   <target dev="vdc" bus="virtio"/>
Aug 14 20:41:06 user nova-compute[72782]:   <serial>237745f2-76b1-406a-a728-a72e898b642c</serial>
Aug 14 20:41:06 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 20:41:06 user nova-compute[72782]: </disk>
Aug 14 20:41:06 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:41:06 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Successfully detached device vdc from instance a5aeb519-2bcf-4714-a608-c6fcd918355b from the persistent domain config.
Aug 14 20:41:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a5aeb519-2bcf-4714-a608-c6fcd918355b from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 20:41:06 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:41:06 user nova-compute[72782]:   <source dev="/dev/sdc"/>
Aug 14 20:41:06 user nova-compute[72782]:   <target dev="vdc" bus="virtio"/>
Aug 14 20:41:06 user nova-compute[72782]:   <serial>237745f2-76b1-406a-a728-a72e898b642c</serial>
Aug 14 20:41:06 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 20:41:06 user nova-compute[72782]: </disk>
Aug 14 20:41:06 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692045666.6609938, a5aeb519-2bcf-4714-a608-c6fcd918355b => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a5aeb519-2bcf-4714-a608-c6fcd918355b {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 20:41:06 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Successfully detached device vdc from instance a5aeb519-2bcf-4714-a608-c6fcd918355b from the live domain config.
Aug 14 20:41:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcLqsMIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:41:06 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:41:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2af248-188d-444f-99e7-8f1c89a6fbb3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aea6259-c5d4-448d-bd20-705e787bbccf]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c (non-flash)
Aug 14 20:41:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c (non-flash)
Aug 14 20:41:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e869af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c'): ({'sdc'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Removing single pathed devices sdc {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa4d57e-1789-43cc-b2b5-07cc62214da6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[647e0017-209a-49a9-94e5-059d57886737]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Flushing IO for device /dev/sdc {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[997cb454-13a6-4c2f-9803-859002336bc3]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8105f9e-590a-4ef5-aa82-edacddb14547]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] SCSI volumes sdc have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0733214b-a1a5-4d87-91f1-f1947df46be8]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b415bf88-16ee-478b-b96a-cf57b4bcc003]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c, portal: 172.16.0.220,3260]
Aug 14 20:41:06 user nova-compute[72782]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c, portal: 172.16.0.220,3260] successful.
Aug 14 20:41:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:41:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:41:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:237745f2-76b1-406a-a728-a72e898b642c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:41:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb8bead-2f78-4a6e-a494-b827f7468a74]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:41:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:41:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:41:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] <== disconnect_volume: return (277ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:41:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:41:07 user nova-compute[72782]: DEBUG nova.objects.instance [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'flavor' on Instance uuid a5aeb519-2bcf-4714-a608-c6fcd918355b {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:41:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7f1dce7c-10a5-452f-af9b-ebf1d656768f tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.634s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:41:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:41:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:41:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "a5aeb519-2bcf-4714-a608-c6fcd918355b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:41:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:41:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:41:08 user nova-compute[72782]: INFO nova.compute.manager [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Terminating instance
Aug 14 20:41:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:41:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:41:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:41:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:41:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:41:09 user nova-compute[72782]: DEBUG nova.compute.manager [req-2f563153-e1c0-4288-b086-1946f0dd485c req-da00a876-3769-4376-bc07-afebd98df684 service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Received event network-vif-unplugged-1476238e-b61a-40bd-bcbd-424a83f30ee3 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:41:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2f563153-e1c0-4288-b086-1946f0dd485c req-da00a876-3769-4376-bc07-afebd98df684 service nova] Acquiring lock "a5aeb519-2bcf-4714-a608-c6fcd918355b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:41:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2f563153-e1c0-4288-b086-1946f0dd485c req-da00a876-3769-4376-bc07-afebd98df684 service nova] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:41:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2f563153-e1c0-4288-b086-1946f0dd485c req-da00a876-3769-4376-bc07-afebd98df684 service nova] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:41:09 user nova-compute[72782]: DEBUG nova.compute.manager [req-2f563153-e1c0-4288-b086-1946f0dd485c req-da00a876-3769-4376-bc07-afebd98df684 service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] No waiting events found dispatching network-vif-unplugged-1476238e-b61a-40bd-bcbd-424a83f30ee3 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:41:09 user nova-compute[72782]: DEBUG nova.compute.manager [req-2f563153-e1c0-4288-b086-1946f0dd485c req-da00a876-3769-4376-bc07-afebd98df684 service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Received event network-vif-unplugged-1476238e-b61a-40bd-bcbd-424a83f30ee3 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:41:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:41:09 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Instance destroyed successfully.
Aug 14 20:41:09 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lazy-loading 'resources' on Instance uuid a5aeb519-2bcf-4714-a608-c6fcd918355b {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:41:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:38:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1155773775',display_name='tempest-AttachVolumeTestJSON-server-1155773775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1155773775',id=46,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZLQzzv+ub5k2/7fR+m0OZ+PatJy8MpK0xwWWTIznEM406eHwydJ3QW2uBiJG8apUl01uRT70cIpsByhafaMMDcg+jafvbPeKNmIjcjnbxLhpTLy/tueJ28v3NS+Y5/AA==',key_name='tempest-keypair-58190085',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21ca996ad34a4a55994ae92a688f349f',ramdisk_id='',reservation_id='r-fkvdox0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-434447893',owner_user_name='tempest-AttachVolumeTestJSON-434447893-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeb23a424fd4eabb174c5630f36956d',uuid=a5aeb519-2bcf-4714-a608-c6fcd918355b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "address": "fa:16:3e:23:29:bc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1476238e-b6", "ovs_interfaceid": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:41:09 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converting VIF {"id": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "address": "fa:16:3e:23:29:bc", "network": {"id": "5ef75fa2-4e08-424b-9ada-03880eb01f1b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2108292566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21ca996ad34a4a55994ae92a688f349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1476238e-b6", "ovs_interfaceid": "1476238e-b61a-40bd-bcbd-424a83f30ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:41:09 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:29:bc,bridge_name='br-int',has_traffic_filtering=True,id=1476238e-b61a-40bd-bcbd-424a83f30ee3,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1476238e-b6') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:41:09 user nova-compute[72782]: DEBUG os_vif [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:29:bc,bridge_name='br-int',has_traffic_filtering=True,id=1476238e-b61a-40bd-bcbd-424a83f30ee3,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1476238e-b6') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:41:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:41:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1476238e-b6, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:41:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:41:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:41:09 user nova-compute[72782]: INFO os_vif [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:29:bc,bridge_name='br-int',has_traffic_filtering=True,id=1476238e-b61a-40bd-bcbd-424a83f30ee3,network=Network(5ef75fa2-4e08-424b-9ada-03880eb01f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1476238e-b6')
Aug 14 20:41:09 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Deleting instance files /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b_del
Aug 14 20:41:09 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Deletion of /opt/stack/data/nova/instances/a5aeb519-2bcf-4714-a608-c6fcd918355b_del complete
Aug 14 20:41:09 user nova-compute[72782]: INFO nova.compute.manager [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 14 20:41:09 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:41:09 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:41:09 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:41:10 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:41:10 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Took 0.80 seconds to deallocate network for instance.
Aug 14 20:41:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-10026528-a2e0-4dfc-a3b0-930e84913756 req-420f7b3a-9dbe-4863-8022-b582cd11cc7c service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Received event network-vif-deleted-1476238e-b61a-40bd-bcbd-424a83f30ee3 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:41:10 user nova-compute[72782]: INFO nova.compute.manager [req-10026528-a2e0-4dfc-a3b0-930e84913756 req-420f7b3a-9dbe-4863-8022-b582cd11cc7c service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Neutron deleted interface 1476238e-b61a-40bd-bcbd-424a83f30ee3; detaching it from the instance and deleting it from the info cache
Aug 14 20:41:10 user nova-compute[72782]: DEBUG nova.network.neutron [req-10026528-a2e0-4dfc-a3b0-930e84913756 req-420f7b3a-9dbe-4863-8022-b582cd11cc7c service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:41:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-10026528-a2e0-4dfc-a3b0-930e84913756 req-420f7b3a-9dbe-4863-8022-b582cd11cc7c service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Detach interface failed, port_id=1476238e-b61a-40bd-bcbd-424a83f30ee3, reason: Instance a5aeb519-2bcf-4714-a608-c6fcd918355b could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 20:41:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:41:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:41:10 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:41:10 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:41:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:41:10 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Deleted allocations for instance a5aeb519-2bcf-4714-a608-c6fcd918355b
Aug 14 20:41:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5bbe8b2c-d6b2-4ec2-a344-7faddaff11cd tempest-AttachVolumeTestJSON-434447893 tempest-AttachVolumeTestJSON-434447893-project-member] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.952s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:41:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-d3ed7e44-75ad-4c8a-9c35-8eccbba2656c req-713e4f2b-7158-404c-bf0c-82cf25e19591 service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Received event network-vif-plugged-1476238e-b61a-40bd-bcbd-424a83f30ee3 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:41:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d3ed7e44-75ad-4c8a-9c35-8eccbba2656c req-713e4f2b-7158-404c-bf0c-82cf25e19591 service nova] Acquiring lock "a5aeb519-2bcf-4714-a608-c6fcd918355b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:41:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d3ed7e44-75ad-4c8a-9c35-8eccbba2656c req-713e4f2b-7158-404c-bf0c-82cf25e19591 service nova] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:41:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d3ed7e44-75ad-4c8a-9c35-8eccbba2656c req-713e4f2b-7158-404c-bf0c-82cf25e19591 service nova] Lock "a5aeb519-2bcf-4714-a608-c6fcd918355b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:41:11 user nova-compute[72782]: DEBUG nova.compute.manager [req-d3ed7e44-75ad-4c8a-9c35-8eccbba2656c req-713e4f2b-7158-404c-bf0c-82cf25e19591 service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] No waiting events found dispatching network-vif-plugged-1476238e-b61a-40bd-bcbd-424a83f30ee3 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:41:11 user nova-compute[72782]: WARNING nova.compute.manager [req-d3ed7e44-75ad-4c8a-9c35-8eccbba2656c req-713e4f2b-7158-404c-bf0c-82cf25e19591 service nova] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Received unexpected event network-vif-plugged-1476238e-b61a-40bd-bcbd-424a83f30ee3 for instance with vm_state deleted and task_state None.
Aug 14 20:41:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:41:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:41:24 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692045669.5142775, a5aeb519-2bcf-4714-a608-c6fcd918355b => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:41:24 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] VM Stopped (Lifecycle Event)
Aug 14 20:41:24 user nova-compute[72782]: DEBUG nova.compute.manager [None req-745cf258-24d8-413b-981f-a2b5241d8a90 None None] [instance: a5aeb519-2bcf-4714-a608-c6fcd918355b] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:41:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:41:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:41:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:41:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:41:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:41:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:41:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:41:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:41:36 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:41:36 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:41:37 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:41:39 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:41:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:41:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:41:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:41:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:41:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:41:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:41:42 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:41:42 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:41:42 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:41:42 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 20:41:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:41:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:41:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:41:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:41:45 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:41:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:41:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:41:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:41:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:41:45 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:41:45 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:41:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8880MB free_disk=25.295169830322266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:41:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:41:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:41:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:41:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:41:45 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing inventories for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 20:41:45 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating ProviderTree inventory for provider d26c9e3b-40e6-476e-9664-3119ebf5873b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 20:41:45 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 20:41:45 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing aggregate associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, aggregates: None {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 20:41:45 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing trait associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 20:41:45 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:41:45 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:41:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:41:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:41:46 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:41:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:41:50 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:41:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:41:56 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:41:56 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 20:41:56 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] There are 0 instances to clean {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 20:41:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:41:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:41:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:42:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:42:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:42:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:42:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:42:16 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:42:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:42:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:25 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:42:27 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:42:27 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72782) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 20:42:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:36 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:42:37 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:42:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:38 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:42:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:40 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:42:42 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:42:42 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:42:42 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:42:42 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 20:42:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:44 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:42:44 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:42:44 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:42:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:45 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:42:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:42:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:42:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:42:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:42:45 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:42:45 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:42:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8880MB free_disk=25.29273223876953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:42:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:42:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:42:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:42:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:42:45 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:42:45 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:42:45 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:42:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:42:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:42:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "b20a1370-e3a7-4dc7-a898-2592236b1965" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:42:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "b20a1370-e3a7-4dc7-a898-2592236b1965" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:42:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:42:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:42:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:42:55 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:42:55 user nova-compute[72782]: INFO nova.compute.claims [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Claim successful on node user
Aug 14 20:42:55 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:42:55 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:42:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.182s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:42:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:42:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:42:55 user nova-compute[72782]: DEBUG nova.network.neutron [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:42:55 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:42:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:42:55 user nova-compute[72782]: DEBUG nova.policy [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2df6ae64c62142cfbedd244de47bdd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a99378957e94fc6a148b06bcd9123bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:42:55 user nova-compute[72782]: INFO nova.virt.block_device [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Booting with volume snapshot 25af0696-b906-43f4-9c05-5662d9e97e82 at /dev/vda
Aug 14 20:42:56 user nova-compute[72782]: DEBUG nova.network.neutron [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Successfully created port: 6a332319-e7a7-4ae5-bea9-13d69d81c782 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:42:57 user nova-compute[72782]: DEBUG nova.network.neutron [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Successfully updated port: 6a332319-e7a7-4ae5-bea9-13d69d81c782 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:42:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "refresh_cache-b20a1370-e3a7-4dc7-a898-2592236b1965" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:42:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquired lock "refresh_cache-b20a1370-e3a7-4dc7-a898-2592236b1965" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:42:57 user nova-compute[72782]: DEBUG nova.network.neutron [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:42:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-e27749e6-b57c-42d7-a4d8-d274ffb7d1b9 req-069db450-8039-4992-a41b-01ea3392a4d2 service nova] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Received event network-changed-6a332319-e7a7-4ae5-bea9-13d69d81c782 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:42:57 user nova-compute[72782]: DEBUG nova.compute.manager [req-e27749e6-b57c-42d7-a4d8-d274ffb7d1b9 req-069db450-8039-4992-a41b-01ea3392a4d2 service nova] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Refreshing instance network info cache due to event network-changed-6a332319-e7a7-4ae5-bea9-13d69d81c782. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:42:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e27749e6-b57c-42d7-a4d8-d274ffb7d1b9 req-069db450-8039-4992-a41b-01ea3392a4d2 service nova] Acquiring lock "refresh_cache-b20a1370-e3a7-4dc7-a898-2592236b1965" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:42:57 user nova-compute[72782]: DEBUG nova.network.neutron [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:42:57 user nova-compute[72782]: DEBUG nova.network.neutron [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Updating instance_info_cache with network_info: [{"id": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "address": "fa:16:3e:23:0e:18", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a332319-e7", "ovs_interfaceid": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:42:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Releasing lock "refresh_cache-b20a1370-e3a7-4dc7-a898-2592236b1965" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:42:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Instance network_info: |[{"id": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "address": "fa:16:3e:23:0e:18", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a332319-e7", "ovs_interfaceid": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:42:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e27749e6-b57c-42d7-a4d8-d274ffb7d1b9 req-069db450-8039-4992-a41b-01ea3392a4d2 service nova] Acquired lock "refresh_cache-b20a1370-e3a7-4dc7-a898-2592236b1965" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:42:57 user nova-compute[72782]: DEBUG nova.network.neutron [req-e27749e6-b57c-42d7-a4d8-d274ffb7d1b9 req-069db450-8039-4992-a41b-01ea3392a4d2 service nova] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Refreshing network info cache for port 6a332319-e7a7-4ae5-bea9-13d69d81c782 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:42:57 user nova-compute[72782]: DEBUG nova.network.neutron [req-e27749e6-b57c-42d7-a4d8-d274ffb7d1b9 req-069db450-8039-4992-a41b-01ea3392a4d2 service nova] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Updated VIF entry in instance network info cache for port 6a332319-e7a7-4ae5-bea9-13d69d81c782. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:42:57 user nova-compute[72782]: DEBUG nova.network.neutron [req-e27749e6-b57c-42d7-a4d8-d274ffb7d1b9 req-069db450-8039-4992-a41b-01ea3392a4d2 service nova] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Updating instance_info_cache with network_info: [{"id": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "address": "fa:16:3e:23:0e:18", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a332319-e7", "ovs_interfaceid": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:42:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-e27749e6-b57c-42d7-a4d8-d274ffb7d1b9 req-069db450-8039-4992-a41b-01ea3392a4d2 service nova] Releasing lock "refresh_cache-b20a1370-e3a7-4dc7-a898-2592236b1965" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:42:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:42:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:42:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:42:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:42:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:42:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG os_brick.utils [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6297b71a-0afb-422f-a34f-8159fb4b27e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[99657e70-03c0-4063-a58b-b2c2d3eed141]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[54253a34-1135-42d9-b324-99ef7c266bc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b26b59f-9cf6-4c17-ba75-040e373346b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:43:01 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:43:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[132ada11-f1d4-4503-89da-14dd714509c7]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG os_brick.utils [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:43:01 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Updating existing volume attachment record: b0e051b4-d4c2-4104-a17f-0a883f400563 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:43:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:43:09 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Creating image(s)
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Did not create local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Ensure instance console log exists: /opt/stack/data/nova/instances/b20a1370-e3a7-4dc7-a898-2592236b1965/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Start _get_guest_xml network_info=[{"id": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "address": "fa:16:3e:23:0e:18", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a332319-e7", "ovs_interfaceid": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'b0e051b4-d4c2-4104-a17f-0a883f400563', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dxnWRhDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b20a1370-e3a7-4dc7-a898-2592236b1965', 'attached_at': '', 'detached_at': '', 'volume_id': '34336e39-32b5-4709-8576-b1f68c520f69', 'serial': '34336e39-32b5-4709-8576-b1f68c520f69'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:43:09 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:43:09 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:43:09 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dxnWRhDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:43:10 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:43:10 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:43:10 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cc869f-baf9-41c0-8549-c25379792927]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:43:10 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9944ea65-0849-4725-91c0-bffe0ab2f21b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69] added
Aug 14 20:43:10 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e721c8-3cc3-4247-81d9-d4b81b1e6678]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[520fd101-2ec0-489a-ac11-a8467d2bb828]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dxnWRhDH {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dxnWRhDH" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3e0ccf-c91e-450c-bc5f-e24cbb2a6911]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dxnWRhDH'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4955d8d-5ce6-4529-a4df-e864cc2e8d0c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63f9468-38e2-4b39-af0e-d2cabe4ffc09]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:43:10 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:43:10 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:43:10 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 20:43:10 user nova-compute[72782]: 
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28037de-30a6-4751-9ea1-c0b60d385241]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69, portal: 172.16.0.220,3260]
Aug 14 20:43:10 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69, portal: 172.16.0.220,3260] successful.
Aug 14 20:43:10 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faad101-f814-4006-bd74-42f9684f604d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba53e5d-d9a2-47cf-9fae-d4ceae88aaec]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 (non-flash)
Aug 14 20:43:10 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 (non-flash)
Aug 14 20:43:10 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f94b37-aed8-4266-82b8-28d68699d193]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:43:10 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dxnWRhDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23938326463386662', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938326463386662', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:42:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1908540785',display_name='tempest-TestVolumeBootPattern-server-1908540785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1908540785',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a99378957e94fc6a148b06bcd9123bf',ramdisk_id='',reservation_id='r-y3v068vx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-52337130',owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:42:56Z,user_data=None,user_id='2df6ae64c62142cfbedd244de47bdd2a',uuid=b20a1370-e3a7-4dc7-a898-2592236b1965,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "address": "fa:16:3e:23:0e:18", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a332319-e7", "ovs_interfaceid": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converting VIF {"id": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "address": "fa:16:3e:23:0e:18", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a332319-e7", "ovs_interfaceid": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:0e:18,bridge_name='br-int',has_traffic_filtering=True,id=6a332319-e7a7-4ae5-bea9-13d69d81c782,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a332319-e7') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG nova.objects.instance [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lazy-loading 'pci_devices' on Instance uuid b20a1370-e3a7-4dc7-a898-2592236b1965 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:43:11 user nova-compute[72782]:   <uuid>b20a1370-e3a7-4dc7-a898-2592236b1965</uuid>
Aug 14 20:43:11 user nova-compute[72782]:   <name>instance-0000002f</name>
Aug 14 20:43:11 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:43:11 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:43:11 user nova-compute[72782]:   <metadata>
Aug 14 20:43:11 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:43:11 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:43:11 user nova-compute[72782]:       <nova:name>tempest-TestVolumeBootPattern-server-1908540785</nova:name>
Aug 14 20:43:11 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:43:09</nova:creationTime>
Aug 14 20:43:11 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:43:11 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:43:11 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:43:11 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:43:11 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:43:11 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:43:11 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:43:11 user nova-compute[72782]:       <nova:owner>
Aug 14 20:43:11 user nova-compute[72782]:         <nova:user uuid="2df6ae64c62142cfbedd244de47bdd2a">tempest-TestVolumeBootPattern-52337130-project-member</nova:user>
Aug 14 20:43:11 user nova-compute[72782]:         <nova:project uuid="0a99378957e94fc6a148b06bcd9123bf">tempest-TestVolumeBootPattern-52337130</nova:project>
Aug 14 20:43:11 user nova-compute[72782]:       </nova:owner>
Aug 14 20:43:11 user nova-compute[72782]:       <nova:ports>
Aug 14 20:43:11 user nova-compute[72782]:         <nova:port uuid="6a332319-e7a7-4ae5-bea9-13d69d81c782">
Aug 14 20:43:11 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 20:43:11 user nova-compute[72782]:         </nova:port>
Aug 14 20:43:11 user nova-compute[72782]:       </nova:ports>
Aug 14 20:43:11 user nova-compute[72782]:     </nova:instance>
Aug 14 20:43:11 user nova-compute[72782]:   </metadata>
Aug 14 20:43:11 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:43:11 user nova-compute[72782]:     <system>
Aug 14 20:43:11 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:43:11 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:43:11 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:43:11 user nova-compute[72782]:       <entry name="serial">b20a1370-e3a7-4dc7-a898-2592236b1965</entry>
Aug 14 20:43:11 user nova-compute[72782]:       <entry name="uuid">b20a1370-e3a7-4dc7-a898-2592236b1965</entry>
Aug 14 20:43:11 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:43:11 user nova-compute[72782]:     </system>
Aug 14 20:43:11 user nova-compute[72782]:   </sysinfo>
Aug 14 20:43:11 user nova-compute[72782]:   <os>
Aug 14 20:43:11 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:43:11 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:43:11 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:43:11 user nova-compute[72782]:   </os>
Aug 14 20:43:11 user nova-compute[72782]:   <features>
Aug 14 20:43:11 user nova-compute[72782]:     <acpi/>
Aug 14 20:43:11 user nova-compute[72782]:     <apic/>
Aug 14 20:43:11 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:43:11 user nova-compute[72782]:   </features>
Aug 14 20:43:11 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:43:11 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:43:11 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:43:11 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:43:11 user nova-compute[72782]:   </clock>
Aug 14 20:43:11 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:43:11 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:43:11 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:43:11 user nova-compute[72782]:   </cpu>
Aug 14 20:43:11 user nova-compute[72782]:   <devices>
Aug 14 20:43:11 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 20:43:11 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:43:11 user nova-compute[72782]:       <source dev="/dev/sdb"/>
Aug 14 20:43:11 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:43:11 user nova-compute[72782]:       <serial>34336e39-32b5-4709-8576-b1f68c520f69</serial>
Aug 14 20:43:11 user nova-compute[72782]:     </disk>
Aug 14 20:43:11 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:43:11 user nova-compute[72782]:       <mac address="fa:16:3e:23:0e:18"/>
Aug 14 20:43:11 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:43:11 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:43:11 user nova-compute[72782]:       <target dev="tap6a332319-e7"/>
Aug 14 20:43:11 user nova-compute[72782]:     </interface>
Aug 14 20:43:11 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:43:11 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/b20a1370-e3a7-4dc7-a898-2592236b1965/console.log" append="off"/>
Aug 14 20:43:11 user nova-compute[72782]:     </serial>
Aug 14 20:43:11 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:43:11 user nova-compute[72782]:     <video>
Aug 14 20:43:11 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:43:11 user nova-compute[72782]:     </video>
Aug 14 20:43:11 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:43:11 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:43:11 user nova-compute[72782]:     </rng>
Aug 14 20:43:11 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:43:11 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:43:11 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:43:11 user nova-compute[72782]:     </memballoon>
Aug 14 20:43:11 user nova-compute[72782]:   </devices>
Aug 14 20:43:11 user nova-compute[72782]: </domain>
Aug 14 20:43:11 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:42:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1908540785',display_name='tempest-TestVolumeBootPattern-server-1908540785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1908540785',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a99378957e94fc6a148b06bcd9123bf',ramdisk_id='',reservation_id='r-y3v068vx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-52337130',owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:42:56Z,user_data=None,user_id='2df6ae64c62142cfbedd244de47bdd2a',uuid=b20a1370-e3a7-4dc7-a898-2592236b1965,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "address": "fa:16:3e:23:0e:18", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a332319-e7", "ovs_interfaceid": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converting VIF {"id": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "address": "fa:16:3e:23:0e:18", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a332319-e7", "ovs_interfaceid": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:0e:18,bridge_name='br-int',has_traffic_filtering=True,id=6a332319-e7a7-4ae5-bea9-13d69d81c782,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a332319-e7') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG os_vif [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:0e:18,bridge_name='br-int',has_traffic_filtering=True,id=6a332319-e7a7-4ae5-bea9-13d69d81c782,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a332319-e7') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a332319-e7, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a332319-e7, col_values=(('external_ids', {'iface-id': '6a332319-e7a7-4ae5-bea9-13d69d81c782', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:0e:18', 'vm-uuid': 'b20a1370-e3a7-4dc7-a898-2592236b1965'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:11 user nova-compute[72782]: INFO os_vif [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:0e:18,bridge_name='br-int',has_traffic_filtering=True,id=6a332319-e7a7-4ae5-bea9-13d69d81c782,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a332319-e7')
Aug 14 20:43:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:43:11 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] No VIF found with MAC fa:16:3e:23:0e:18, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:43:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-6499ce62-9e80-4900-90e8-81ffc37484d3 req-ba6cedf6-a82c-441d-b5ee-4c87545784ed service nova] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Received event network-vif-plugged-6a332319-e7a7-4ae5-bea9-13d69d81c782 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:43:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6499ce62-9e80-4900-90e8-81ffc37484d3 req-ba6cedf6-a82c-441d-b5ee-4c87545784ed service nova] Acquiring lock "b20a1370-e3a7-4dc7-a898-2592236b1965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:43:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6499ce62-9e80-4900-90e8-81ffc37484d3 req-ba6cedf6-a82c-441d-b5ee-4c87545784ed service nova] Lock "b20a1370-e3a7-4dc7-a898-2592236b1965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:43:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-6499ce62-9e80-4900-90e8-81ffc37484d3 req-ba6cedf6-a82c-441d-b5ee-4c87545784ed service nova] Lock "b20a1370-e3a7-4dc7-a898-2592236b1965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:43:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-6499ce62-9e80-4900-90e8-81ffc37484d3 req-ba6cedf6-a82c-441d-b5ee-4c87545784ed service nova] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] No waiting events found dispatching network-vif-plugged-6a332319-e7a7-4ae5-bea9-13d69d81c782 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:43:12 user nova-compute[72782]: WARNING nova.compute.manager [req-6499ce62-9e80-4900-90e8-81ffc37484d3 req-ba6cedf6-a82c-441d-b5ee-4c87545784ed service nova] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Received unexpected event network-vif-plugged-6a332319-e7a7-4ae5-bea9-13d69d81c782 for instance with vm_state building and task_state spawning.
Aug 14 20:43:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:14 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692045794.8860712, b20a1370-e3a7-4dc7-a898-2592236b1965 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:43:14 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] VM Resumed (Lifecycle Event)
Aug 14 20:43:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:43:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:43:14 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Instance spawned successfully.
Aug 14 20:43:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:43:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:43:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:43:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:43:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:43:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:43:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:43:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:43:14 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:43:14 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:43:14 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692045794.8878324, b20a1370-e3a7-4dc7-a898-2592236b1965 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:43:14 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] VM Started (Lifecycle Event)
Aug 14 20:43:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-1b1b859d-a55f-45ca-9782-9def48f491fd req-99083615-e2f9-4d40-ade7-8dd0a19ad254 service nova] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Received event network-vif-plugged-6a332319-e7a7-4ae5-bea9-13d69d81c782 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:43:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1b1b859d-a55f-45ca-9782-9def48f491fd req-99083615-e2f9-4d40-ade7-8dd0a19ad254 service nova] Acquiring lock "b20a1370-e3a7-4dc7-a898-2592236b1965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:43:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1b1b859d-a55f-45ca-9782-9def48f491fd req-99083615-e2f9-4d40-ade7-8dd0a19ad254 service nova] Lock "b20a1370-e3a7-4dc7-a898-2592236b1965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:43:14 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1b1b859d-a55f-45ca-9782-9def48f491fd req-99083615-e2f9-4d40-ade7-8dd0a19ad254 service nova] Lock "b20a1370-e3a7-4dc7-a898-2592236b1965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:43:14 user nova-compute[72782]: DEBUG nova.compute.manager [req-1b1b859d-a55f-45ca-9782-9def48f491fd req-99083615-e2f9-4d40-ade7-8dd0a19ad254 service nova] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] No waiting events found dispatching network-vif-plugged-6a332319-e7a7-4ae5-bea9-13d69d81c782 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:43:14 user nova-compute[72782]: WARNING nova.compute.manager [req-1b1b859d-a55f-45ca-9782-9def48f491fd req-99083615-e2f9-4d40-ade7-8dd0a19ad254 service nova] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Received unexpected event network-vif-plugged-6a332319-e7a7-4ae5-bea9-13d69d81c782 for instance with vm_state building and task_state spawning.
Aug 14 20:43:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:43:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:43:14 user nova-compute[72782]: INFO nova.compute.manager [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 14 20:43:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:43:14 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:43:15 user nova-compute[72782]: INFO nova.compute.manager [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Took 19.86 seconds to build instance.
Aug 14 20:43:15 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-b0238295-52d3-4fce-99f3-fd1f5da535a6 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "b20a1370-e3a7-4dc7-a898-2592236b1965" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.951s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:43:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:37 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:43:38 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:43:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:40 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:43:41 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:43:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:44 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:43:44 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:43:44 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:43:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-b20a1370-e3a7-4dc7-a898-2592236b1965" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:43:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-b20a1370-e3a7-4dc7-a898-2592236b1965" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:43:44 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:43:44 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid b20a1370-e3a7-4dc7-a898-2592236b1965 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:43:44 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Updating instance_info_cache with network_info: [{"id": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "address": "fa:16:3e:23:0e:18", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a332319-e7", "ovs_interfaceid": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:43:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-b20a1370-e3a7-4dc7-a898-2592236b1965" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:43:44 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:43:46 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:43:46 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:43:46 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:43:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:47 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:43:47 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:43:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:43:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:43:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:43:47 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:43:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:43:47 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:43:47 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:43:47 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8795MB free_disk=25.282981872558594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:43:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:43:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:43:47 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance b20a1370-e3a7-4dc7-a898-2592236b1965 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:43:47 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:43:47 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:43:47 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:43:47 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:43:47 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:43:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:43:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:43:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:43:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:44:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:44:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:44:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:44:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:44:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:44:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:44:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:44:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:44:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:44:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:44:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:44:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:44:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:44:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:44:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:44:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:44:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:44:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:44:38 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:44:39 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:44:41 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:44:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:44:42 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Skipping network cache update for instance because it is being deleted. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "b20a1370-e3a7-4dc7-a898-2592236b1965" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "b20a1370-e3a7-4dc7-a898-2592236b1965" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "b20a1370-e3a7-4dc7-a898-2592236b1965-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "b20a1370-e3a7-4dc7-a898-2592236b1965-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "b20a1370-e3a7-4dc7-a898-2592236b1965-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:44:46 user nova-compute[72782]: INFO nova.compute.manager [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Terminating instance
Aug 14 20:44:46 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG nova.compute.manager [req-3005241f-9666-4b10-8245-ac807f7b0126 req-a709d67a-9f24-4b74-ba71-852d1b7fdf33 service nova] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Received event network-vif-unplugged-6a332319-e7a7-4ae5-bea9-13d69d81c782 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3005241f-9666-4b10-8245-ac807f7b0126 req-a709d67a-9f24-4b74-ba71-852d1b7fdf33 service nova] Acquiring lock "b20a1370-e3a7-4dc7-a898-2592236b1965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3005241f-9666-4b10-8245-ac807f7b0126 req-a709d67a-9f24-4b74-ba71-852d1b7fdf33 service nova] Lock "b20a1370-e3a7-4dc7-a898-2592236b1965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-3005241f-9666-4b10-8245-ac807f7b0126 req-a709d67a-9f24-4b74-ba71-852d1b7fdf33 service nova] Lock "b20a1370-e3a7-4dc7-a898-2592236b1965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG nova.compute.manager [req-3005241f-9666-4b10-8245-ac807f7b0126 req-a709d67a-9f24-4b74-ba71-852d1b7fdf33 service nova] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] No waiting events found dispatching network-vif-unplugged-6a332319-e7a7-4ae5-bea9-13d69d81c782 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG nova.compute.manager [req-3005241f-9666-4b10-8245-ac807f7b0126 req-a709d67a-9f24-4b74-ba71-852d1b7fdf33 service nova] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Received event network-vif-unplugged-6a332319-e7a7-4ae5-bea9-13d69d81c782 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:44:46 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Instance destroyed successfully.
Aug 14 20:44:46 user nova-compute[72782]: DEBUG nova.objects.instance [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lazy-loading 'resources' on Instance uuid b20a1370-e3a7-4dc7-a898-2592236b1965 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:42:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1908540785',display_name='tempest-TestVolumeBootPattern-server-1908540785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1908540785',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:43:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a99378957e94fc6a148b06bcd9123bf',ramdisk_id='',reservation_id='r-y3v068vx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-52337130',owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:43:15Z,user_data=None,user_id='2df6ae64c62142cfbedd244de47bdd2a',uuid=b20a1370-e3a7-4dc7-a898-2592236b1965,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "address": "fa:16:3e:23:0e:18", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a332319-e7", "ovs_interfaceid": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converting VIF {"id": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "address": "fa:16:3e:23:0e:18", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a332319-e7", "ovs_interfaceid": "6a332319-e7a7-4ae5-bea9-13d69d81c782", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:0e:18,bridge_name='br-int',has_traffic_filtering=True,id=6a332319-e7a7-4ae5-bea9-13d69d81c782,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a332319-e7') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG os_vif [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:0e:18,bridge_name='br-int',has_traffic_filtering=True,id=6a332319-e7a7-4ae5-bea9-13d69d81c782,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a332319-e7') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a332319-e7, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:44:46 user nova-compute[72782]: INFO os_vif [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:0e:18,bridge_name='br-int',has_traffic_filtering=True,id=6a332319-e7a7-4ae5-bea9-13d69d81c782,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a332319-e7')
Aug 14 20:44:46 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dxnWRhDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:44:46 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:44:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4179b521-cf5b-4c73-b96d-fe6e172796c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad444a1b-977f-4d58-824d-dcdeafa18b2b]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 (non-flash)
Aug 14 20:44:46 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 (non-flash)
Aug 14 20:44:46 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e8496cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e58168-bad6-486b-b664-c88bbb54b04d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fd2cfd-62ad-4bfd-a05d-9122ca7c2fde]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dbf804-edb0-4c1e-b935-d1f687c50f8c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:44:46 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[102fc5a1-0250-4940-9e00-7c7b6d135cef]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7b5074ee-982dc8fb54fec3d4', '/dev/disk/by-id/scsi-23938326463386662', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7b5074ee') {{(pid=83776) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31ee6ba-4c28-42df-8b75-0a66804f739f]: (4, None) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a326e059-04bd-4405-ae75-f565a149c9bb]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cab4b76-69c7-4c5b-b81f-f700dfcbc3b0]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69, portal: 172.16.0.220,3260]
Aug 14 20:44:47 user nova-compute[72782]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69, portal: 172.16.0.220,3260] successful.
Aug 14 20:44:47 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34336e39-32b5-4709-8576-b1f68c520f69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b6ef2d-e0b4-41fa-ad7c-1c9d4c69ec86]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] <== disconnect_volume: return (279ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:44:47 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Deleting instance files /opt/stack/data/nova/instances/b20a1370-e3a7-4dc7-a898-2592236b1965_del
Aug 14 20:44:47 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Deletion of /opt/stack/data/nova/instances/b20a1370-e3a7-4dc7-a898-2592236b1965_del complete
Aug 14 20:44:47 user nova-compute[72782]: INFO nova.compute.manager [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 14 20:44:47 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:44:47 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:44:47 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Took 0.43 seconds to deallocate network for instance.
Aug 14 20:44:47 user nova-compute[72782]: DEBUG nova.compute.manager [req-8af73e63-9335-47b5-bc12-8bf39ea5818f req-071e2b82-0b65-496e-a246-fb2a9c2ef96c service nova] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Received event network-vif-deleted-6a332319-e7a7-4ae5-bea9-13d69d81c782 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:44:48 user nova-compute[72782]: INFO nova.compute.manager [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Took 0.83 seconds to detach 1 volumes for instance.
Aug 14 20:44:48 user nova-compute[72782]: DEBUG nova.compute.manager [req-4e537d8e-c64f-4904-96fa-b425068e1b7e req-026c6f8e-9e59-4c47-9e48-b7295ffa9619 service nova] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Received event network-vif-plugged-6a332319-e7a7-4ae5-bea9-13d69d81c782 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4e537d8e-c64f-4904-96fa-b425068e1b7e req-026c6f8e-9e59-4c47-9e48-b7295ffa9619 service nova] Acquiring lock "b20a1370-e3a7-4dc7-a898-2592236b1965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4e537d8e-c64f-4904-96fa-b425068e1b7e req-026c6f8e-9e59-4c47-9e48-b7295ffa9619 service nova] Lock "b20a1370-e3a7-4dc7-a898-2592236b1965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4e537d8e-c64f-4904-96fa-b425068e1b7e req-026c6f8e-9e59-4c47-9e48-b7295ffa9619 service nova] Lock "b20a1370-e3a7-4dc7-a898-2592236b1965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG nova.compute.manager [req-4e537d8e-c64f-4904-96fa-b425068e1b7e req-026c6f8e-9e59-4c47-9e48-b7295ffa9619 service nova] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] No waiting events found dispatching network-vif-plugged-6a332319-e7a7-4ae5-bea9-13d69d81c782 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:44:48 user nova-compute[72782]: WARNING nova.compute.manager [req-4e537d8e-c64f-4904-96fa-b425068e1b7e req-026c6f8e-9e59-4c47-9e48-b7295ffa9619 service nova] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Received unexpected event network-vif-plugged-6a332319-e7a7-4ae5-bea9-13d69d81c782 for instance with vm_state active and task_state deleting.
Aug 14 20:44:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Deleting volume: 34336e39-32b5-4709-8576-b1f68c520f69 {{(pid=72782) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 20:44:48 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:44:48 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:44:48 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8885MB free_disk=25.282272338867188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance b20a1370-e3a7-4dc7-a898-2592236b1965 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.067s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:44:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:44:48 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Deleted allocations for instance b20a1370-e3a7-4dc7-a898-2592236b1965
Aug 14 20:44:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-7ff82034-1b26-4ebc-8fa5-878f6a5685df tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "b20a1370-e3a7-4dc7-a898-2592236b1965" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.809s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:44:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:44:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:44:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:45:01 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692045886.7938015, b20a1370-e3a7-4dc7-a898-2592236b1965 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:45:01 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] VM Stopped (Lifecycle Event)
Aug 14 20:45:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-dabd95b3-54ca-4a63-a13e-517df75a9378 None None] [instance: b20a1370-e3a7-4dc7-a898-2592236b1965] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:45:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:45:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:45:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:45:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:45:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:45:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:45:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:45:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:45:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:45:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:45:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:45:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:45:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:45:39 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:45:40 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:45:41 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:45:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:45:42 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:45:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:45:47 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:45:47 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:45:47 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:45:47 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 20:45:49 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:45:49 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:45:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:45:49 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:45:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:45:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:45:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:45:49 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:45:49 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:45:49 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:45:49 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=25.281322479248047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:45:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:45:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:45:49 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:45:49 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:45:49 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:45:49 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:45:49 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:45:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:45:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:45:52 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:45:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:45:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:45:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "3af93ab4-1017-45de-94d2-bc7840429fd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "3af93ab4-1017-45de-94d2-bc7840429fd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:45:58 user nova-compute[72782]: INFO nova.compute.claims [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Claim successful on node user
Aug 14 20:45:58 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.175s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:45:58 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:45:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:45:58 user nova-compute[72782]: INFO nova.virt.block_device [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Booting with volume 20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 at /dev/vda
Aug 14 20:45:58 user nova-compute[72782]: DEBUG nova.policy [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2df6ae64c62142cfbedd244de47bdd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a99378957e94fc6a148b06bcd9123bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG os_brick.utils [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13bf419-9328-495d-988c-ac02796d7def]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cdb3bf-f805-4095-8214-b9efe7ef2912]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cd3066-870a-4942-97ab-07c991e58b69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0e86ac-7d27-4b86-9be7-6e0c50185968]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:45:58 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:45:58 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ceb558-6230-4fe3-baff-f8e037d2037a]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG os_brick.utils [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:45:58 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Updating existing volume attachment record: 0c086acc-1286-43ca-8718-2f7f39709d3b {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:45:59 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Successfully created port: 3b305230-3723-4cde-92c8-bed3d9dff50e {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:46:00 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Successfully updated port: 3b305230-3723-4cde-92c8-bed3d9dff50e {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:46:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "refresh_cache-3af93ab4-1017-45de-94d2-bc7840429fd7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:46:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquired lock "refresh_cache-3af93ab4-1017-45de-94d2-bc7840429fd7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:46:00 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:46:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-d97e8d81-c143-4049-b2e7-c2d401ec7711 req-97794267-ba38-4968-b622-a7341afab932 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Received event network-changed-3b305230-3723-4cde-92c8-bed3d9dff50e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:46:00 user nova-compute[72782]: DEBUG nova.compute.manager [req-d97e8d81-c143-4049-b2e7-c2d401ec7711 req-97794267-ba38-4968-b622-a7341afab932 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Refreshing instance network info cache due to event network-changed-3b305230-3723-4cde-92c8-bed3d9dff50e. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:46:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d97e8d81-c143-4049-b2e7-c2d401ec7711 req-97794267-ba38-4968-b622-a7341afab932 service nova] Acquiring lock "refresh_cache-3af93ab4-1017-45de-94d2-bc7840429fd7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:46:00 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:46:00 user nova-compute[72782]: DEBUG nova.network.neutron [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Updating instance_info_cache with network_info: [{"id": "3b305230-3723-4cde-92c8-bed3d9dff50e", "address": "fa:16:3e:4d:a5:76", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b305230-37", "ovs_interfaceid": "3b305230-3723-4cde-92c8-bed3d9dff50e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:46:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Releasing lock "refresh_cache-3af93ab4-1017-45de-94d2-bc7840429fd7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:46:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Instance network_info: |[{"id": "3b305230-3723-4cde-92c8-bed3d9dff50e", "address": "fa:16:3e:4d:a5:76", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b305230-37", "ovs_interfaceid": "3b305230-3723-4cde-92c8-bed3d9dff50e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:46:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d97e8d81-c143-4049-b2e7-c2d401ec7711 req-97794267-ba38-4968-b622-a7341afab932 service nova] Acquired lock "refresh_cache-3af93ab4-1017-45de-94d2-bc7840429fd7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:46:00 user nova-compute[72782]: DEBUG nova.network.neutron [req-d97e8d81-c143-4049-b2e7-c2d401ec7711 req-97794267-ba38-4968-b622-a7341afab932 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Refreshing network info cache for port 3b305230-3723-4cde-92c8-bed3d9dff50e {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:46:00 user nova-compute[72782]: DEBUG nova.network.neutron [req-d97e8d81-c143-4049-b2e7-c2d401ec7711 req-97794267-ba38-4968-b622-a7341afab932 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Updated VIF entry in instance network info cache for port 3b305230-3723-4cde-92c8-bed3d9dff50e. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:46:00 user nova-compute[72782]: DEBUG nova.network.neutron [req-d97e8d81-c143-4049-b2e7-c2d401ec7711 req-97794267-ba38-4968-b622-a7341afab932 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Updating instance_info_cache with network_info: [{"id": "3b305230-3723-4cde-92c8-bed3d9dff50e", "address": "fa:16:3e:4d:a5:76", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b305230-37", "ovs_interfaceid": "3b305230-3723-4cde-92c8-bed3d9dff50e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:46:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-d97e8d81-c143-4049-b2e7-c2d401ec7711 req-97794267-ba38-4968-b622-a7341afab932 service nova] Releasing lock "refresh_cache-3af93ab4-1017-45de-94d2-bc7840429fd7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:46:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:46:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:46:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:46:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:46:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:46:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:46:07 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Creating image(s)
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Did not create local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Ensure instance console log exists: /opt/stack/data/nova/instances/3af93ab4-1017-45de-94d2-bc7840429fd7/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Start _get_guest_xml network_info=[{"id": "3b305230-3723-4cde-92c8-bed3d9dff50e", "address": "fa:16:3e:4d:a5:76", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b305230-37", "ovs_interfaceid": "3b305230-3723-4cde-92c8-bed3d9dff50e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '0c086acc-1286-43ca-8718-2f7f39709d3b', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPbBtmXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3af93ab4-1017-45de-94d2-bc7840429fd7', 'attached_at': '', 'detached_at': '', 'volume_id': '20d6edff-3eaa-4cb3-9ca1-2efce610f5d7', 'serial': '20d6edff-3eaa-4cb3-9ca1-2efce610f5d7'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:46:07 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:46:07 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPbBtmXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:46:07 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:46:07 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:46:07 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3deab6fd-04df-4288-92bf-fa4a2df8ef3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:46:07 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff063f18-2190-414c-b927-66060c9a2588]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7] added
Aug 14 20:46:07 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ab736b-5f33-47d6-bace-e0ea8d6151c9]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad49d74-2044-4d25-9fe5-3677e8974823]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qPbBtmXa {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qPbBtmXa" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63696f8-ff60-49b3-9bd0-faf59e26c4d6]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qPbBtmXa'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2aa240f-8022-4004-b504-575b3124ece5]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a659826-669f-4870-be99-0469e0d64326]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:46:07 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:46:07 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:46:07 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 20:46:07 user nova-compute[72782]: 
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4b00c6-3571-432d-badb-8ce5f077876f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7, portal: 172.16.0.220,3260]
Aug 14 20:46:07 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7, portal: 172.16.0.220,3260] successful.
Aug 14 20:46:07 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[88945495-5724-4082-b227-37675a2c697d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbbbea7-7aba-4ddb-b2d7-999571a9714f]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 (non-flash)
Aug 14 20:46:07 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 (non-flash)
Aug 14 20:46:07 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[77387bf6-50e7-4bac-bb09-e0c616e41490]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:46:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPbBtmXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26333393337663031', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333393337663031', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:45:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-315035445',display_name='tempest-TestVolumeBootPattern-volume-backed-server-315035445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-315035445',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMArwLtDFIKkOneh+knhMg4ViXiJEk52Wb05xVyOaMAoGE42Rsmbrlu+rWNERNAtFnw3Q6siH34bxfI5WVvnieiYXe3k/EafKs90tn3i2ef6qCpeI3XpM5wiQ1EiqNEEfQ==',key_name='tempest-keypair-439450554',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a99378957e94fc6a148b06bcd9123bf',ramdisk_id='',reservation_id='r-i07t2k5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-52337130',owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:45:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2df6ae64c62142cfbedd244de47bdd2a',uuid=3af93ab4-1017-45de-94d2-bc7840429fd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b305230-3723-4cde-92c8-bed3d9dff50e", "address": "fa:16:3e:4d:a5:76", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b305230-37", "ovs_interfaceid": "3b305230-3723-4cde-92c8-bed3d9dff50e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converting VIF {"id": "3b305230-3723-4cde-92c8-bed3d9dff50e", "address": "fa:16:3e:4d:a5:76", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b305230-37", "ovs_interfaceid": "3b305230-3723-4cde-92c8-bed3d9dff50e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a5:76,bridge_name='br-int',has_traffic_filtering=True,id=3b305230-3723-4cde-92c8-bed3d9dff50e,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b305230-37') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lazy-loading 'pci_devices' on Instance uuid 3af93ab4-1017-45de-94d2-bc7840429fd7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:46:08 user nova-compute[72782]:   <uuid>3af93ab4-1017-45de-94d2-bc7840429fd7</uuid>
Aug 14 20:46:08 user nova-compute[72782]:   <name>instance-00000030</name>
Aug 14 20:46:08 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:46:08 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:46:08 user nova-compute[72782]:   <metadata>
Aug 14 20:46:08 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:46:08 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:46:08 user nova-compute[72782]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-315035445</nova:name>
Aug 14 20:46:08 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:46:07</nova:creationTime>
Aug 14 20:46:08 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:46:08 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:46:08 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:46:08 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:46:08 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:46:08 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:46:08 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:46:08 user nova-compute[72782]:       <nova:owner>
Aug 14 20:46:08 user nova-compute[72782]:         <nova:user uuid="2df6ae64c62142cfbedd244de47bdd2a">tempest-TestVolumeBootPattern-52337130-project-member</nova:user>
Aug 14 20:46:08 user nova-compute[72782]:         <nova:project uuid="0a99378957e94fc6a148b06bcd9123bf">tempest-TestVolumeBootPattern-52337130</nova:project>
Aug 14 20:46:08 user nova-compute[72782]:       </nova:owner>
Aug 14 20:46:08 user nova-compute[72782]:       <nova:ports>
Aug 14 20:46:08 user nova-compute[72782]:         <nova:port uuid="3b305230-3723-4cde-92c8-bed3d9dff50e">
Aug 14 20:46:08 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 20:46:08 user nova-compute[72782]:         </nova:port>
Aug 14 20:46:08 user nova-compute[72782]:       </nova:ports>
Aug 14 20:46:08 user nova-compute[72782]:     </nova:instance>
Aug 14 20:46:08 user nova-compute[72782]:   </metadata>
Aug 14 20:46:08 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:46:08 user nova-compute[72782]:     <system>
Aug 14 20:46:08 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:46:08 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:46:08 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:46:08 user nova-compute[72782]:       <entry name="serial">3af93ab4-1017-45de-94d2-bc7840429fd7</entry>
Aug 14 20:46:08 user nova-compute[72782]:       <entry name="uuid">3af93ab4-1017-45de-94d2-bc7840429fd7</entry>
Aug 14 20:46:08 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:46:08 user nova-compute[72782]:     </system>
Aug 14 20:46:08 user nova-compute[72782]:   </sysinfo>
Aug 14 20:46:08 user nova-compute[72782]:   <os>
Aug 14 20:46:08 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:46:08 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:46:08 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:46:08 user nova-compute[72782]:   </os>
Aug 14 20:46:08 user nova-compute[72782]:   <features>
Aug 14 20:46:08 user nova-compute[72782]:     <acpi/>
Aug 14 20:46:08 user nova-compute[72782]:     <apic/>
Aug 14 20:46:08 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:46:08 user nova-compute[72782]:   </features>
Aug 14 20:46:08 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:46:08 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:46:08 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:46:08 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:46:08 user nova-compute[72782]:   </clock>
Aug 14 20:46:08 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:46:08 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:46:08 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:46:08 user nova-compute[72782]:   </cpu>
Aug 14 20:46:08 user nova-compute[72782]:   <devices>
Aug 14 20:46:08 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 20:46:08 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:46:08 user nova-compute[72782]:       <source dev="/dev/sdb"/>
Aug 14 20:46:08 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:46:08 user nova-compute[72782]:       <serial>20d6edff-3eaa-4cb3-9ca1-2efce610f5d7</serial>
Aug 14 20:46:08 user nova-compute[72782]:     </disk>
Aug 14 20:46:08 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:46:08 user nova-compute[72782]:       <mac address="fa:16:3e:4d:a5:76"/>
Aug 14 20:46:08 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:46:08 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:46:08 user nova-compute[72782]:       <target dev="tap3b305230-37"/>
Aug 14 20:46:08 user nova-compute[72782]:     </interface>
Aug 14 20:46:08 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:46:08 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/3af93ab4-1017-45de-94d2-bc7840429fd7/console.log" append="off"/>
Aug 14 20:46:08 user nova-compute[72782]:     </serial>
Aug 14 20:46:08 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:46:08 user nova-compute[72782]:     <video>
Aug 14 20:46:08 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:46:08 user nova-compute[72782]:     </video>
Aug 14 20:46:08 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:46:08 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:46:08 user nova-compute[72782]:     </rng>
Aug 14 20:46:08 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:46:08 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:46:08 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:46:08 user nova-compute[72782]:     </memballoon>
Aug 14 20:46:08 user nova-compute[72782]:   </devices>
Aug 14 20:46:08 user nova-compute[72782]: </domain>
Aug 14 20:46:08 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:45:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-315035445',display_name='tempest-TestVolumeBootPattern-volume-backed-server-315035445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-315035445',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMArwLtDFIKkOneh+knhMg4ViXiJEk52Wb05xVyOaMAoGE42Rsmbrlu+rWNERNAtFnw3Q6siH34bxfI5WVvnieiYXe3k/EafKs90tn3i2ef6qCpeI3XpM5wiQ1EiqNEEfQ==',key_name='tempest-keypair-439450554',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a99378957e94fc6a148b06bcd9123bf',ramdisk_id='',reservation_id='r-i07t2k5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-52337130',owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:45:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2df6ae64c62142cfbedd244de47bdd2a',uuid=3af93ab4-1017-45de-94d2-bc7840429fd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b305230-3723-4cde-92c8-bed3d9dff50e", "address": "fa:16:3e:4d:a5:76", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b305230-37", "ovs_interfaceid": "3b305230-3723-4cde-92c8-bed3d9dff50e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converting VIF {"id": "3b305230-3723-4cde-92c8-bed3d9dff50e", "address": "fa:16:3e:4d:a5:76", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b305230-37", "ovs_interfaceid": "3b305230-3723-4cde-92c8-bed3d9dff50e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a5:76,bridge_name='br-int',has_traffic_filtering=True,id=3b305230-3723-4cde-92c8-bed3d9dff50e,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b305230-37') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG os_vif [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a5:76,bridge_name='br-int',has_traffic_filtering=True,id=3b305230-3723-4cde-92c8-bed3d9dff50e,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b305230-37') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b305230-37, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b305230-37, col_values=(('external_ids', {'iface-id': '3b305230-3723-4cde-92c8-bed3d9dff50e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:a5:76', 'vm-uuid': '3af93ab4-1017-45de-94d2-bc7840429fd7'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:08 user nova-compute[72782]: INFO os_vif [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:a5:76,bridge_name='br-int',has_traffic_filtering=True,id=3b305230-3723-4cde-92c8-bed3d9dff50e,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b305230-37')
Aug 14 20:46:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:46:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] No VIF found with MAC fa:16:3e:4d:a5:76, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:46:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-f1af153c-f67e-4e9d-9aa8-c89f99a02327 req-7ecf74cc-224d-4269-921c-0ffa0c860b45 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Received event network-vif-plugged-3b305230-3723-4cde-92c8-bed3d9dff50e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:46:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f1af153c-f67e-4e9d-9aa8-c89f99a02327 req-7ecf74cc-224d-4269-921c-0ffa0c860b45 service nova] Acquiring lock "3af93ab4-1017-45de-94d2-bc7840429fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:46:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f1af153c-f67e-4e9d-9aa8-c89f99a02327 req-7ecf74cc-224d-4269-921c-0ffa0c860b45 service nova] Lock "3af93ab4-1017-45de-94d2-bc7840429fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:46:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f1af153c-f67e-4e9d-9aa8-c89f99a02327 req-7ecf74cc-224d-4269-921c-0ffa0c860b45 service nova] Lock "3af93ab4-1017-45de-94d2-bc7840429fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:46:10 user nova-compute[72782]: DEBUG nova.compute.manager [req-f1af153c-f67e-4e9d-9aa8-c89f99a02327 req-7ecf74cc-224d-4269-921c-0ffa0c860b45 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] No waiting events found dispatching network-vif-plugged-3b305230-3723-4cde-92c8-bed3d9dff50e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:46:10 user nova-compute[72782]: WARNING nova.compute.manager [req-f1af153c-f67e-4e9d-9aa8-c89f99a02327 req-7ecf74cc-224d-4269-921c-0ffa0c860b45 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Received unexpected event network-vif-plugged-3b305230-3723-4cde-92c8-bed3d9dff50e for instance with vm_state building and task_state spawning.
Aug 14 20:46:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:12 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692045972.223684, 3af93ab4-1017-45de-94d2-bc7840429fd7 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:46:12 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] VM Resumed (Lifecycle Event)
Aug 14 20:46:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:46:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:46:12 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Instance spawned successfully.
Aug 14 20:46:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:46:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:46:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:46:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:46:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:46:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:46:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:46:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:46:12 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:46:12 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:46:12 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692045972.2258432, 3af93ab4-1017-45de-94d2-bc7840429fd7 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:46:12 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] VM Started (Lifecycle Event)
Aug 14 20:46:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:46:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:46:12 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:46:12 user nova-compute[72782]: INFO nova.compute.manager [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Took 4.97 seconds to spawn the instance on the hypervisor.
Aug 14 20:46:12 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:46:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-16761cc4-37ed-4805-b427-41f2f240fd73 req-1fb0a7ab-3fc9-4c54-9726-328cb92e3973 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Received event network-vif-plugged-3b305230-3723-4cde-92c8-bed3d9dff50e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:46:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-16761cc4-37ed-4805-b427-41f2f240fd73 req-1fb0a7ab-3fc9-4c54-9726-328cb92e3973 service nova] Acquiring lock "3af93ab4-1017-45de-94d2-bc7840429fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:46:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-16761cc4-37ed-4805-b427-41f2f240fd73 req-1fb0a7ab-3fc9-4c54-9726-328cb92e3973 service nova] Lock "3af93ab4-1017-45de-94d2-bc7840429fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:46:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-16761cc4-37ed-4805-b427-41f2f240fd73 req-1fb0a7ab-3fc9-4c54-9726-328cb92e3973 service nova] Lock "3af93ab4-1017-45de-94d2-bc7840429fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:46:12 user nova-compute[72782]: DEBUG nova.compute.manager [req-16761cc4-37ed-4805-b427-41f2f240fd73 req-1fb0a7ab-3fc9-4c54-9726-328cb92e3973 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] No waiting events found dispatching network-vif-plugged-3b305230-3723-4cde-92c8-bed3d9dff50e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:46:12 user nova-compute[72782]: WARNING nova.compute.manager [req-16761cc4-37ed-4805-b427-41f2f240fd73 req-1fb0a7ab-3fc9-4c54-9726-328cb92e3973 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Received unexpected event network-vif-plugged-3b305230-3723-4cde-92c8-bed3d9dff50e for instance with vm_state building and task_state spawning.
Aug 14 20:46:12 user nova-compute[72782]: INFO nova.compute.manager [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Took 13.96 seconds to build instance.
Aug 14 20:46:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5f5a0eec-c31e-42a2-ae93-5c24be787692 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "3af93ab4-1017-45de-94d2-bc7840429fd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.048s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:46:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:39 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:46:41 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:46:41 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:46:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:46:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:47 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:46:47 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:46:47 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:46:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-3af93ab4-1017-45de-94d2-bc7840429fd7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:46:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-3af93ab4-1017-45de-94d2-bc7840429fd7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:46:47 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:46:47 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 3af93ab4-1017-45de-94d2-bc7840429fd7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:46:47 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Updating instance_info_cache with network_info: [{"id": "3b305230-3723-4cde-92c8-bed3d9dff50e", "address": "fa:16:3e:4d:a5:76", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b305230-37", "ovs_interfaceid": "3b305230-3723-4cde-92c8-bed3d9dff50e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:46:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-3af93ab4-1017-45de-94d2-bc7840429fd7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:46:47 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:46:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:46:50 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:46:50 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:46:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8716MB free_disk=25.279476165771484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3af93ab4-1017-45de-94d2-bc7840429fd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing inventories for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating ProviderTree inventory for provider d26c9e3b-40e6-476e-9664-3119ebf5873b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing aggregate associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, aggregates: None {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing trait associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:46:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:46:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:46:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:46:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:46:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:46:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:46:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:46:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:46:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 20:46:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] There are 0 instances to clean {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 20:46:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:47:03 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:47:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:47:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:47:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:47:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:47:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:47:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:47:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:47:38 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:47:38 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72782) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 20:47:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:47:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:47:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:47:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:47:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:47:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:47:41 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:47:41 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:47:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:47:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:47:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:47:47 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:47:47 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:47:47 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:47:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-3af93ab4-1017-45de-94d2-bc7840429fd7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:47:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-3af93ab4-1017-45de-94d2-bc7840429fd7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:47:47 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:47:47 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 3af93ab4-1017-45de-94d2-bc7840429fd7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:47:47 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Updating instance_info_cache with network_info: [{"id": "3b305230-3723-4cde-92c8-bed3d9dff50e", "address": "fa:16:3e:4d:a5:76", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b305230-37", "ovs_interfaceid": "3b305230-3723-4cde-92c8-bed3d9dff50e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:47:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-3af93ab4-1017-45de-94d2-bc7840429fd7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:47:47 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:47:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:47:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-f26a3a14-6c61-4bca-a06c-aa6008696119 req-2aac6807-09ef-41b3-a852-6248b01f69d3 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Received event network-changed-3b305230-3723-4cde-92c8-bed3d9dff50e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:47:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-f26a3a14-6c61-4bca-a06c-aa6008696119 req-2aac6807-09ef-41b3-a852-6248b01f69d3 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Refreshing instance network info cache due to event network-changed-3b305230-3723-4cde-92c8-bed3d9dff50e. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:47:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f26a3a14-6c61-4bca-a06c-aa6008696119 req-2aac6807-09ef-41b3-a852-6248b01f69d3 service nova] Acquiring lock "refresh_cache-3af93ab4-1017-45de-94d2-bc7840429fd7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:47:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f26a3a14-6c61-4bca-a06c-aa6008696119 req-2aac6807-09ef-41b3-a852-6248b01f69d3 service nova] Acquired lock "refresh_cache-3af93ab4-1017-45de-94d2-bc7840429fd7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:47:49 user nova-compute[72782]: DEBUG nova.network.neutron [req-f26a3a14-6c61-4bca-a06c-aa6008696119 req-2aac6807-09ef-41b3-a852-6248b01f69d3 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Refreshing network info cache for port 3b305230-3723-4cde-92c8-bed3d9dff50e {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG nova.network.neutron [req-f26a3a14-6c61-4bca-a06c-aa6008696119 req-2aac6807-09ef-41b3-a852-6248b01f69d3 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Updated VIF entry in instance network info cache for port 3b305230-3723-4cde-92c8-bed3d9dff50e. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG nova.network.neutron [req-f26a3a14-6c61-4bca-a06c-aa6008696119 req-2aac6807-09ef-41b3-a852-6248b01f69d3 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Updating instance_info_cache with network_info: [{"id": "3b305230-3723-4cde-92c8-bed3d9dff50e", "address": "fa:16:3e:4d:a5:76", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b305230-37", "ovs_interfaceid": "3b305230-3723-4cde-92c8-bed3d9dff50e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f26a3a14-6c61-4bca-a06c-aa6008696119 req-2aac6807-09ef-41b3-a852-6248b01f69d3 service nova] Releasing lock "refresh_cache-3af93ab4-1017-45de-94d2-bc7840429fd7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:47:50 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:47:50 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:47:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8749MB free_disk=25.278884887695312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3af93ab4-1017-45de-94d2-bc7840429fd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:47:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:47:52 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:47:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:47:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:47:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:47:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:47:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:47:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:47:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "d7309eb4-87ef-407e-8853-85be3a3d5e30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:48:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "d7309eb4-87ef-407e-8853-85be3a3d5e30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:48:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:48:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:48:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:48:01 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:48:01 user nova-compute[72782]: INFO nova.compute.claims [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Claim successful on node user
Aug 14 20:48:01 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:48:01 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:48:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:48:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:48:01 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:48:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:48:01 user nova-compute[72782]: DEBUG nova.network.neutron [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:48:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:48:02 user nova-compute[72782]: INFO nova.virt.block_device [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Booting with volume snapshot 0667f598-3728-4de4-a236-775d94a4ffe4 at /dev/vda
Aug 14 20:48:02 user nova-compute[72782]: DEBUG nova.policy [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2df6ae64c62142cfbedd244de47bdd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a99378957e94fc6a148b06bcd9123bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:48:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Successfully created port: da3057af-4912-4ac9-800b-42bff16cdecf {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:48:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Successfully updated port: da3057af-4912-4ac9-800b-42bff16cdecf {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:48:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "refresh_cache-d7309eb4-87ef-407e-8853-85be3a3d5e30" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:48:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquired lock "refresh_cache-d7309eb4-87ef-407e-8853-85be3a3d5e30" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:48:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:48:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-b9e3096e-cd38-4e5d-a869-6b84900f6409 req-b84eef0d-b8e0-4478-ae1c-ec025590244d service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Received event network-changed-da3057af-4912-4ac9-800b-42bff16cdecf {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:48:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-b9e3096e-cd38-4e5d-a869-6b84900f6409 req-b84eef0d-b8e0-4478-ae1c-ec025590244d service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Refreshing instance network info cache due to event network-changed-da3057af-4912-4ac9-800b-42bff16cdecf. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:48:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b9e3096e-cd38-4e5d-a869-6b84900f6409 req-b84eef0d-b8e0-4478-ae1c-ec025590244d service nova] Acquiring lock "refresh_cache-d7309eb4-87ef-407e-8853-85be3a3d5e30" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:48:04 user nova-compute[72782]: DEBUG nova.network.neutron [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:48:04 user nova-compute[72782]: DEBUG nova.network.neutron [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Updating instance_info_cache with network_info: [{"id": "da3057af-4912-4ac9-800b-42bff16cdecf", "address": "fa:16:3e:a2:24:3b", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3057af-49", "ovs_interfaceid": "da3057af-4912-4ac9-800b-42bff16cdecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:48:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Releasing lock "refresh_cache-d7309eb4-87ef-407e-8853-85be3a3d5e30" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:48:04 user nova-compute[72782]: DEBUG nova.compute.manager [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Instance network_info: |[{"id": "da3057af-4912-4ac9-800b-42bff16cdecf", "address": "fa:16:3e:a2:24:3b", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3057af-49", "ovs_interfaceid": "da3057af-4912-4ac9-800b-42bff16cdecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:48:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b9e3096e-cd38-4e5d-a869-6b84900f6409 req-b84eef0d-b8e0-4478-ae1c-ec025590244d service nova] Acquired lock "refresh_cache-d7309eb4-87ef-407e-8853-85be3a3d5e30" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:48:04 user nova-compute[72782]: DEBUG nova.network.neutron [req-b9e3096e-cd38-4e5d-a869-6b84900f6409 req-b84eef0d-b8e0-4478-ae1c-ec025590244d service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Refreshing network info cache for port da3057af-4912-4ac9-800b-42bff16cdecf {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:48:04 user nova-compute[72782]: DEBUG nova.network.neutron [req-b9e3096e-cd38-4e5d-a869-6b84900f6409 req-b84eef0d-b8e0-4478-ae1c-ec025590244d service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Updated VIF entry in instance network info cache for port da3057af-4912-4ac9-800b-42bff16cdecf. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:48:04 user nova-compute[72782]: DEBUG nova.network.neutron [req-b9e3096e-cd38-4e5d-a869-6b84900f6409 req-b84eef0d-b8e0-4478-ae1c-ec025590244d service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Updating instance_info_cache with network_info: [{"id": "da3057af-4912-4ac9-800b-42bff16cdecf", "address": "fa:16:3e:a2:24:3b", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3057af-49", "ovs_interfaceid": "da3057af-4912-4ac9-800b-42bff16cdecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:48:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-b9e3096e-cd38-4e5d-a869-6b84900f6409 req-b84eef0d-b8e0-4478-ae1c-ec025590244d service nova] Releasing lock "refresh_cache-d7309eb4-87ef-407e-8853-85be3a3d5e30" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG os_brick.utils [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[25248d0b-80fa-4bcb-86ed-c11df7f691a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d9f093-6100-407f-aaf8-93f14dfa76cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89aabfc-a978-4947-9789-93b4eaff7e68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e465ea-f61a-4e3c-ac51-c8991e829c34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:48:07 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:48:07 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd2bb48-3955-4672-ac3a-3bd9446e1924]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG os_brick.utils [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:48:07 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Updating existing volume attachment record: add6e43b-1ff1-4f3a-bc85-1ea9ce6e2c9a {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:48:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:48:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:21 user nova-compute[72782]: DEBUG nova.compute.manager [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:48:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:48:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Creating image(s)
Aug 14 20:48:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Did not create local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 20:48:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Ensure instance console log exists: /opt/stack/data/nova/instances/d7309eb4-87ef-407e-8853-85be3a3d5e30/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:48:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:48:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:48:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:48:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Start _get_guest_xml network_info=[{"id": "da3057af-4912-4ac9-800b-42bff16cdecf", "address": "fa:16:3e:a2:24:3b", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3057af-49", "ovs_interfaceid": "da3057af-4912-4ac9-800b-42bff16cdecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-14T20:47:52Z,direct_url=<?>,disk_format='qcow2',id=41132d1f-a454-45d8-a37c-275f5d2812b7,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-763909800',owner='0a99378957e94fc6a148b06bcd9123bf',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-14T20:47:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'add6e43b-1ff1-4f3a-bc85-1ea9ce6e2c9a', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXQujKMa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd7309eb4-87ef-407e-8853-85be3a3d5e30', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2ab8f6b-6248-4307-bf55-4a76848b287d', 'serial': 'c2ab8f6b-6248-4307-bf55-4a76848b287d'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:48:21 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:48:21 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:48:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-14T20:47:52Z,direct_url=<?>,disk_format='qcow2',id=41132d1f-a454-45d8-a37c-275f5d2812b7,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-763909800',owner='0a99378957e94fc6a148b06bcd9123bf',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-14T20:47:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXQujKMa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:48:22 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:48:22 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:48:22 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcbac0b-fa5e-4bbd-ba2e-c0a36c566eec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:48:22 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa716614-307b-4f57-9b65-4e710cdd212e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d] added
Aug 14 20:48:22 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46e8caa-df95-4dd7-bf3c-4eb3940d77ad]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4b55d1-6631-430a-a0ba-73c836fd45f1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IXQujKMa {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IXQujKMa" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5651f48-8449-4997-a85c-ac6aa266df77]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IXQujKMa'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a418131-8ba5-4f27-ab29-967bb11ff096]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2b9813-a98c-40aa-8374-c0f72aafeb4f]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 (non-flash)
Aug 14 20:48:22 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 (non-flash)
Aug 14 20:48:22 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e633c5b4-8a30-40aa-b246-f4c97e927057]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d, portal: 172.16.0.220,3260]
Aug 14 20:48:22 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d, portal: 172.16.0.220,3260] successful.
Aug 14 20:48:22 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ba4dc5-8308-4a64-844c-a251f96c92e8]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a86232-6516-452f-aada-308208460fb0]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 (non-flash)
Aug 14 20:48:22 user nova-compute[72782]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d (non-flash)
Aug 14 20:48:22 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 (non-flash)
Aug 14 20:48:22 user nova-compute[72782]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d (non-flash)
Aug 14 20:48:22 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f1a466-a8b9-4eff-bb2f-7ff55989e224]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:48:22 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXQujKMa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26634393835366562', 'path': '/dev/sdc'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634393835366562', 'path': '/dev/sdc'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-849284062',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-849284062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-849284062',id=49,image_ref='41132d1f-a454-45d8-a37c-275f5d2812b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCPsKttW7XByy1zFNFG61cC1jnYp0XLAENoA6WeSq1y9A4E6hT1Z1oX2p9NNe7WDSFzgDZsb4KlOxaxL8QsjnghJI33ViyA4DXWNAJ2HnJy9RpWwVgCYC4vso8URN16TQ==',key_name='tempest-keypair-436855013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a99378957e94fc6a148b06bcd9123bf',ramdisk_id='',reservation_id='r-1wgxdzkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-52337130',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-52337130',owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:48:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2df6ae64c62142cfbedd244de47bdd2a',uuid=d7309eb4-87ef-407e-8853-85be3a3d5e30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da3057af-4912-4ac9-800b-42bff16cdecf", "address": "fa:16:3e:a2:24:3b", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3057af-49", "ovs_interfaceid": "da3057af-4912-4ac9-800b-42bff16cdecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converting VIF {"id": "da3057af-4912-4ac9-800b-42bff16cdecf", "address": "fa:16:3e:a2:24:3b", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3057af-49", "ovs_interfaceid": "da3057af-4912-4ac9-800b-42bff16cdecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:24:3b,bridge_name='br-int',has_traffic_filtering=True,id=da3057af-4912-4ac9-800b-42bff16cdecf,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3057af-49') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG nova.objects.instance [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lazy-loading 'pci_devices' on Instance uuid d7309eb4-87ef-407e-8853-85be3a3d5e30 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:48:23 user nova-compute[72782]:   <uuid>d7309eb4-87ef-407e-8853-85be3a3d5e30</uuid>
Aug 14 20:48:23 user nova-compute[72782]:   <name>instance-00000031</name>
Aug 14 20:48:23 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:48:23 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:48:23 user nova-compute[72782]:   <metadata>
Aug 14 20:48:23 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:48:23 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:48:23 user nova-compute[72782]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-849284062</nova:name>
Aug 14 20:48:23 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:48:21</nova:creationTime>
Aug 14 20:48:23 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:48:23 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:48:23 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:48:23 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:48:23 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:48:23 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:48:23 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:48:23 user nova-compute[72782]:       <nova:owner>
Aug 14 20:48:23 user nova-compute[72782]:         <nova:user uuid="2df6ae64c62142cfbedd244de47bdd2a">tempest-TestVolumeBootPattern-52337130-project-member</nova:user>
Aug 14 20:48:23 user nova-compute[72782]:         <nova:project uuid="0a99378957e94fc6a148b06bcd9123bf">tempest-TestVolumeBootPattern-52337130</nova:project>
Aug 14 20:48:23 user nova-compute[72782]:       </nova:owner>
Aug 14 20:48:23 user nova-compute[72782]:       <nova:root type="image" uuid="41132d1f-a454-45d8-a37c-275f5d2812b7"/>
Aug 14 20:48:23 user nova-compute[72782]:       <nova:ports>
Aug 14 20:48:23 user nova-compute[72782]:         <nova:port uuid="da3057af-4912-4ac9-800b-42bff16cdecf">
Aug 14 20:48:23 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 20:48:23 user nova-compute[72782]:         </nova:port>
Aug 14 20:48:23 user nova-compute[72782]:       </nova:ports>
Aug 14 20:48:23 user nova-compute[72782]:     </nova:instance>
Aug 14 20:48:23 user nova-compute[72782]:   </metadata>
Aug 14 20:48:23 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:48:23 user nova-compute[72782]:     <system>
Aug 14 20:48:23 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:48:23 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:48:23 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:48:23 user nova-compute[72782]:       <entry name="serial">d7309eb4-87ef-407e-8853-85be3a3d5e30</entry>
Aug 14 20:48:23 user nova-compute[72782]:       <entry name="uuid">d7309eb4-87ef-407e-8853-85be3a3d5e30</entry>
Aug 14 20:48:23 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:48:23 user nova-compute[72782]:     </system>
Aug 14 20:48:23 user nova-compute[72782]:   </sysinfo>
Aug 14 20:48:23 user nova-compute[72782]:   <os>
Aug 14 20:48:23 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:48:23 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:48:23 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:48:23 user nova-compute[72782]:   </os>
Aug 14 20:48:23 user nova-compute[72782]:   <features>
Aug 14 20:48:23 user nova-compute[72782]:     <acpi/>
Aug 14 20:48:23 user nova-compute[72782]:     <apic/>
Aug 14 20:48:23 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:48:23 user nova-compute[72782]:   </features>
Aug 14 20:48:23 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:48:23 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:48:23 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:48:23 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:48:23 user nova-compute[72782]:   </clock>
Aug 14 20:48:23 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:48:23 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:48:23 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:48:23 user nova-compute[72782]:   </cpu>
Aug 14 20:48:23 user nova-compute[72782]:   <devices>
Aug 14 20:48:23 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 20:48:23 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:48:23 user nova-compute[72782]:       <source dev="/dev/sdc"/>
Aug 14 20:48:23 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:48:23 user nova-compute[72782]:       <serial>c2ab8f6b-6248-4307-bf55-4a76848b287d</serial>
Aug 14 20:48:23 user nova-compute[72782]:     </disk>
Aug 14 20:48:23 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:48:23 user nova-compute[72782]:       <mac address="fa:16:3e:a2:24:3b"/>
Aug 14 20:48:23 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:48:23 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:48:23 user nova-compute[72782]:       <target dev="tapda3057af-49"/>
Aug 14 20:48:23 user nova-compute[72782]:     </interface>
Aug 14 20:48:23 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:48:23 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/d7309eb4-87ef-407e-8853-85be3a3d5e30/console.log" append="off"/>
Aug 14 20:48:23 user nova-compute[72782]:     </serial>
Aug 14 20:48:23 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:48:23 user nova-compute[72782]:     <video>
Aug 14 20:48:23 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:48:23 user nova-compute[72782]:     </video>
Aug 14 20:48:23 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:48:23 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:48:23 user nova-compute[72782]:     </rng>
Aug 14 20:48:23 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:48:23 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:48:23 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:48:23 user nova-compute[72782]:     </memballoon>
Aug 14 20:48:23 user nova-compute[72782]:   </devices>
Aug 14 20:48:23 user nova-compute[72782]: </domain>
Aug 14 20:48:23 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-849284062',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-849284062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-849284062',id=49,image_ref='41132d1f-a454-45d8-a37c-275f5d2812b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCPsKttW7XByy1zFNFG61cC1jnYp0XLAENoA6WeSq1y9A4E6hT1Z1oX2p9NNe7WDSFzgDZsb4KlOxaxL8QsjnghJI33ViyA4DXWNAJ2HnJy9RpWwVgCYC4vso8URN16TQ==',key_name='tempest-keypair-436855013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a99378957e94fc6a148b06bcd9123bf',ramdisk_id='',reservation_id='r-1wgxdzkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-52337130',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-52337130',owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:48:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2df6ae64c62142cfbedd244de47bdd2a',uuid=d7309eb4-87ef-407e-8853-85be3a3d5e30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da3057af-4912-4ac9-800b-42bff16cdecf", "address": "fa:16:3e:a2:24:3b", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3057af-49", "ovs_interfaceid": "da3057af-4912-4ac9-800b-42bff16cdecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converting VIF {"id": "da3057af-4912-4ac9-800b-42bff16cdecf", "address": "fa:16:3e:a2:24:3b", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3057af-49", "ovs_interfaceid": "da3057af-4912-4ac9-800b-42bff16cdecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:24:3b,bridge_name='br-int',has_traffic_filtering=True,id=da3057af-4912-4ac9-800b-42bff16cdecf,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3057af-49') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG os_vif [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:24:3b,bridge_name='br-int',has_traffic_filtering=True,id=da3057af-4912-4ac9-800b-42bff16cdecf,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3057af-49') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda3057af-49, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda3057af-49, col_values=(('external_ids', {'iface-id': 'da3057af-4912-4ac9-800b-42bff16cdecf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:24:3b', 'vm-uuid': 'd7309eb4-87ef-407e-8853-85be3a3d5e30'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:23 user nova-compute[72782]: INFO os_vif [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:24:3b,bridge_name='br-int',has_traffic_filtering=True,id=da3057af-4912-4ac9-800b-42bff16cdecf,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3057af-49')
Aug 14 20:48:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] No VIF found with MAC fa:16:3e:a2:24:3b, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:48:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-0ed43189-2438-4721-a327-a25a3c55daef req-981a27ae-afde-4948-a79d-b496b26d73e9 service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Received event network-vif-plugged-da3057af-4912-4ac9-800b-42bff16cdecf {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:48:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0ed43189-2438-4721-a327-a25a3c55daef req-981a27ae-afde-4948-a79d-b496b26d73e9 service nova] Acquiring lock "d7309eb4-87ef-407e-8853-85be3a3d5e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:48:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0ed43189-2438-4721-a327-a25a3c55daef req-981a27ae-afde-4948-a79d-b496b26d73e9 service nova] Lock "d7309eb4-87ef-407e-8853-85be3a3d5e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:48:24 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0ed43189-2438-4721-a327-a25a3c55daef req-981a27ae-afde-4948-a79d-b496b26d73e9 service nova] Lock "d7309eb4-87ef-407e-8853-85be3a3d5e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:48:24 user nova-compute[72782]: DEBUG nova.compute.manager [req-0ed43189-2438-4721-a327-a25a3c55daef req-981a27ae-afde-4948-a79d-b496b26d73e9 service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] No waiting events found dispatching network-vif-plugged-da3057af-4912-4ac9-800b-42bff16cdecf {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:48:24 user nova-compute[72782]: WARNING nova.compute.manager [req-0ed43189-2438-4721-a327-a25a3c55daef req-981a27ae-afde-4948-a79d-b496b26d73e9 service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Received unexpected event network-vif-plugged-da3057af-4912-4ac9-800b-42bff16cdecf for instance with vm_state building and task_state spawning.
Aug 14 20:48:26 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692046106.8006454, d7309eb4-87ef-407e-8853-85be3a3d5e30 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:48:26 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] VM Resumed (Lifecycle Event)
Aug 14 20:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:48:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:48:26 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Instance spawned successfully.
Aug 14 20:48:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:48:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:48:26 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:48:26 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:48:26 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692046106.8018715, d7309eb4-87ef-407e-8853-85be3a3d5e30 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:48:26 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] VM Started (Lifecycle Event)
Aug 14 20:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:48:26 user nova-compute[72782]: INFO nova.compute.manager [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Took 4.90 seconds to spawn the instance on the hypervisor.
Aug 14 20:48:26 user nova-compute[72782]: DEBUG nova.compute.manager [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:48:26 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:48:26 user nova-compute[72782]: INFO nova.compute.manager [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Took 25.54 seconds to build instance.
Aug 14 20:48:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-40ed038a-d4a0-457f-b66e-fa6def24a550 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "d7309eb4-87ef-407e-8853-85be3a3d5e30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.631s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:48:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-0667b6e9-93a7-49a9-9320-45dd086faf90 req-a1a724fb-343d-474f-a3a5-ebbb99c3bd58 service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Received event network-vif-plugged-da3057af-4912-4ac9-800b-42bff16cdecf {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:48:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0667b6e9-93a7-49a9-9320-45dd086faf90 req-a1a724fb-343d-474f-a3a5-ebbb99c3bd58 service nova] Acquiring lock "d7309eb4-87ef-407e-8853-85be3a3d5e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:48:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0667b6e9-93a7-49a9-9320-45dd086faf90 req-a1a724fb-343d-474f-a3a5-ebbb99c3bd58 service nova] Lock "d7309eb4-87ef-407e-8853-85be3a3d5e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:48:27 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-0667b6e9-93a7-49a9-9320-45dd086faf90 req-a1a724fb-343d-474f-a3a5-ebbb99c3bd58 service nova] Lock "d7309eb4-87ef-407e-8853-85be3a3d5e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:48:27 user nova-compute[72782]: DEBUG nova.compute.manager [req-0667b6e9-93a7-49a9-9320-45dd086faf90 req-a1a724fb-343d-474f-a3a5-ebbb99c3bd58 service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] No waiting events found dispatching network-vif-plugged-da3057af-4912-4ac9-800b-42bff16cdecf {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:48:27 user nova-compute[72782]: WARNING nova.compute.manager [req-0667b6e9-93a7-49a9-9320-45dd086faf90 req-a1a724fb-343d-474f-a3a5-ebbb99c3bd58 service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Received unexpected event network-vif-plugged-da3057af-4912-4ac9-800b-42bff16cdecf for instance with vm_state active and task_state None.
Aug 14 20:48:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:42 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:48:43 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:48:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:44 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:48:45 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:48:48 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:48:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:48:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:48:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-3af93ab4-1017-45de-94d2-bc7840429fd7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:48:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-3af93ab4-1017-45de-94d2-bc7840429fd7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:48:48 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:48:48 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 3af93ab4-1017-45de-94d2-bc7840429fd7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:48:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:48 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Updating instance_info_cache with network_info: [{"id": "3b305230-3723-4cde-92c8-bed3d9dff50e", "address": "fa:16:3e:4d:a5:76", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b305230-37", "ovs_interfaceid": "3b305230-3723-4cde-92c8-bed3d9dff50e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:48:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-3af93ab4-1017-45de-94d2-bc7840429fd7" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:48:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:48:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:50 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:48:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:48:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:48:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:48:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:48:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:48:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:48:50 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:48:50 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:48:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8601MB free_disk=25.27692413330078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:48:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:48:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:48:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3af93ab4-1017-45de-94d2-bc7840429fd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:48:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance d7309eb4-87ef-407e-8853-85be3a3d5e30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:48:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:48:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:48:50 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:48:50 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:48:50 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:48:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:48:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:48:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:48:52 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:48:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:48:55 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:48:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:49:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:49:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:49:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:49:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:49:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:49:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:49:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:49:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:49:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:49:44 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:49:45 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:49:45 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:49:47 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:49:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:49:49 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:49:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:49:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-d7309eb4-87ef-407e-8853-85be3a3d5e30" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:49:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-d7309eb4-87ef-407e-8853-85be3a3d5e30" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:49:49 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:49:49 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Updating instance_info_cache with network_info: [{"id": "da3057af-4912-4ac9-800b-42bff16cdecf", "address": "fa:16:3e:a2:24:3b", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3057af-49", "ovs_interfaceid": "da3057af-4912-4ac9-800b-42bff16cdecf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:49:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-d7309eb4-87ef-407e-8853-85be3a3d5e30" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:49:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:49:51 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:49:51 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:49:51 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8654MB free_disk=25.276290893554688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 3af93ab4-1017-45de-94d2-bc7840429fd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance d7309eb4-87ef-407e-8853-85be3a3d5e30 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:49:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:49:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-69dbb264-299a-4933-b027-268624055f3b req-be64451a-5b00-4191-9404-2593ae846834 service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Received event network-changed-da3057af-4912-4ac9-800b-42bff16cdecf {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:49:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-69dbb264-299a-4933-b027-268624055f3b req-be64451a-5b00-4191-9404-2593ae846834 service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Refreshing instance network info cache due to event network-changed-da3057af-4912-4ac9-800b-42bff16cdecf. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:49:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-69dbb264-299a-4933-b027-268624055f3b req-be64451a-5b00-4191-9404-2593ae846834 service nova] Acquiring lock "refresh_cache-d7309eb4-87ef-407e-8853-85be3a3d5e30" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:49:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-69dbb264-299a-4933-b027-268624055f3b req-be64451a-5b00-4191-9404-2593ae846834 service nova] Acquired lock "refresh_cache-d7309eb4-87ef-407e-8853-85be3a3d5e30" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:49:52 user nova-compute[72782]: DEBUG nova.network.neutron [req-69dbb264-299a-4933-b027-268624055f3b req-be64451a-5b00-4191-9404-2593ae846834 service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Refreshing network info cache for port da3057af-4912-4ac9-800b-42bff16cdecf {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:49:52 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "d7309eb4-87ef-407e-8853-85be3a3d5e30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "d7309eb4-87ef-407e-8853-85be3a3d5e30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "d7309eb4-87ef-407e-8853-85be3a3d5e30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "d7309eb4-87ef-407e-8853-85be3a3d5e30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "d7309eb4-87ef-407e-8853-85be3a3d5e30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:49:53 user nova-compute[72782]: INFO nova.compute.manager [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Terminating instance
Aug 14 20:49:53 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG nova.network.neutron [req-69dbb264-299a-4933-b027-268624055f3b req-be64451a-5b00-4191-9404-2593ae846834 service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Updated VIF entry in instance network info cache for port da3057af-4912-4ac9-800b-42bff16cdecf. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG nova.network.neutron [req-69dbb264-299a-4933-b027-268624055f3b req-be64451a-5b00-4191-9404-2593ae846834 service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Updating instance_info_cache with network_info: [{"id": "da3057af-4912-4ac9-800b-42bff16cdecf", "address": "fa:16:3e:a2:24:3b", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3057af-49", "ovs_interfaceid": "da3057af-4912-4ac9-800b-42bff16cdecf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-69dbb264-299a-4933-b027-268624055f3b req-be64451a-5b00-4191-9404-2593ae846834 service nova] Releasing lock "refresh_cache-d7309eb4-87ef-407e-8853-85be3a3d5e30" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG nova.compute.manager [req-83495193-a7c0-456c-947d-302e71f5df16 req-729cb391-f459-46ab-aeed-2f01313c563e service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Received event network-vif-unplugged-da3057af-4912-4ac9-800b-42bff16cdecf {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-83495193-a7c0-456c-947d-302e71f5df16 req-729cb391-f459-46ab-aeed-2f01313c563e service nova] Acquiring lock "d7309eb4-87ef-407e-8853-85be3a3d5e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-83495193-a7c0-456c-947d-302e71f5df16 req-729cb391-f459-46ab-aeed-2f01313c563e service nova] Lock "d7309eb4-87ef-407e-8853-85be3a3d5e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-83495193-a7c0-456c-947d-302e71f5df16 req-729cb391-f459-46ab-aeed-2f01313c563e service nova] Lock "d7309eb4-87ef-407e-8853-85be3a3d5e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG nova.compute.manager [req-83495193-a7c0-456c-947d-302e71f5df16 req-729cb391-f459-46ab-aeed-2f01313c563e service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] No waiting events found dispatching network-vif-unplugged-da3057af-4912-4ac9-800b-42bff16cdecf {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG nova.compute.manager [req-83495193-a7c0-456c-947d-302e71f5df16 req-729cb391-f459-46ab-aeed-2f01313c563e service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Received event network-vif-unplugged-da3057af-4912-4ac9-800b-42bff16cdecf for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:49:53 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Instance destroyed successfully.
Aug 14 20:49:53 user nova-compute[72782]: DEBUG nova.objects.instance [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lazy-loading 'resources' on Instance uuid d7309eb4-87ef-407e-8853-85be3a3d5e30 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-849284062',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-849284062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-849284062',id=49,image_ref='41132d1f-a454-45d8-a37c-275f5d2812b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCPsKttW7XByy1zFNFG61cC1jnYp0XLAENoA6WeSq1y9A4E6hT1Z1oX2p9NNe7WDSFzgDZsb4KlOxaxL8QsjnghJI33ViyA4DXWNAJ2HnJy9RpWwVgCYC4vso8URN16TQ==',key_name='tempest-keypair-436855013',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:48:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a99378957e94fc6a148b06bcd9123bf',ramdisk_id='',reservation_id='r-1wgxdzkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-52337130',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-52337130',owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:48:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2df6ae64c62142cfbedd244de47bdd2a',uuid=d7309eb4-87ef-407e-8853-85be3a3d5e30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da3057af-4912-4ac9-800b-42bff16cdecf", "address": "fa:16:3e:a2:24:3b", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3057af-49", "ovs_interfaceid": "da3057af-4912-4ac9-800b-42bff16cdecf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converting VIF {"id": "da3057af-4912-4ac9-800b-42bff16cdecf", "address": "fa:16:3e:a2:24:3b", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3057af-49", "ovs_interfaceid": "da3057af-4912-4ac9-800b-42bff16cdecf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:24:3b,bridge_name='br-int',has_traffic_filtering=True,id=da3057af-4912-4ac9-800b-42bff16cdecf,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3057af-49') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG os_vif [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:24:3b,bridge_name='br-int',has_traffic_filtering=True,id=da3057af-4912-4ac9-800b-42bff16cdecf,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3057af-49') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda3057af-49, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:49:53 user nova-compute[72782]: INFO os_vif [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:24:3b,bridge_name='br-int',has_traffic_filtering=True,id=da3057af-4912-4ac9-800b-42bff16cdecf,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3057af-49')
Aug 14 20:49:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXQujKMa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:49:53 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:49:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd5df3c-4433-4d7f-b6b8-f7e25f4eb887]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:49:53 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b07d22-3772-49d3-9995-1963c4fe2c57]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 (non-flash)
Aug 14 20:49:54 user nova-compute[72782]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d (non-flash)
Aug 14 20:49:54 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 (non-flash)
Aug 14 20:49:54 user nova-compute[72782]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d (non-flash)
Aug 14 20:49:54 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6408481750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d'): ({'sdc'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Removing single pathed devices sdc {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1861a2b6-eb55-4c3a-901e-9dce4b0849e8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cad532-937c-42f8-9c84-688243615684]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Flushing IO for device /dev/sdc {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[81184ff8-c797-417c-ab6a-75e023b78d70]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85265b2-2d56-4b65-820e-f2caf5b42290]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] SCSI volumes sdc have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ad6c41f4', '/dev/disk/by-id/scsi-26634393835366562', '/dev/disk/by-id/scsi-1SCST_BIOad6c41f4-f49856eb246fc89e') {{(pid=83776) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 20:49:54 user nova-compute[72782]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_ad6c41f4
Aug 14 20:49:54 user nova-compute[72782]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26634393835366562
Aug 14 20:49:54 user nova-compute[72782]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOad6c41f4-f49856eb246fc89e
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0876d620-90d8-4f58-a0ba-3b1362065ffd]: (4, None) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[617179b5-e5f8-4c0e-8080-a68ee9dbae5c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbbff80-e77d-45b4-825e-8465f7f4af8b]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d, portal: 172.16.0.220,3260]
Aug 14 20:49:54 user nova-compute[72782]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d, portal: 172.16.0.220,3260] successful.
Aug 14 20:49:54 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ab8f6b-6248-4307-bf55-4a76848b287d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3743e364-769c-4028-8d64-fb1232ab7356]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] <== disconnect_volume: return (292ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:49:54 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Deleting instance files /opt/stack/data/nova/instances/d7309eb4-87ef-407e-8853-85be3a3d5e30_del
Aug 14 20:49:54 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Deletion of /opt/stack/data/nova/instances/d7309eb4-87ef-407e-8853-85be3a3d5e30_del complete
Aug 14 20:49:54 user nova-compute[72782]: INFO nova.compute.manager [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 14 20:49:54 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:49:54 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:49:55 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:49:55 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Took 0.87 seconds to deallocate network for instance.
Aug 14 20:49:55 user nova-compute[72782]: DEBUG nova.compute.manager [req-57fcb9e6-6c16-4d3c-a1ed-7bd648cb4929 req-7eaad60e-4add-4eae-8e8f-7b8c314910e3 service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Received event network-vif-deleted-da3057af-4912-4ac9-800b-42bff16cdecf {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:49:55 user nova-compute[72782]: DEBUG nova.compute.manager [req-5d6d9aac-53ca-4abf-8091-1016eaf642ca req-68ce95d0-85c7-4866-9cdc-54caf56f9034 service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Received event network-vif-plugged-da3057af-4912-4ac9-800b-42bff16cdecf {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:49:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5d6d9aac-53ca-4abf-8091-1016eaf642ca req-68ce95d0-85c7-4866-9cdc-54caf56f9034 service nova] Acquiring lock "d7309eb4-87ef-407e-8853-85be3a3d5e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:49:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5d6d9aac-53ca-4abf-8091-1016eaf642ca req-68ce95d0-85c7-4866-9cdc-54caf56f9034 service nova] Lock "d7309eb4-87ef-407e-8853-85be3a3d5e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:49:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5d6d9aac-53ca-4abf-8091-1016eaf642ca req-68ce95d0-85c7-4866-9cdc-54caf56f9034 service nova] Lock "d7309eb4-87ef-407e-8853-85be3a3d5e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:49:55 user nova-compute[72782]: DEBUG nova.compute.manager [req-5d6d9aac-53ca-4abf-8091-1016eaf642ca req-68ce95d0-85c7-4866-9cdc-54caf56f9034 service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] No waiting events found dispatching network-vif-plugged-da3057af-4912-4ac9-800b-42bff16cdecf {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:49:55 user nova-compute[72782]: WARNING nova.compute.manager [req-5d6d9aac-53ca-4abf-8091-1016eaf642ca req-68ce95d0-85c7-4866-9cdc-54caf56f9034 service nova] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Received unexpected event network-vif-plugged-da3057af-4912-4ac9-800b-42bff16cdecf for instance with vm_state active and task_state deleting.
Aug 14 20:49:55 user nova-compute[72782]: INFO nova.compute.manager [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Took 0.77 seconds to detach 1 volumes for instance.
Aug 14 20:49:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Deleting volume: c2ab8f6b-6248-4307-bf55-4a76848b287d {{(pid=72782) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 20:49:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:49:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:49:56 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:49:56 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:49:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:49:56 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Deleted allocations for instance d7309eb4-87ef-407e-8853-85be3a3d5e30
Aug 14 20:49:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-5564ec9c-6bc2-4265-9d2a-92dcc7a50787 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "d7309eb4-87ef-407e-8853-85be3a3d5e30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.190s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:49:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:49:58 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:50:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:50:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:50:08 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692046193.9158213, d7309eb4-87ef-407e-8853-85be3a3d5e30 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:50:08 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] VM Stopped (Lifecycle Event)
Aug 14 20:50:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-b69f5465-a296-4eee-a51a-cad0915b7763 None None] [instance: d7309eb4-87ef-407e-8853-85be3a3d5e30] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:50:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:50:13 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:50:18 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:50:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:50:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:50:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:50:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:50:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:50:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:50:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:50:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:50:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:50:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:50:44 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:50:46 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:50:47 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:50:47 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:50:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:50:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "3af93ab4-1017-45de-94d2-bc7840429fd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:50:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "3af93ab4-1017-45de-94d2-bc7840429fd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:50:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "3af93ab4-1017-45de-94d2-bc7840429fd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:50:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "3af93ab4-1017-45de-94d2-bc7840429fd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:50:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "3af93ab4-1017-45de-94d2-bc7840429fd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:50:48 user nova-compute[72782]: INFO nova.compute.manager [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Terminating instance
Aug 14 20:50:48 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Skipping network cache update for instance because it is being deleted. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-8e74a152-865c-4493-ab0f-3773b94a1396 req-61132a34-4df1-4d85-9632-28eaff37f685 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Received event network-vif-unplugged-3b305230-3723-4cde-92c8-bed3d9dff50e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8e74a152-865c-4493-ab0f-3773b94a1396 req-61132a34-4df1-4d85-9632-28eaff37f685 service nova] Acquiring lock "3af93ab4-1017-45de-94d2-bc7840429fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8e74a152-865c-4493-ab0f-3773b94a1396 req-61132a34-4df1-4d85-9632-28eaff37f685 service nova] Lock "3af93ab4-1017-45de-94d2-bc7840429fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8e74a152-865c-4493-ab0f-3773b94a1396 req-61132a34-4df1-4d85-9632-28eaff37f685 service nova] Lock "3af93ab4-1017-45de-94d2-bc7840429fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-8e74a152-865c-4493-ab0f-3773b94a1396 req-61132a34-4df1-4d85-9632-28eaff37f685 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] No waiting events found dispatching network-vif-unplugged-3b305230-3723-4cde-92c8-bed3d9dff50e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG nova.compute.manager [req-8e74a152-865c-4493-ab0f-3773b94a1396 req-61132a34-4df1-4d85-9632-28eaff37f685 service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Received event network-vif-unplugged-3b305230-3723-4cde-92c8-bed3d9dff50e for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:50:49 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Instance destroyed successfully.
Aug 14 20:50:49 user nova-compute[72782]: DEBUG nova.objects.instance [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lazy-loading 'resources' on Instance uuid 3af93ab4-1017-45de-94d2-bc7840429fd7 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:45:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-315035445',display_name='tempest-TestVolumeBootPattern-volume-backed-server-315035445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-315035445',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMArwLtDFIKkOneh+knhMg4ViXiJEk52Wb05xVyOaMAoGE42Rsmbrlu+rWNERNAtFnw3Q6siH34bxfI5WVvnieiYXe3k/EafKs90tn3i2ef6qCpeI3XpM5wiQ1EiqNEEfQ==',key_name='tempest-keypair-439450554',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:46:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a99378957e94fc6a148b06bcd9123bf',ramdisk_id='',reservation_id='r-i07t2k5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-52337130',owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:46:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2df6ae64c62142cfbedd244de47bdd2a',uuid=3af93ab4-1017-45de-94d2-bc7840429fd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b305230-3723-4cde-92c8-bed3d9dff50e", "address": "fa:16:3e:4d:a5:76", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b305230-37", "ovs_interfaceid": "3b305230-3723-4cde-92c8-bed3d9dff50e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converting VIF {"id": "3b305230-3723-4cde-92c8-bed3d9dff50e", "address": "fa:16:3e:4d:a5:76", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b305230-37", "ovs_interfaceid": "3b305230-3723-4cde-92c8-bed3d9dff50e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:a5:76,bridge_name='br-int',has_traffic_filtering=True,id=3b305230-3723-4cde-92c8-bed3d9dff50e,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b305230-37') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG os_vif [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:a5:76,bridge_name='br-int',has_traffic_filtering=True,id=3b305230-3723-4cde-92c8-bed3d9dff50e,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b305230-37') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b305230-37, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:50:49 user nova-compute[72782]: INFO os_vif [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:a5:76,bridge_name='br-int',has_traffic_filtering=True,id=3b305230-3723-4cde-92c8-bed3d9dff50e,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b305230-37')
Aug 14 20:50:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPbBtmXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:50:49 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bc00e2-2689-46e6-8dda-a8103eb8f4e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[99093c05-e216-4269-9b50-9a4713608c24]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 (non-flash)
Aug 14 20:50:49 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 (non-flash)
Aug 14 20:50:49 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e86ca170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97a8924-22c3-4f89-bdc8-62e28f7cf0dd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0204f325-eaa1-4402-9fd3-5f7e8bd425a0]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7113bd59-e246-4fbb-b197-c502eb18b945]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[80066d93-8526-412a-8da6-18e85b349646]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26333393337663031', '/dev/disk/by-id/scsi-1SCST_BIO4e860bd1-c3937f01b3f1a9ed', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4e860bd1') {{(pid=83776) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee5a069-394f-4c76-bfe5-ede2eea42257]: (4, None) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[478c7e0c-83ad-4b3b-be10-f10a28f3cd9a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:50:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:50:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebd1ffc-26e9-4b42-b855-f9be3454e805]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7, portal: 172.16.0.220,3260]
Aug 14 20:50:50 user nova-compute[72782]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7, portal: 172.16.0.220,3260] successful.
Aug 14 20:50:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:50:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:50:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a4c967-6071-4ed3-8e4e-6ed62f19a4d1]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:50:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] <== disconnect_volume: return (270ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:50:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:50:50 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Deleting instance files /opt/stack/data/nova/instances/3af93ab4-1017-45de-94d2-bc7840429fd7_del
Aug 14 20:50:50 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Deletion of /opt/stack/data/nova/instances/3af93ab4-1017-45de-94d2-bc7840429fd7_del complete
Aug 14 20:50:50 user nova-compute[72782]: INFO nova.compute.manager [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 14 20:50:50 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:50:50 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:50:50 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:50:51 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:50:51 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Took 1.33 seconds to deallocate network for instance.
Aug 14 20:50:51 user nova-compute[72782]: DEBUG nova.compute.manager [req-342d15a9-d887-4f90-8257-6b80969bacf4 req-004df486-a3db-4d5c-990d-c600d53c431e service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Received event network-vif-plugged-3b305230-3723-4cde-92c8-bed3d9dff50e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:50:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-342d15a9-d887-4f90-8257-6b80969bacf4 req-004df486-a3db-4d5c-990d-c600d53c431e service nova] Acquiring lock "3af93ab4-1017-45de-94d2-bc7840429fd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:50:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-342d15a9-d887-4f90-8257-6b80969bacf4 req-004df486-a3db-4d5c-990d-c600d53c431e service nova] Lock "3af93ab4-1017-45de-94d2-bc7840429fd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:50:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-342d15a9-d887-4f90-8257-6b80969bacf4 req-004df486-a3db-4d5c-990d-c600d53c431e service nova] Lock "3af93ab4-1017-45de-94d2-bc7840429fd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:50:51 user nova-compute[72782]: DEBUG nova.compute.manager [req-342d15a9-d887-4f90-8257-6b80969bacf4 req-004df486-a3db-4d5c-990d-c600d53c431e service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] No waiting events found dispatching network-vif-plugged-3b305230-3723-4cde-92c8-bed3d9dff50e {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:50:51 user nova-compute[72782]: WARNING nova.compute.manager [req-342d15a9-d887-4f90-8257-6b80969bacf4 req-004df486-a3db-4d5c-990d-c600d53c431e service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Received unexpected event network-vif-plugged-3b305230-3723-4cde-92c8-bed3d9dff50e for instance with vm_state active and task_state deleting.
Aug 14 20:50:51 user nova-compute[72782]: DEBUG nova.compute.manager [req-342d15a9-d887-4f90-8257-6b80969bacf4 req-004df486-a3db-4d5c-990d-c600d53c431e service nova] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Received event network-vif-deleted-3b305230-3723-4cde-92c8-bed3d9dff50e {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:50:52 user nova-compute[72782]: INFO nova.compute.manager [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Took 0.72 seconds to detach 1 volumes for instance.
Aug 14 20:50:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Deleting volume: 20d6edff-3eaa-4cb3-9ca1-2efce610f5d7 {{(pid=72782) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 20:50:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:50:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:50:52 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:50:52 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:50:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:50:52 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Deleted allocations for instance 3af93ab4-1017-45de-94d2-bc7840429fd7
Aug 14 20:50:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-a2c84a15-81d4-4633-a3b5-2db9c536d3da tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "3af93ab4-1017-45de-94d2-bc7840429fd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.506s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:50:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:50:53 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:50:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:50:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:50:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:50:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:50:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:50:53 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:50:53 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:50:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8858MB free_disk=25.27515411376953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:50:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:50:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:50:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:50:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:50:53 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:50:53 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:50:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:50:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:50:54 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:50:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:50:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:50:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:51:04 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692046249.7282534, 3af93ab4-1017-45de-94d2-bc7840429fd7 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:51:04 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] VM Stopped (Lifecycle Event)
Aug 14 20:51:04 user nova-compute[72782]: DEBUG nova.compute.manager [None req-2313273d-865c-4a6d-8959-945ad5c977fe None None] [instance: 3af93ab4-1017-45de-94d2-bc7840429fd7] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:51:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:51:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:51:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:51:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:51:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:51:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:51:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:51:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:51:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:51:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:51:46 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:51:46 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:51:47 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:51:49 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:51:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:51:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:51:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:51:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:51:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:51:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:51:50 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:51:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:51:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:51:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 20:51:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:51:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:51:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:51:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:51:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:51:51 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:51:51 user nova-compute[72782]: INFO nova.compute.claims [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Claim successful on node user
Aug 14 20:51:52 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Refreshing inventories for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Updating ProviderTree inventory for provider d26c9e3b-40e6-476e-9664-3119ebf5873b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Refreshing aggregate associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, aggregates: None {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Refreshing trait associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG nova.network.neutron [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:51:52 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:51:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:51:52 user nova-compute[72782]: INFO nova.virt.block_device [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Booting with volume b4445c40-96a5-427c-9189-d47cd296b95b at /dev/vda
Aug 14 20:51:52 user nova-compute[72782]: DEBUG nova.policy [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2df6ae64c62142cfbedd244de47bdd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a99378957e94fc6a148b06bcd9123bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG os_brick.utils [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a38cb3b-7d60-4de5-ac1c-4b7c8c04c158]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b95cf78-5d12-4d24-a53c-940d75e5e7b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[55761801-6841-401b-a9c5-b29acda31c86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ebdd00-c2d6-453f-b881-190670c5dad6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:51:52 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:51:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6f7bf4-3d1f-4e65-b9d8-2780a5752c3e]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG os_brick.utils [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:51:52 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Updating existing volume attachment record: af10e1b9-3bc2-4acd-9710-f4974e7c851f {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG nova.network.neutron [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Successfully created port: 79b2fc91-bad6-408c-b7e3-ba7347b36ee8 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:51:53 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:51:53 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:51:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8869MB free_disk=25.273841857910156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 622c7d21-9262-44b2-801a-81b6a7e8a6f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG nova.network.neutron [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Successfully updated port: 79b2fc91-bad6-408c-b7e3-ba7347b36ee8 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "refresh_cache-622c7d21-9262-44b2-801a-81b6a7e8a6f8" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquired lock "refresh_cache-622c7d21-9262-44b2-801a-81b6a7e8a6f8" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG nova.network.neutron [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG nova.compute.manager [req-f35c9e65-6c9d-4d4c-9fb2-84a08ceb3778 req-9de49389-6828-4391-ac44-dd4292632720 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Received event network-changed-79b2fc91-bad6-408c-b7e3-ba7347b36ee8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG nova.compute.manager [req-f35c9e65-6c9d-4d4c-9fb2-84a08ceb3778 req-9de49389-6828-4391-ac44-dd4292632720 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Refreshing instance network info cache due to event network-changed-79b2fc91-bad6-408c-b7e3-ba7347b36ee8. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f35c9e65-6c9d-4d4c-9fb2-84a08ceb3778 req-9de49389-6828-4391-ac44-dd4292632720 service nova] Acquiring lock "refresh_cache-622c7d21-9262-44b2-801a-81b6a7e8a6f8" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:51:53 user nova-compute[72782]: DEBUG nova.network.neutron [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:51:54 user nova-compute[72782]: DEBUG nova.network.neutron [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Updating instance_info_cache with network_info: [{"id": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "address": "fa:16:3e:75:bf:e8", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2fc91-ba", "ovs_interfaceid": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:51:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Releasing lock "refresh_cache-622c7d21-9262-44b2-801a-81b6a7e8a6f8" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:51:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Instance network_info: |[{"id": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "address": "fa:16:3e:75:bf:e8", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2fc91-ba", "ovs_interfaceid": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:51:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f35c9e65-6c9d-4d4c-9fb2-84a08ceb3778 req-9de49389-6828-4391-ac44-dd4292632720 service nova] Acquired lock "refresh_cache-622c7d21-9262-44b2-801a-81b6a7e8a6f8" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:51:54 user nova-compute[72782]: DEBUG nova.network.neutron [req-f35c9e65-6c9d-4d4c-9fb2-84a08ceb3778 req-9de49389-6828-4391-ac44-dd4292632720 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Refreshing network info cache for port 79b2fc91-bad6-408c-b7e3-ba7347b36ee8 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:51:54 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:51:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:51:54 user nova-compute[72782]: DEBUG nova.network.neutron [req-f35c9e65-6c9d-4d4c-9fb2-84a08ceb3778 req-9de49389-6828-4391-ac44-dd4292632720 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Updated VIF entry in instance network info cache for port 79b2fc91-bad6-408c-b7e3-ba7347b36ee8. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:51:54 user nova-compute[72782]: DEBUG nova.network.neutron [req-f35c9e65-6c9d-4d4c-9fb2-84a08ceb3778 req-9de49389-6828-4391-ac44-dd4292632720 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Updating instance_info_cache with network_info: [{"id": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "address": "fa:16:3e:75:bf:e8", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2fc91-ba", "ovs_interfaceid": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:51:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f35c9e65-6c9d-4d4c-9fb2-84a08ceb3778 req-9de49389-6828-4391-ac44-dd4292632720 service nova] Releasing lock "refresh_cache-622c7d21-9262-44b2-801a-81b6a7e8a6f8" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:51:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:51:56 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:51:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:51:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:52:00 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Creating image(s)
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Did not create local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Ensure instance console log exists: /opt/stack/data/nova/instances/622c7d21-9262-44b2-801a-81b6a7e8a6f8/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Start _get_guest_xml network_info=[{"id": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "address": "fa:16:3e:75:bf:e8", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2fc91-ba", "ovs_interfaceid": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': 'af10e1b9-3bc2-4acd-9710-f4974e7c851f', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQkEUuFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '622c7d21-9262-44b2-801a-81b6a7e8a6f8', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4445c40-96a5-427c-9189-d47cd296b95b', 'serial': 'b4445c40-96a5-427c-9189-d47cd296b95b'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:52:00 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:52:00 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQkEUuFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:52:00 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:52:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:52:00 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:52:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:52:00 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a91aeb-cb6f-4bc3-af13-10bbb2607a45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:52:00 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5954018-6132-4251-89f1-7afae48d7982]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b] added
Aug 14 20:52:00 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e717e2ac-2aef-4c8d-807d-ca202dc33c47]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec7ac8c-9ddf-4b47-b8ff-efbab8be6475]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQkEUuFX {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQkEUuFX" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[30725516-5314-4668-8998-ae5a81a26b70]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dQkEUuFX'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:52:00 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f8c971-16ad-4b21-ada4-3597d3c8f370]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] There are 0 instances to clean {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebb1304-8b0b-4288-bd8a-c88c70b03084]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:52:01 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:52:01 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:52:01 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 20:52:01 user nova-compute[72782]: 
Aug 14 20:52:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f24b21-47e8-4f37-bf05-512dc241d31c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b, portal: 172.16.0.220,3260]
Aug 14 20:52:01 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b, portal: 172.16.0.220,3260] successful.
Aug 14 20:52:01 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b507b5a6-f4f4-4b78-b986-69b5b2d18cef]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9e3a18-e631-4dbb-b253-c13e6c5ac256]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)
Aug 14 20:52:01 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)
Aug 14 20:52:01 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9100c2de-82cf-459d-a0a0-b8fb589db17d]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:52:01 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQkEUuFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26138313864643464', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138313864643464', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1606713498',display_name='tempest-TestVolumeBootPattern-server-1606713498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1606713498',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3lDqNRM0dgyXsRQEWkWhJp1ZKddVfimacQxE2mNea9hU/c/Nvj3bT6VAIc+GOPx3eIlv853bKj9DkYcpchR/+fmz+870Kb1UY4vB0T5Az8VE5eoCMc0Dx35KUzi5xHNw==',key_name='tempest-TestVolumeBootPattern-1143441036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a99378957e94fc6a148b06bcd9123bf',ramdisk_id='',reservation_id='r-zm687iq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-52337130',owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:51:52Z,user_data=None,user_id='2df6ae64c62142cfbedd244de47bdd2a',uuid=622c7d21-9262-44b2-801a-81b6a7e8a6f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "address": "fa:16:3e:75:bf:e8", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2fc91-ba", "ovs_interfaceid": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converting VIF {"id": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "address": "fa:16:3e:75:bf:e8", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2fc91-ba", "ovs_interfaceid": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:bf:e8,bridge_name='br-int',has_traffic_filtering=True,id=79b2fc91-bad6-408c-b7e3-ba7347b36ee8,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b2fc91-ba') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG nova.objects.instance [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lazy-loading 'pci_devices' on Instance uuid 622c7d21-9262-44b2-801a-81b6a7e8a6f8 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:52:02 user nova-compute[72782]:   <uuid>622c7d21-9262-44b2-801a-81b6a7e8a6f8</uuid>
Aug 14 20:52:02 user nova-compute[72782]:   <name>instance-00000032</name>
Aug 14 20:52:02 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:52:02 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:52:02 user nova-compute[72782]:   <metadata>
Aug 14 20:52:02 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:52:02 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:52:02 user nova-compute[72782]:       <nova:name>tempest-TestVolumeBootPattern-server-1606713498</nova:name>
Aug 14 20:52:02 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:52:00</nova:creationTime>
Aug 14 20:52:02 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:52:02 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:52:02 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:52:02 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:52:02 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:52:02 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:52:02 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:52:02 user nova-compute[72782]:       <nova:owner>
Aug 14 20:52:02 user nova-compute[72782]:         <nova:user uuid="2df6ae64c62142cfbedd244de47bdd2a">tempest-TestVolumeBootPattern-52337130-project-member</nova:user>
Aug 14 20:52:02 user nova-compute[72782]:         <nova:project uuid="0a99378957e94fc6a148b06bcd9123bf">tempest-TestVolumeBootPattern-52337130</nova:project>
Aug 14 20:52:02 user nova-compute[72782]:       </nova:owner>
Aug 14 20:52:02 user nova-compute[72782]:       <nova:ports>
Aug 14 20:52:02 user nova-compute[72782]:         <nova:port uuid="79b2fc91-bad6-408c-b7e3-ba7347b36ee8">
Aug 14 20:52:02 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 20:52:02 user nova-compute[72782]:         </nova:port>
Aug 14 20:52:02 user nova-compute[72782]:       </nova:ports>
Aug 14 20:52:02 user nova-compute[72782]:     </nova:instance>
Aug 14 20:52:02 user nova-compute[72782]:   </metadata>
Aug 14 20:52:02 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:52:02 user nova-compute[72782]:     <system>
Aug 14 20:52:02 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:52:02 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:52:02 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:52:02 user nova-compute[72782]:       <entry name="serial">622c7d21-9262-44b2-801a-81b6a7e8a6f8</entry>
Aug 14 20:52:02 user nova-compute[72782]:       <entry name="uuid">622c7d21-9262-44b2-801a-81b6a7e8a6f8</entry>
Aug 14 20:52:02 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:52:02 user nova-compute[72782]:     </system>
Aug 14 20:52:02 user nova-compute[72782]:   </sysinfo>
Aug 14 20:52:02 user nova-compute[72782]:   <os>
Aug 14 20:52:02 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:52:02 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:52:02 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:52:02 user nova-compute[72782]:   </os>
Aug 14 20:52:02 user nova-compute[72782]:   <features>
Aug 14 20:52:02 user nova-compute[72782]:     <acpi/>
Aug 14 20:52:02 user nova-compute[72782]:     <apic/>
Aug 14 20:52:02 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:52:02 user nova-compute[72782]:   </features>
Aug 14 20:52:02 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:52:02 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:52:02 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:52:02 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:52:02 user nova-compute[72782]:   </clock>
Aug 14 20:52:02 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:52:02 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:52:02 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:52:02 user nova-compute[72782]:   </cpu>
Aug 14 20:52:02 user nova-compute[72782]:   <devices>
Aug 14 20:52:02 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 20:52:02 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:52:02 user nova-compute[72782]:       <source dev="/dev/sdb"/>
Aug 14 20:52:02 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:52:02 user nova-compute[72782]:       <serial>b4445c40-96a5-427c-9189-d47cd296b95b</serial>
Aug 14 20:52:02 user nova-compute[72782]:     </disk>
Aug 14 20:52:02 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:52:02 user nova-compute[72782]:       <mac address="fa:16:3e:75:bf:e8"/>
Aug 14 20:52:02 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:52:02 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:52:02 user nova-compute[72782]:       <target dev="tap79b2fc91-ba"/>
Aug 14 20:52:02 user nova-compute[72782]:     </interface>
Aug 14 20:52:02 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:52:02 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/622c7d21-9262-44b2-801a-81b6a7e8a6f8/console.log" append="off"/>
Aug 14 20:52:02 user nova-compute[72782]:     </serial>
Aug 14 20:52:02 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:52:02 user nova-compute[72782]:     <video>
Aug 14 20:52:02 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:52:02 user nova-compute[72782]:     </video>
Aug 14 20:52:02 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:52:02 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:52:02 user nova-compute[72782]:     </rng>
Aug 14 20:52:02 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:52:02 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:52:02 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:52:02 user nova-compute[72782]:     </memballoon>
Aug 14 20:52:02 user nova-compute[72782]:   </devices>
Aug 14 20:52:02 user nova-compute[72782]: </domain>
Aug 14 20:52:02 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1606713498',display_name='tempest-TestVolumeBootPattern-server-1606713498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1606713498',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3lDqNRM0dgyXsRQEWkWhJp1ZKddVfimacQxE2mNea9hU/c/Nvj3bT6VAIc+GOPx3eIlv853bKj9DkYcpchR/+fmz+870Kb1UY4vB0T5Az8VE5eoCMc0Dx35KUzi5xHNw==',key_name='tempest-TestVolumeBootPattern-1143441036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a99378957e94fc6a148b06bcd9123bf',ramdisk_id='',reservation_id='r-zm687iq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-52337130',owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:51:52Z,user_data=None,user_id='2df6ae64c62142cfbedd244de47bdd2a',uuid=622c7d21-9262-44b2-801a-81b6a7e8a6f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "address": "fa:16:3e:75:bf:e8", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2fc91-ba", "ovs_interfaceid": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converting VIF {"id": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "address": "fa:16:3e:75:bf:e8", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2fc91-ba", "ovs_interfaceid": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:bf:e8,bridge_name='br-int',has_traffic_filtering=True,id=79b2fc91-bad6-408c-b7e3-ba7347b36ee8,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b2fc91-ba') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG os_vif [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:bf:e8,bridge_name='br-int',has_traffic_filtering=True,id=79b2fc91-bad6-408c-b7e3-ba7347b36ee8,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b2fc91-ba') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79b2fc91-ba, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap79b2fc91-ba, col_values=(('external_ids', {'iface-id': '79b2fc91-bad6-408c-b7e3-ba7347b36ee8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:bf:e8', 'vm-uuid': '622c7d21-9262-44b2-801a-81b6a7e8a6f8'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:02 user nova-compute[72782]: INFO os_vif [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:bf:e8,bridge_name='br-int',has_traffic_filtering=True,id=79b2fc91-bad6-408c-b7e3-ba7347b36ee8,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b2fc91-ba')
Aug 14 20:52:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:52:02 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] No VIF found with MAC fa:16:3e:75:bf:e8, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:52:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:03 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-7dd207f6-3a38-4b8c-bd9f-a061cf5fcf7e req-fbadb0cd-59b8-4bb8-be3e-c6690c482014 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Received event network-vif-plugged-79b2fc91-bad6-408c-b7e3-ba7347b36ee8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:52:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7dd207f6-3a38-4b8c-bd9f-a061cf5fcf7e req-fbadb0cd-59b8-4bb8-be3e-c6690c482014 service nova] Acquiring lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:52:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7dd207f6-3a38-4b8c-bd9f-a061cf5fcf7e req-fbadb0cd-59b8-4bb8-be3e-c6690c482014 service nova] Lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:52:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-7dd207f6-3a38-4b8c-bd9f-a061cf5fcf7e req-fbadb0cd-59b8-4bb8-be3e-c6690c482014 service nova] Lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:52:03 user nova-compute[72782]: DEBUG nova.compute.manager [req-7dd207f6-3a38-4b8c-bd9f-a061cf5fcf7e req-fbadb0cd-59b8-4bb8-be3e-c6690c482014 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] No waiting events found dispatching network-vif-plugged-79b2fc91-bad6-408c-b7e3-ba7347b36ee8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:52:03 user nova-compute[72782]: WARNING nova.compute.manager [req-7dd207f6-3a38-4b8c-bd9f-a061cf5fcf7e req-fbadb0cd-59b8-4bb8-be3e-c6690c482014 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Received unexpected event network-vif-plugged-79b2fc91-bad6-408c-b7e3-ba7347b36ee8 for instance with vm_state building and task_state spawning.
Aug 14 20:52:04 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:52:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:05 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692046325.6644583, 622c7d21-9262-44b2-801a-81b6a7e8a6f8 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:52:05 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] VM Resumed (Lifecycle Event)
Aug 14 20:52:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:52:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:52:05 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Instance spawned successfully.
Aug 14 20:52:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:52:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:52:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:52:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:52:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:52:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:52:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:52:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:52:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:52:05 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:52:05 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692046325.666251, 622c7d21-9262-44b2-801a-81b6a7e8a6f8 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:52:05 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] VM Started (Lifecycle Event)
Aug 14 20:52:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:52:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:52:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-4740932a-ad12-4d83-b102-61a2efd38bce req-8fe3c09b-c783-424a-9064-86887458a44f service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Received event network-vif-plugged-79b2fc91-bad6-408c-b7e3-ba7347b36ee8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:52:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4740932a-ad12-4d83-b102-61a2efd38bce req-8fe3c09b-c783-424a-9064-86887458a44f service nova] Acquiring lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:52:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4740932a-ad12-4d83-b102-61a2efd38bce req-8fe3c09b-c783-424a-9064-86887458a44f service nova] Lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:52:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4740932a-ad12-4d83-b102-61a2efd38bce req-8fe3c09b-c783-424a-9064-86887458a44f service nova] Lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:52:05 user nova-compute[72782]: DEBUG nova.compute.manager [req-4740932a-ad12-4d83-b102-61a2efd38bce req-8fe3c09b-c783-424a-9064-86887458a44f service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] No waiting events found dispatching network-vif-plugged-79b2fc91-bad6-408c-b7e3-ba7347b36ee8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:52:05 user nova-compute[72782]: WARNING nova.compute.manager [req-4740932a-ad12-4d83-b102-61a2efd38bce req-8fe3c09b-c783-424a-9064-86887458a44f service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Received unexpected event network-vif-plugged-79b2fc91-bad6-408c-b7e3-ba7347b36ee8 for instance with vm_state building and task_state spawning.
Aug 14 20:52:05 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:52:05 user nova-compute[72782]: INFO nova.compute.manager [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Took 4.97 seconds to spawn the instance on the hypervisor.
Aug 14 20:52:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:52:05 user nova-compute[72782]: INFO nova.compute.manager [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Took 13.97 seconds to build instance.
Aug 14 20:52:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f4fcd341-5577-4cb6-b1c7-8133b30e5e9b tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.098s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:52:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:08 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:09 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:52:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:52:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:52:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:52:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:52:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:23 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:28 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:33 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:35 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:52:35 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid 622c7d21-9262-44b2-801a-81b6a7e8a6f8 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 20:52:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:52:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:52:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:52:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:46 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:52:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:48 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:52:49 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:52:49 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:52:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72782) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 20:52:50 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:52:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:52:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:52:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-622c7d21-9262-44b2-801a-81b6a7e8a6f8" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:52:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-622c7d21-9262-44b2-801a-81b6a7e8a6f8" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:52:50 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:52:50 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 622c7d21-9262-44b2-801a-81b6a7e8a6f8 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:52:50 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Updating instance_info_cache with network_info: [{"id": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "address": "fa:16:3e:75:bf:e8", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2fc91-ba", "ovs_interfaceid": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:52:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-622c7d21-9262-44b2-801a-81b6a7e8a6f8" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:52:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:52:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:52:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:52:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:52:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:52:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:52:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:52:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:52:53 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:52:53 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:52:53 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:52:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8759MB free_disk=25.26457977294922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:52:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:52:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:52:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 622c7d21-9262-44b2-801a-81b6a7e8a6f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:52:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:52:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:52:53 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:52:53 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:52:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:52:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:52:56 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:52:56 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:52:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:52:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:52:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:52:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:52:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:52:57 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:52:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:53:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:53:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:53:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:53:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:53:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:53:02 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:53:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:53:12 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:53:17 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:53:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:53:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:53:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:53:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:53:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:53:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:53:44 user nova-compute[72782]: DEBUG nova.compute.manager [req-2ccdcdd9-74e8-402f-8714-ea1517002611 req-a3252a27-0b92-462e-aed0-2d72a9a6a328 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Received event network-changed-79b2fc91-bad6-408c-b7e3-ba7347b36ee8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:53:44 user nova-compute[72782]: DEBUG nova.compute.manager [req-2ccdcdd9-74e8-402f-8714-ea1517002611 req-a3252a27-0b92-462e-aed0-2d72a9a6a328 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Refreshing instance network info cache due to event network-changed-79b2fc91-bad6-408c-b7e3-ba7347b36ee8. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2ccdcdd9-74e8-402f-8714-ea1517002611 req-a3252a27-0b92-462e-aed0-2d72a9a6a328 service nova] Acquiring lock "refresh_cache-622c7d21-9262-44b2-801a-81b6a7e8a6f8" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2ccdcdd9-74e8-402f-8714-ea1517002611 req-a3252a27-0b92-462e-aed0-2d72a9a6a328 service nova] Acquired lock "refresh_cache-622c7d21-9262-44b2-801a-81b6a7e8a6f8" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:53:44 user nova-compute[72782]: DEBUG nova.network.neutron [req-2ccdcdd9-74e8-402f-8714-ea1517002611 req-a3252a27-0b92-462e-aed0-2d72a9a6a328 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Refreshing network info cache for port 79b2fc91-bad6-408c-b7e3-ba7347b36ee8 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:53:44 user nova-compute[72782]: INFO nova.compute.manager [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Terminating instance
Aug 14 20:53:44 user nova-compute[72782]: DEBUG nova.compute.manager [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:53:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:53:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:53:44 user nova-compute[72782]: DEBUG nova.network.neutron [req-2ccdcdd9-74e8-402f-8714-ea1517002611 req-a3252a27-0b92-462e-aed0-2d72a9a6a328 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Updated VIF entry in instance network info cache for port 79b2fc91-bad6-408c-b7e3-ba7347b36ee8. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:53:44 user nova-compute[72782]: DEBUG nova.network.neutron [req-2ccdcdd9-74e8-402f-8714-ea1517002611 req-a3252a27-0b92-462e-aed0-2d72a9a6a328 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Updating instance_info_cache with network_info: [{"id": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "address": "fa:16:3e:75:bf:e8", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2fc91-ba", "ovs_interfaceid": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:53:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:53:44 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-2ccdcdd9-74e8-402f-8714-ea1517002611 req-a3252a27-0b92-462e-aed0-2d72a9a6a328 service nova] Releasing lock "refresh_cache-622c7d21-9262-44b2-801a-81b6a7e8a6f8" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:53:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:53:45 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Instance destroyed successfully.
Aug 14 20:53:45 user nova-compute[72782]: DEBUG nova.objects.instance [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lazy-loading 'resources' on Instance uuid 622c7d21-9262-44b2-801a-81b6a7e8a6f8 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1606713498',display_name='tempest-TestVolumeBootPattern-server-1606713498',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1606713498',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3lDqNRM0dgyXsRQEWkWhJp1ZKddVfimacQxE2mNea9hU/c/Nvj3bT6VAIc+GOPx3eIlv853bKj9DkYcpchR/+fmz+870Kb1UY4vB0T5Az8VE5eoCMc0Dx35KUzi5xHNw==',key_name='tempest-TestVolumeBootPattern-1143441036',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:52:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a99378957e94fc6a148b06bcd9123bf',ramdisk_id='',reservation_id='r-zm687iq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-52337130',owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:52:06Z,user_data=None,user_id='2df6ae64c62142cfbedd244de47bdd2a',uuid=622c7d21-9262-44b2-801a-81b6a7e8a6f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "address": "fa:16:3e:75:bf:e8", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2fc91-ba", "ovs_interfaceid": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converting VIF {"id": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "address": "fa:16:3e:75:bf:e8", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2fc91-ba", "ovs_interfaceid": "79b2fc91-bad6-408c-b7e3-ba7347b36ee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:bf:e8,bridge_name='br-int',has_traffic_filtering=True,id=79b2fc91-bad6-408c-b7e3-ba7347b36ee8,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b2fc91-ba') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_vif [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:bf:e8,bridge_name='br-int',has_traffic_filtering=True,id=79b2fc91-bad6-408c-b7e3-ba7347b36ee8,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b2fc91-ba') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79b2fc91-ba, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:53:45 user nova-compute[72782]: INFO os_vif [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:bf:e8,bridge_name='br-int',has_traffic_filtering=True,id=79b2fc91-bad6-408c-b7e3-ba7347b36ee8,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b2fc91-ba')
Aug 14 20:53:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQkEUuFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:53:45 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6b5175-f83a-48fc-b68f-282053d8eb46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[036f6778-0610-4827-9863-3b20dcfaca27]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)
Aug 14 20:53:45 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)
Aug 14 20:53:45 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f64084e0700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dc66e4-16c3-4dd6-9e1e-0bd9026324eb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3432986e-453f-4c68-af3b-e9192ad792fb]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c939704-9a3b-4421-8bf2-dfbb96024a53]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[692a0c4f-4293-4205-9ba0-af5bfb526d62]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26138313864643464', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_583133d6', '/dev/disk/by-id/scsi-1SCST_BIO583133d6-a818dd4dd49b13e8') {{(pid=83776) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e732fb-5521-4da0-8e98-310fb334a714]: (4, None) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2064a3e7-609a-4bbe-9c43-b465fb509f56]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[515e42e0-3d56-4549-a5f2-b18b0246d9e6]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b, portal: 172.16.0.220,3260]
Aug 14 20:53:45 user nova-compute[72782]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b, portal: 172.16.0.220,3260] successful.
Aug 14 20:53:45 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba79c2e-23da-47fc-8ee4-801553a2b36c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.248s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] <== disconnect_volume: return (249ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:53:45 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Deleting instance files /opt/stack/data/nova/instances/622c7d21-9262-44b2-801a-81b6a7e8a6f8_del
Aug 14 20:53:45 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Deletion of /opt/stack/data/nova/instances/622c7d21-9262-44b2-801a-81b6a7e8a6f8_del complete
Aug 14 20:53:45 user nova-compute[72782]: INFO nova.compute.manager [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Took 1.07 seconds to destroy the instance on the hypervisor.
Aug 14 20:53:45 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:53:45 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:53:46 user nova-compute[72782]: DEBUG nova.compute.manager [req-647a9e0c-d692-4cf1-aa9b-80d73eff457f req-e2cb4e2f-6cf2-4729-9f1f-7f4eca386484 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Received event network-vif-unplugged-79b2fc91-bad6-408c-b7e3-ba7347b36ee8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:53:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-647a9e0c-d692-4cf1-aa9b-80d73eff457f req-e2cb4e2f-6cf2-4729-9f1f-7f4eca386484 service nova] Acquiring lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:53:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-647a9e0c-d692-4cf1-aa9b-80d73eff457f req-e2cb4e2f-6cf2-4729-9f1f-7f4eca386484 service nova] Lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:53:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-647a9e0c-d692-4cf1-aa9b-80d73eff457f req-e2cb4e2f-6cf2-4729-9f1f-7f4eca386484 service nova] Lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:53:46 user nova-compute[72782]: DEBUG nova.compute.manager [req-647a9e0c-d692-4cf1-aa9b-80d73eff457f req-e2cb4e2f-6cf2-4729-9f1f-7f4eca386484 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] No waiting events found dispatching network-vif-unplugged-79b2fc91-bad6-408c-b7e3-ba7347b36ee8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:53:46 user nova-compute[72782]: DEBUG nova.compute.manager [req-647a9e0c-d692-4cf1-aa9b-80d73eff457f req-e2cb4e2f-6cf2-4729-9f1f-7f4eca386484 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Received event network-vif-unplugged-79b2fc91-bad6-408c-b7e3-ba7347b36ee8 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:53:46 user nova-compute[72782]: DEBUG nova.compute.manager [req-647a9e0c-d692-4cf1-aa9b-80d73eff457f req-e2cb4e2f-6cf2-4729-9f1f-7f4eca386484 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Received event network-vif-plugged-79b2fc91-bad6-408c-b7e3-ba7347b36ee8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:53:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-647a9e0c-d692-4cf1-aa9b-80d73eff457f req-e2cb4e2f-6cf2-4729-9f1f-7f4eca386484 service nova] Acquiring lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:53:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-647a9e0c-d692-4cf1-aa9b-80d73eff457f req-e2cb4e2f-6cf2-4729-9f1f-7f4eca386484 service nova] Lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:53:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-647a9e0c-d692-4cf1-aa9b-80d73eff457f req-e2cb4e2f-6cf2-4729-9f1f-7f4eca386484 service nova] Lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:53:46 user nova-compute[72782]: DEBUG nova.compute.manager [req-647a9e0c-d692-4cf1-aa9b-80d73eff457f req-e2cb4e2f-6cf2-4729-9f1f-7f4eca386484 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] No waiting events found dispatching network-vif-plugged-79b2fc91-bad6-408c-b7e3-ba7347b36ee8 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:53:46 user nova-compute[72782]: WARNING nova.compute.manager [req-647a9e0c-d692-4cf1-aa9b-80d73eff457f req-e2cb4e2f-6cf2-4729-9f1f-7f4eca386484 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Received unexpected event network-vif-plugged-79b2fc91-bad6-408c-b7e3-ba7347b36ee8 for instance with vm_state active and task_state deleting.
Aug 14 20:53:46 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:53:46 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Took 0.76 seconds to deallocate network for instance.
Aug 14 20:53:46 user nova-compute[72782]: DEBUG nova.compute.manager [req-76d6a616-160d-42bf-9d4d-c52a835ff43b req-406a2e58-97d3-49d1-97a4-b1e1b2528067 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Received event network-vif-deleted-79b2fc91-bad6-408c-b7e3-ba7347b36ee8 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:53:46 user nova-compute[72782]: INFO nova.compute.manager [req-76d6a616-160d-42bf-9d4d-c52a835ff43b req-406a2e58-97d3-49d1-97a4-b1e1b2528067 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Neutron deleted interface 79b2fc91-bad6-408c-b7e3-ba7347b36ee8; detaching it from the instance and deleting it from the info cache
Aug 14 20:53:46 user nova-compute[72782]: DEBUG nova.network.neutron [req-76d6a616-160d-42bf-9d4d-c52a835ff43b req-406a2e58-97d3-49d1-97a4-b1e1b2528067 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:53:46 user nova-compute[72782]: DEBUG nova.compute.manager [req-76d6a616-160d-42bf-9d4d-c52a835ff43b req-406a2e58-97d3-49d1-97a4-b1e1b2528067 service nova] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Detach interface failed, port_id=79b2fc91-bad6-408c-b7e3-ba7347b36ee8, reason: Instance 622c7d21-9262-44b2-801a-81b6a7e8a6f8 could not be found. {{(pid=72782) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 20:53:47 user nova-compute[72782]: INFO nova.compute.manager [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Took 0.77 seconds to detach 1 volumes for instance.
Aug 14 20:53:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:53:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:53:47 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:53:47 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:53:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:53:47 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Deleted allocations for instance 622c7d21-9262-44b2-801a-81b6a7e8a6f8
Aug 14 20:53:47 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ddb15e35-b6d6-44d8-aa7e-ae488a7dce53 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "622c7d21-9262-44b2-801a-81b6a7e8a6f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.905s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:53:48 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:53:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:53:49 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:53:49 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:53:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:53:52 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:53:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:53:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:53:52 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 20:53:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:53:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:53:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:53:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:53:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:53:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:53:53 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:53:53 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:53:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8855MB free_disk=25.263748168945312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:53:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:53:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:53:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:53:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:53:53 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:53:53 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:53:53 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:53:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:53:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:53:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:53:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:53:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:53:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:54:00 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692046425.3812375, 622c7d21-9262-44b2-801a-81b6a7e8a6f8 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:54:00 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] VM Stopped (Lifecycle Event)
Aug 14 20:54:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-ed1ff8fe-c065-420d-a5ce-899adc12e57c None None] [instance: 622c7d21-9262-44b2-801a-81b6a7e8a6f8] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:54:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:54:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:54:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:54:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:54:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:54:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:54:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:54:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:54:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:54:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "283d9889-b930-48bd-b053-d015d24cdd0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:54:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "283d9889-b930-48bd-b053-d015d24cdd0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:54:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:54:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:54:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:54:36 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:54:36 user nova-compute[72782]: INFO nova.compute.claims [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Claim successful on node user
Aug 14 20:54:36 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:54:36 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:54:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.174s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:54:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:54:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:54:36 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:54:36 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:54:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:54:36 user nova-compute[72782]: DEBUG nova.policy [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2df6ae64c62142cfbedd244de47bdd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a99378957e94fc6a148b06bcd9123bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:54:36 user nova-compute[72782]: INFO nova.virt.block_device [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Booting with volume b4445c40-96a5-427c-9189-d47cd296b95b at /dev/vda
Aug 14 20:54:37 user nova-compute[72782]: DEBUG os_brick.utils [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93867f8-0e01-499f-b074-0cb63232cef3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[174e82b4-4dbe-4383-8486-49044d3ddab9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca348bf-a66e-4925-821c-344b49c0b83a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6ef7a0-141e-4727-8084-6a79b3844ceb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:54:37 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:54:37 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c636b1-bc3a-4dc8-8f79-9c059368c2c5]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG os_brick.utils [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Updating existing volume attachment record: 3588d298-89e5-4b8b-a28b-76972d04239d {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:54:37 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Successfully created port: 7f8a9fd6-607b-48b2-be15-e45fe1c3654d {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:54:38 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Successfully updated port: 7f8a9fd6-607b-48b2-be15-e45fe1c3654d {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:54:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:54:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquired lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:54:38 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:54:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-f062d471-d758-4170-8a72-acf64914991b req-360c7109-3894-441d-ac2e-3854a953a695 service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Received event network-changed-7f8a9fd6-607b-48b2-be15-e45fe1c3654d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:54:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-f062d471-d758-4170-8a72-acf64914991b req-360c7109-3894-441d-ac2e-3854a953a695 service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Refreshing instance network info cache due to event network-changed-7f8a9fd6-607b-48b2-be15-e45fe1c3654d. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:54:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f062d471-d758-4170-8a72-acf64914991b req-360c7109-3894-441d-ac2e-3854a953a695 service nova] Acquiring lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:54:38 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:54:39 user nova-compute[72782]: DEBUG nova.network.neutron [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Updating instance_info_cache with network_info: [{"id": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "address": "fa:16:3e:55:87:5a", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8a9fd6-60", "ovs_interfaceid": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Releasing lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:54:39 user nova-compute[72782]: DEBUG nova.compute.manager [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Instance network_info: |[{"id": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "address": "fa:16:3e:55:87:5a", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8a9fd6-60", "ovs_interfaceid": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f062d471-d758-4170-8a72-acf64914991b req-360c7109-3894-441d-ac2e-3854a953a695 service nova] Acquired lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:54:39 user nova-compute[72782]: DEBUG nova.network.neutron [req-f062d471-d758-4170-8a72-acf64914991b req-360c7109-3894-441d-ac2e-3854a953a695 service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Refreshing network info cache for port 7f8a9fd6-607b-48b2-be15-e45fe1c3654d {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:54:39 user nova-compute[72782]: DEBUG nova.network.neutron [req-f062d471-d758-4170-8a72-acf64914991b req-360c7109-3894-441d-ac2e-3854a953a695 service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Updated VIF entry in instance network info cache for port 7f8a9fd6-607b-48b2-be15-e45fe1c3654d. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:54:39 user nova-compute[72782]: DEBUG nova.network.neutron [req-f062d471-d758-4170-8a72-acf64914991b req-360c7109-3894-441d-ac2e-3854a953a695 service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Updating instance_info_cache with network_info: [{"id": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "address": "fa:16:3e:55:87:5a", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8a9fd6-60", "ovs_interfaceid": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:54:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f062d471-d758-4170-8a72-acf64914991b req-360c7109-3894-441d-ac2e-3854a953a695 service nova] Releasing lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:54:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.compute.manager [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:54:45 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Creating image(s)
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Did not create local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Ensure instance console log exists: /opt/stack/data/nova/instances/283d9889-b930-48bd-b053-d015d24cdd0e/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Start _get_guest_xml network_info=[{"id": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "address": "fa:16:3e:55:87:5a", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8a9fd6-60", "ovs_interfaceid": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '3588d298-89e5-4b8b-a28b-76972d04239d', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQkEUuFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '283d9889-b930-48bd-b053-d015d24cdd0e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4445c40-96a5-427c-9189-d47cd296b95b', 'serial': 'b4445c40-96a5-427c-9189-d47cd296b95b'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:54:45 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:54:45 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQkEUuFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:54:45 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:54:45 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:54:45 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e58c01-c332-4df8-ac96-cbd91d0e574e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:54:45 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4cb211-e685-46b6-aab6-a5d7e6ed09b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b] added
Aug 14 20:54:45 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f05aff-1b6e-4c33-b79e-54df3eb0d8d8]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[200f2a11-aa55-4094-a6ba-28dbb983677c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQkEUuFX {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQkEUuFX" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a009f4fd-429a-470b-b81d-be983f482185]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dQkEUuFX'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d544b1-0255-4812-8bea-344bbdd23323]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cea5ba-4478-4bce-9f49-6613a3a7dcba]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:54:45 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 20:54:45 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:54:45 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 20:54:45 user nova-compute[72782]: 
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26d027e-dbc9-4eeb-b488-a2d959f457fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b, portal: 172.16.0.220,3260]
Aug 14 20:54:45 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b, portal: 172.16.0.220,3260] successful.
Aug 14 20:54:45 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a9f520-7b7a-41d0-b65f-06b5a288f7ce]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f5a6ec-c9e6-48c3-915c-c02692314c87]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)
Aug 14 20:54:45 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)
Aug 14 20:54:45 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[894c65c7-93e4-42d4-940d-b8e0f61542c0]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:54:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQkEUuFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26138313864643464', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138313864643464', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:54:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1828346221',display_name='tempest-TestVolumeBootPattern-server-1828346221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1828346221',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3lDqNRM0dgyXsRQEWkWhJp1ZKddVfimacQxE2mNea9hU/c/Nvj3bT6VAIc+GOPx3eIlv853bKj9DkYcpchR/+fmz+870Kb1UY4vB0T5Az8VE5eoCMc0Dx35KUzi5xHNw==',key_name='tempest-TestVolumeBootPattern-1143441036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a99378957e94fc6a148b06bcd9123bf',ramdisk_id='',reservation_id='r-3ecnkyh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-52337130',owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:54:37Z,user_data=None,user_id='2df6ae64c62142cfbedd244de47bdd2a',uuid=283d9889-b930-48bd-b053-d015d24cdd0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "address": "fa:16:3e:55:87:5a", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8a9fd6-60", "ovs_interfaceid": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converting VIF {"id": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "address": "fa:16:3e:55:87:5a", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8a9fd6-60", "ovs_interfaceid": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:87:5a,bridge_name='br-int',has_traffic_filtering=True,id=7f8a9fd6-607b-48b2-be15-e45fe1c3654d,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8a9fd6-60') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG nova.objects.instance [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lazy-loading 'pci_devices' on Instance uuid 283d9889-b930-48bd-b053-d015d24cdd0e {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:54:46 user nova-compute[72782]:   <uuid>283d9889-b930-48bd-b053-d015d24cdd0e</uuid>
Aug 14 20:54:46 user nova-compute[72782]:   <name>instance-00000033</name>
Aug 14 20:54:46 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:54:46 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:54:46 user nova-compute[72782]:   <metadata>
Aug 14 20:54:46 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:54:46 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:54:46 user nova-compute[72782]:       <nova:name>tempest-TestVolumeBootPattern-server-1828346221</nova:name>
Aug 14 20:54:46 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:54:45</nova:creationTime>
Aug 14 20:54:46 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:54:46 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:54:46 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:54:46 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:54:46 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:54:46 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:54:46 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:54:46 user nova-compute[72782]:       <nova:owner>
Aug 14 20:54:46 user nova-compute[72782]:         <nova:user uuid="2df6ae64c62142cfbedd244de47bdd2a">tempest-TestVolumeBootPattern-52337130-project-member</nova:user>
Aug 14 20:54:46 user nova-compute[72782]:         <nova:project uuid="0a99378957e94fc6a148b06bcd9123bf">tempest-TestVolumeBootPattern-52337130</nova:project>
Aug 14 20:54:46 user nova-compute[72782]:       </nova:owner>
Aug 14 20:54:46 user nova-compute[72782]:       <nova:ports>
Aug 14 20:54:46 user nova-compute[72782]:         <nova:port uuid="7f8a9fd6-607b-48b2-be15-e45fe1c3654d">
Aug 14 20:54:46 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 20:54:46 user nova-compute[72782]:         </nova:port>
Aug 14 20:54:46 user nova-compute[72782]:       </nova:ports>
Aug 14 20:54:46 user nova-compute[72782]:     </nova:instance>
Aug 14 20:54:46 user nova-compute[72782]:   </metadata>
Aug 14 20:54:46 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:54:46 user nova-compute[72782]:     <system>
Aug 14 20:54:46 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:54:46 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:54:46 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:54:46 user nova-compute[72782]:       <entry name="serial">283d9889-b930-48bd-b053-d015d24cdd0e</entry>
Aug 14 20:54:46 user nova-compute[72782]:       <entry name="uuid">283d9889-b930-48bd-b053-d015d24cdd0e</entry>
Aug 14 20:54:46 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:54:46 user nova-compute[72782]:     </system>
Aug 14 20:54:46 user nova-compute[72782]:   </sysinfo>
Aug 14 20:54:46 user nova-compute[72782]:   <os>
Aug 14 20:54:46 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:54:46 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:54:46 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:54:46 user nova-compute[72782]:   </os>
Aug 14 20:54:46 user nova-compute[72782]:   <features>
Aug 14 20:54:46 user nova-compute[72782]:     <acpi/>
Aug 14 20:54:46 user nova-compute[72782]:     <apic/>
Aug 14 20:54:46 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:54:46 user nova-compute[72782]:   </features>
Aug 14 20:54:46 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:54:46 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:54:46 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:54:46 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:54:46 user nova-compute[72782]:   </clock>
Aug 14 20:54:46 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:54:46 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:54:46 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:54:46 user nova-compute[72782]:   </cpu>
Aug 14 20:54:46 user nova-compute[72782]:   <devices>
Aug 14 20:54:46 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 20:54:46 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:54:46 user nova-compute[72782]:       <source dev="/dev/sdb"/>
Aug 14 20:54:46 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:54:46 user nova-compute[72782]:       <serial>b4445c40-96a5-427c-9189-d47cd296b95b</serial>
Aug 14 20:54:46 user nova-compute[72782]:     </disk>
Aug 14 20:54:46 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:54:46 user nova-compute[72782]:       <mac address="fa:16:3e:55:87:5a"/>
Aug 14 20:54:46 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:54:46 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:54:46 user nova-compute[72782]:       <target dev="tap7f8a9fd6-60"/>
Aug 14 20:54:46 user nova-compute[72782]:     </interface>
Aug 14 20:54:46 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:54:46 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/283d9889-b930-48bd-b053-d015d24cdd0e/console.log" append="off"/>
Aug 14 20:54:46 user nova-compute[72782]:     </serial>
Aug 14 20:54:46 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:54:46 user nova-compute[72782]:     <video>
Aug 14 20:54:46 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:54:46 user nova-compute[72782]:     </video>
Aug 14 20:54:46 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:54:46 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:54:46 user nova-compute[72782]:     </rng>
Aug 14 20:54:46 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:54:46 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:54:46 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:54:46 user nova-compute[72782]:     </memballoon>
Aug 14 20:54:46 user nova-compute[72782]:   </devices>
Aug 14 20:54:46 user nova-compute[72782]: </domain>
Aug 14 20:54:46 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:54:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1828346221',display_name='tempest-TestVolumeBootPattern-server-1828346221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1828346221',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3lDqNRM0dgyXsRQEWkWhJp1ZKddVfimacQxE2mNea9hU/c/Nvj3bT6VAIc+GOPx3eIlv853bKj9DkYcpchR/+fmz+870Kb1UY4vB0T5Az8VE5eoCMc0Dx35KUzi5xHNw==',key_name='tempest-TestVolumeBootPattern-1143441036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a99378957e94fc6a148b06bcd9123bf',ramdisk_id='',reservation_id='r-3ecnkyh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-52337130',owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:54:37Z,user_data=None,user_id='2df6ae64c62142cfbedd244de47bdd2a',uuid=283d9889-b930-48bd-b053-d015d24cdd0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "address": "fa:16:3e:55:87:5a", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8a9fd6-60", "ovs_interfaceid": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converting VIF {"id": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "address": "fa:16:3e:55:87:5a", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8a9fd6-60", "ovs_interfaceid": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:87:5a,bridge_name='br-int',has_traffic_filtering=True,id=7f8a9fd6-607b-48b2-be15-e45fe1c3654d,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8a9fd6-60') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG os_vif [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:87:5a,bridge_name='br-int',has_traffic_filtering=True,id=7f8a9fd6-607b-48b2-be15-e45fe1c3654d,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8a9fd6-60') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f8a9fd6-60, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f8a9fd6-60, col_values=(('external_ids', {'iface-id': '7f8a9fd6-607b-48b2-be15-e45fe1c3654d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:87:5a', 'vm-uuid': '283d9889-b930-48bd-b053-d015d24cdd0e'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:54:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:46 user nova-compute[72782]: INFO os_vif [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:87:5a,bridge_name='br-int',has_traffic_filtering=True,id=7f8a9fd6-607b-48b2-be15-e45fe1c3654d,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8a9fd6-60')
Aug 14 20:54:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:54:47 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] No VIF found with MAC fa:16:3e:55:87:5a, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:54:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:48 user nova-compute[72782]: DEBUG nova.compute.manager [req-dafcac97-7f78-4d84-8391-56077f37097a req-71a6af26-93a2-4c27-8a0b-f93fa5339801 service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Received event network-vif-plugged-7f8a9fd6-607b-48b2-be15-e45fe1c3654d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:54:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-dafcac97-7f78-4d84-8391-56077f37097a req-71a6af26-93a2-4c27-8a0b-f93fa5339801 service nova] Acquiring lock "283d9889-b930-48bd-b053-d015d24cdd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:54:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-dafcac97-7f78-4d84-8391-56077f37097a req-71a6af26-93a2-4c27-8a0b-f93fa5339801 service nova] Lock "283d9889-b930-48bd-b053-d015d24cdd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:54:48 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-dafcac97-7f78-4d84-8391-56077f37097a req-71a6af26-93a2-4c27-8a0b-f93fa5339801 service nova] Lock "283d9889-b930-48bd-b053-d015d24cdd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:54:48 user nova-compute[72782]: DEBUG nova.compute.manager [req-dafcac97-7f78-4d84-8391-56077f37097a req-71a6af26-93a2-4c27-8a0b-f93fa5339801 service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] No waiting events found dispatching network-vif-plugged-7f8a9fd6-607b-48b2-be15-e45fe1c3654d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:54:48 user nova-compute[72782]: WARNING nova.compute.manager [req-dafcac97-7f78-4d84-8391-56077f37097a req-71a6af26-93a2-4c27-8a0b-f93fa5339801 service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Received unexpected event network-vif-plugged-7f8a9fd6-607b-48b2-be15-e45fe1c3654d for instance with vm_state building and task_state spawning.
Aug 14 20:54:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:48 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:50 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:54:50 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:54:50 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692046490.2841828, 283d9889-b930-48bd-b053-d015d24cdd0e => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:54:50 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] VM Resumed (Lifecycle Event)
Aug 14 20:54:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:54:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:54:50 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Instance spawned successfully.
Aug 14 20:54:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:54:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:54:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:54:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:54:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:54:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:54:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:54:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:54:50 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:54:50 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:54:50 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692046490.2865274, 283d9889-b930-48bd-b053-d015d24cdd0e => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:54:50 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] VM Started (Lifecycle Event)
Aug 14 20:54:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:54:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:54:50 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:54:50 user nova-compute[72782]: INFO nova.compute.manager [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Took 4.89 seconds to spawn the instance on the hypervisor.
Aug 14 20:54:50 user nova-compute[72782]: DEBUG nova.compute.manager [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:54:50 user nova-compute[72782]: INFO nova.compute.manager [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Took 13.88 seconds to build instance.
Aug 14 20:54:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-26fb1ac5-154a-40dd-a877-988c7c5a7db8 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "283d9889-b930-48bd-b053-d015d24cdd0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.966s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:54:50 user nova-compute[72782]: DEBUG nova.compute.manager [req-26fc8d28-8714-48cf-9168-899b2f69d861 req-08e224d5-072c-4a4a-a9c5-346442a16cf3 service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Received event network-vif-plugged-7f8a9fd6-607b-48b2-be15-e45fe1c3654d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:54:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-26fc8d28-8714-48cf-9168-899b2f69d861 req-08e224d5-072c-4a4a-a9c5-346442a16cf3 service nova] Acquiring lock "283d9889-b930-48bd-b053-d015d24cdd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:54:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-26fc8d28-8714-48cf-9168-899b2f69d861 req-08e224d5-072c-4a4a-a9c5-346442a16cf3 service nova] Lock "283d9889-b930-48bd-b053-d015d24cdd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:54:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-26fc8d28-8714-48cf-9168-899b2f69d861 req-08e224d5-072c-4a4a-a9c5-346442a16cf3 service nova] Lock "283d9889-b930-48bd-b053-d015d24cdd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:54:50 user nova-compute[72782]: DEBUG nova.compute.manager [req-26fc8d28-8714-48cf-9168-899b2f69d861 req-08e224d5-072c-4a4a-a9c5-346442a16cf3 service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] No waiting events found dispatching network-vif-plugged-7f8a9fd6-607b-48b2-be15-e45fe1c3654d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:54:50 user nova-compute[72782]: WARNING nova.compute.manager [req-26fc8d28-8714-48cf-9168-899b2f69d861 req-08e224d5-072c-4a4a-a9c5-346442a16cf3 service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Received unexpected event network-vif-plugged-7f8a9fd6-607b-48b2-be15-e45fe1c3654d for instance with vm_state active and task_state None.
Aug 14 20:54:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:54:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:54 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:54:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:54:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:54:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:54:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:54:54 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:54:54 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 283d9889-b930-48bd-b053-d015d24cdd0e {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:54:54 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Updating instance_info_cache with network_info: [{"id": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "address": "fa:16:3e:55:87:5a", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8a9fd6-60", "ovs_interfaceid": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:54:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:54:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:54:54 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:54:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:54:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:54:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:54:54 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:54:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:54:55 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:54:55 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:54:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8791MB free_disk=25.26211929321289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:54:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:54:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:54:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 283d9889-b930-48bd-b053-d015d24cdd0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:54:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:54:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:54:55 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:54:55 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:54:55 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:54:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:54:55 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:54:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:54:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:54:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:54:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:55:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:55:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:55:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:55:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:55:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:55:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:55:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:55:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:55:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:55:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:55:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:55:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:55:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:55:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:55:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:55:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:55:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:55:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:55:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:55:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:55:50 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:55:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:55:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:55:52 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:55:55 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:55:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:55:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:55:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:55:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:55:55 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:55:55 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 283d9889-b930-48bd-b053-d015d24cdd0e {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:55:55 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Updating instance_info_cache with network_info: [{"id": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "address": "fa:16:3e:55:87:5a", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8a9fd6-60", "ovs_interfaceid": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:55:55 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:55:55 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:55:56 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:55:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:55:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:55:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:55:56 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:55:56 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:55:56 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:55:56 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:55:56 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8751MB free_disk=25.26144790649414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:55:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:55:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:55:56 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 283d9889-b930-48bd-b053-d015d24cdd0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:55:56 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:55:56 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:55:56 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:55:56 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:55:56 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:55:56 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:55:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:55:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:55:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:55:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:55:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:56:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:56:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:56:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:56:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:56:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:56:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:56:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:56:22 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:27 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:28 user nova-compute[72782]: DEBUG nova.compute.manager [req-4d83e0fa-cc24-4512-b7a2-918d02e816df req-6211bfc3-bb9a-431d-bd9b-f36e266dbe0a service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Received event network-changed-7f8a9fd6-607b-48b2-be15-e45fe1c3654d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:56:28 user nova-compute[72782]: DEBUG nova.compute.manager [req-4d83e0fa-cc24-4512-b7a2-918d02e816df req-6211bfc3-bb9a-431d-bd9b-f36e266dbe0a service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Refreshing instance network info cache due to event network-changed-7f8a9fd6-607b-48b2-be15-e45fe1c3654d. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4d83e0fa-cc24-4512-b7a2-918d02e816df req-6211bfc3-bb9a-431d-bd9b-f36e266dbe0a service nova] Acquiring lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4d83e0fa-cc24-4512-b7a2-918d02e816df req-6211bfc3-bb9a-431d-bd9b-f36e266dbe0a service nova] Acquired lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:56:28 user nova-compute[72782]: DEBUG nova.network.neutron [req-4d83e0fa-cc24-4512-b7a2-918d02e816df req-6211bfc3-bb9a-431d-bd9b-f36e266dbe0a service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Refreshing network info cache for port 7f8a9fd6-607b-48b2-be15-e45fe1c3654d {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:56:28 user nova-compute[72782]: DEBUG nova.network.neutron [req-4d83e0fa-cc24-4512-b7a2-918d02e816df req-6211bfc3-bb9a-431d-bd9b-f36e266dbe0a service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Updated VIF entry in instance network info cache for port 7f8a9fd6-607b-48b2-be15-e45fe1c3654d. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:56:28 user nova-compute[72782]: DEBUG nova.network.neutron [req-4d83e0fa-cc24-4512-b7a2-918d02e816df req-6211bfc3-bb9a-431d-bd9b-f36e266dbe0a service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Updating instance_info_cache with network_info: [{"id": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "address": "fa:16:3e:55:87:5a", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8a9fd6-60", "ovs_interfaceid": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:56:28 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4d83e0fa-cc24-4512-b7a2-918d02e816df req-6211bfc3-bb9a-431d-bd9b-f36e266dbe0a service nova] Releasing lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:56:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:32 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:37 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:56:40 user nova-compute[72782]: DEBUG nova.compute.manager [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 20:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:56:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:56:40 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 20:56:40 user nova-compute[72782]: INFO nova.compute.claims [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Claim successful on node user
Aug 14 20:56:41 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG nova.network.neutron [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 20:56:41 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 20:56:41 user nova-compute[72782]: DEBUG nova.compute.manager [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 20:56:41 user nova-compute[72782]: INFO nova.virt.block_device [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Booting with volume 8b439813-313b-4443-a0d2-00b9c7c13cf2 at /dev/vda
Aug 14 20:56:41 user nova-compute[72782]: DEBUG nova.policy [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2df6ae64c62142cfbedd244de47bdd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a99378957e94fc6a148b06bcd9123bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG os_brick.utils [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[215fc527-7c38-428f-a85c-afe9fab5e36d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dff81f9-b68e-45d2-98f3-bd54995c21b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa6d07a-5fdc-491c-8949-eaea99ff4a99]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8e4121-4c13-4048-b620-b6cd1526f563]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 20:56:41 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 20:56:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83b1b34-7e62-4967-b42e-f3f8c1e001bf]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG os_brick.utils [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:56:41 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Updating existing volume attachment record: 6d0c07a7-2750-4961-a342-e86b09465c0a {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 20:56:42 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:42 user nova-compute[72782]: DEBUG nova.network.neutron [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Successfully created port: 7a557ab9-7e59-4d71-98e6-b1dae23fdb2d {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 20:56:42 user nova-compute[72782]: DEBUG nova.network.neutron [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Successfully updated port: 7a557ab9-7e59-4d71-98e6-b1dae23fdb2d {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 20:56:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "refresh_cache-60a62685-50bd-4197-8c8f-96ff0f7d73ce" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:56:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquired lock "refresh_cache-60a62685-50bd-4197-8c8f-96ff0f7d73ce" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:56:42 user nova-compute[72782]: DEBUG nova.network.neutron [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 20:56:42 user nova-compute[72782]: DEBUG nova.network.neutron [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 20:56:42 user nova-compute[72782]: DEBUG nova.compute.manager [req-ece34f72-56ac-4e8d-b587-9dae74b2b6bd req-3c8d4823-826f-4697-a726-1f894a985e6c service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Received event network-changed-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:56:42 user nova-compute[72782]: DEBUG nova.compute.manager [req-ece34f72-56ac-4e8d-b587-9dae74b2b6bd req-3c8d4823-826f-4697-a726-1f894a985e6c service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Refreshing instance network info cache due to event network-changed-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:56:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ece34f72-56ac-4e8d-b587-9dae74b2b6bd req-3c8d4823-826f-4697-a726-1f894a985e6c service nova] Acquiring lock "refresh_cache-60a62685-50bd-4197-8c8f-96ff0f7d73ce" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:56:43 user nova-compute[72782]: DEBUG nova.network.neutron [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Updating instance_info_cache with network_info: [{"id": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "address": "fa:16:3e:02:55:a5", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a557ab9-7e", "ovs_interfaceid": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Releasing lock "refresh_cache-60a62685-50bd-4197-8c8f-96ff0f7d73ce" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:56:43 user nova-compute[72782]: DEBUG nova.compute.manager [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Instance network_info: |[{"id": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "address": "fa:16:3e:02:55:a5", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a557ab9-7e", "ovs_interfaceid": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 20:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ece34f72-56ac-4e8d-b587-9dae74b2b6bd req-3c8d4823-826f-4697-a726-1f894a985e6c service nova] Acquired lock "refresh_cache-60a62685-50bd-4197-8c8f-96ff0f7d73ce" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:56:43 user nova-compute[72782]: DEBUG nova.network.neutron [req-ece34f72-56ac-4e8d-b587-9dae74b2b6bd req-3c8d4823-826f-4697-a726-1f894a985e6c service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Refreshing network info cache for port 7a557ab9-7e59-4d71-98e6-b1dae23fdb2d {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:56:43 user nova-compute[72782]: DEBUG nova.network.neutron [req-ece34f72-56ac-4e8d-b587-9dae74b2b6bd req-3c8d4823-826f-4697-a726-1f894a985e6c service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Updated VIF entry in instance network info cache for port 7a557ab9-7e59-4d71-98e6-b1dae23fdb2d. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:56:43 user nova-compute[72782]: DEBUG nova.network.neutron [req-ece34f72-56ac-4e8d-b587-9dae74b2b6bd req-3c8d4823-826f-4697-a726-1f894a985e6c service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Updating instance_info_cache with network_info: [{"id": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "address": "fa:16:3e:02:55:a5", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a557ab9-7e", "ovs_interfaceid": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:56:43 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ece34f72-56ac-4e8d-b587-9dae74b2b6bd req-3c8d4823-826f-4697-a726-1f894a985e6c service nova] Releasing lock "refresh_cache-60a62685-50bd-4197-8c8f-96ff0f7d73ce" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:56:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:47 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 20:56:49 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Creating image(s)
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Did not create local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Ensure instance console log exists: /opt/stack/data/nova/instances/60a62685-50bd-4197-8c8f-96ff0f7d73ce/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Start _get_guest_xml network_info=[{"id": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "address": "fa:16:3e:02:55:a5", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a557ab9-7e", "ovs_interfaceid": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'attachment_id': '6d0c07a7-2750-4961-a342-e86b09465c0a', 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRPFqulE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '60a62685-50bd-4197-8c8f-96ff0f7d73ce', 'attached_at': '', 'detached_at': '', 'volume_id': '8b439813-313b-4443-a0d2-00b9c7c13cf2', 'serial': '8b439813-313b-4443-a0d2-00b9c7c13cf2'}, 'volume_type': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 20:56:49 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:56:49 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRPFqulE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:56:49 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:56:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:56:49 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:56:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:56:49 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 20:56:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8604959-bba6-4c9f-91b8-2d899aa25bf7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 20:56:49 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:56:49 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[337fcbd0-1972-44c5-8547-335379814150]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2] added
Aug 14 20:56:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[41434d65-f951-4670-8098-5331f29833a7]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39801c4-76d5-4fac-b673-74cad60cd382]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vRPFqulE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vRPFqulE" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[24954520-fd69-422a-90e3-f046c151340d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vRPFqulE'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[81047655-0c13-4b06-af02-28fdaeb24dad]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[661a2f45-39d1-4084-8508-f9cfc64b47f5]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)
Aug 14 20:56:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)
Aug 14 20:56:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6f15c6-2e9c-405d-acfc-12d03ee2ea60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2, portal: 172.16.0.220,3260]
Aug 14 20:56:50 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2, portal: 172.16.0.220,3260] successful.
Aug 14 20:56:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c918693-8262-4229-9e6d-862521e6542f]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28e1085-97fe-4527-80e7-f3d3c50b4b10]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)
Aug 14 20:56:50 user nova-compute[72782]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 (non-flash)
Aug 14 20:56:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)
Aug 14 20:56:50 user nova-compute[72782]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 (non-flash)
Aug 14 20:56:50 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c8afbf-578a-4a20-b775-34bee81b48e2]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:56:50 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: None {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRPFqulE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26164633632373262', 'path': '/dev/sdc'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164633632373262', 'path': '/dev/sdc'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:56:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1579523620',display_name='tempest-TestVolumeBootPattern-server-1579523620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1579523620',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3lDqNRM0dgyXsRQEWkWhJp1ZKddVfimacQxE2mNea9hU/c/Nvj3bT6VAIc+GOPx3eIlv853bKj9DkYcpchR/+fmz+870Kb1UY4vB0T5Az8VE5eoCMc0Dx35KUzi5xHNw==',key_name='tempest-TestVolumeBootPattern-1143441036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a99378957e94fc6a148b06bcd9123bf',ramdisk_id='',reservation_id='r-6qm3v391',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-52337130',owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:56:41Z,user_data=None,user_id='2df6ae64c62142cfbedd244de47bdd2a',uuid=60a62685-50bd-4197-8c8f-96ff0f7d73ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "address": "fa:16:3e:02:55:a5", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a557ab9-7e", "ovs_interfaceid": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converting VIF {"id": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "address": "fa:16:3e:02:55:a5", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a557ab9-7e", "ovs_interfaceid": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:55:a5,bridge_name='br-int',has_traffic_filtering=True,id=7a557ab9-7e59-4d71-98e6-b1dae23fdb2d,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a557ab9-7e') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG nova.objects.instance [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lazy-loading 'pci_devices' on Instance uuid 60a62685-50bd-4197-8c8f-96ff0f7d73ce {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] End _get_guest_xml xml=<domain type="kvm">
Aug 14 20:56:51 user nova-compute[72782]:   <uuid>60a62685-50bd-4197-8c8f-96ff0f7d73ce</uuid>
Aug 14 20:56:51 user nova-compute[72782]:   <name>instance-00000034</name>
Aug 14 20:56:51 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 20:56:51 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 20:56:51 user nova-compute[72782]:   <metadata>
Aug 14 20:56:51 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 20:56:51 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 20:56:51 user nova-compute[72782]:       <nova:name>tempest-TestVolumeBootPattern-server-1579523620</nova:name>
Aug 14 20:56:51 user nova-compute[72782]:       <nova:creationTime>2023-08-14 20:56:49</nova:creationTime>
Aug 14 20:56:51 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 20:56:51 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 20:56:51 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 20:56:51 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 20:56:51 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 20:56:51 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 20:56:51 user nova-compute[72782]:       </nova:flavor>
Aug 14 20:56:51 user nova-compute[72782]:       <nova:owner>
Aug 14 20:56:51 user nova-compute[72782]:         <nova:user uuid="2df6ae64c62142cfbedd244de47bdd2a">tempest-TestVolumeBootPattern-52337130-project-member</nova:user>
Aug 14 20:56:51 user nova-compute[72782]:         <nova:project uuid="0a99378957e94fc6a148b06bcd9123bf">tempest-TestVolumeBootPattern-52337130</nova:project>
Aug 14 20:56:51 user nova-compute[72782]:       </nova:owner>
Aug 14 20:56:51 user nova-compute[72782]:       <nova:ports>
Aug 14 20:56:51 user nova-compute[72782]:         <nova:port uuid="7a557ab9-7e59-4d71-98e6-b1dae23fdb2d">
Aug 14 20:56:51 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 20:56:51 user nova-compute[72782]:         </nova:port>
Aug 14 20:56:51 user nova-compute[72782]:       </nova:ports>
Aug 14 20:56:51 user nova-compute[72782]:     </nova:instance>
Aug 14 20:56:51 user nova-compute[72782]:   </metadata>
Aug 14 20:56:51 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 20:56:51 user nova-compute[72782]:     <system>
Aug 14 20:56:51 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 20:56:51 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 20:56:51 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 20:56:51 user nova-compute[72782]:       <entry name="serial">60a62685-50bd-4197-8c8f-96ff0f7d73ce</entry>
Aug 14 20:56:51 user nova-compute[72782]:       <entry name="uuid">60a62685-50bd-4197-8c8f-96ff0f7d73ce</entry>
Aug 14 20:56:51 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 20:56:51 user nova-compute[72782]:     </system>
Aug 14 20:56:51 user nova-compute[72782]:   </sysinfo>
Aug 14 20:56:51 user nova-compute[72782]:   <os>
Aug 14 20:56:51 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 20:56:51 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 20:56:51 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 20:56:51 user nova-compute[72782]:   </os>
Aug 14 20:56:51 user nova-compute[72782]:   <features>
Aug 14 20:56:51 user nova-compute[72782]:     <acpi/>
Aug 14 20:56:51 user nova-compute[72782]:     <apic/>
Aug 14 20:56:51 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 20:56:51 user nova-compute[72782]:   </features>
Aug 14 20:56:51 user nova-compute[72782]:   <clock offset="utc">
Aug 14 20:56:51 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 20:56:51 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 20:56:51 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 20:56:51 user nova-compute[72782]:   </clock>
Aug 14 20:56:51 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 20:56:51 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 20:56:51 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 20:56:51 user nova-compute[72782]:   </cpu>
Aug 14 20:56:51 user nova-compute[72782]:   <devices>
Aug 14 20:56:51 user nova-compute[72782]:     <disk type="block" device="disk">
Aug 14 20:56:51 user nova-compute[72782]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 20:56:51 user nova-compute[72782]:       <source dev="/dev/sdc"/>
Aug 14 20:56:51 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 20:56:51 user nova-compute[72782]:       <serial>8b439813-313b-4443-a0d2-00b9c7c13cf2</serial>
Aug 14 20:56:51 user nova-compute[72782]:     </disk>
Aug 14 20:56:51 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 20:56:51 user nova-compute[72782]:       <mac address="fa:16:3e:02:55:a5"/>
Aug 14 20:56:51 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:56:51 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 20:56:51 user nova-compute[72782]:       <target dev="tap7a557ab9-7e"/>
Aug 14 20:56:51 user nova-compute[72782]:     </interface>
Aug 14 20:56:51 user nova-compute[72782]:     <serial type="pty">
Aug 14 20:56:51 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/60a62685-50bd-4197-8c8f-96ff0f7d73ce/console.log" append="off"/>
Aug 14 20:56:51 user nova-compute[72782]:     </serial>
Aug 14 20:56:51 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 20:56:51 user nova-compute[72782]:     <video>
Aug 14 20:56:51 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 20:56:51 user nova-compute[72782]:     </video>
Aug 14 20:56:51 user nova-compute[72782]:     <rng model="virtio">
Aug 14 20:56:51 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 20:56:51 user nova-compute[72782]:     </rng>
Aug 14 20:56:51 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 20:56:51 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 20:56:51 user nova-compute[72782]:       <stats period="10"/>
Aug 14 20:56:51 user nova-compute[72782]:     </memballoon>
Aug 14 20:56:51 user nova-compute[72782]:   </devices>
Aug 14 20:56:51 user nova-compute[72782]: </domain>
Aug 14 20:56:51 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:56:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1579523620',display_name='tempest-TestVolumeBootPattern-server-1579523620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1579523620',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3lDqNRM0dgyXsRQEWkWhJp1ZKddVfimacQxE2mNea9hU/c/Nvj3bT6VAIc+GOPx3eIlv853bKj9DkYcpchR/+fmz+870Kb1UY4vB0T5Az8VE5eoCMc0Dx35KUzi5xHNw==',key_name='tempest-TestVolumeBootPattern-1143441036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a99378957e94fc6a148b06bcd9123bf',ramdisk_id='',reservation_id='r-6qm3v391',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-52337130',owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T20:56:41Z,user_data=None,user_id='2df6ae64c62142cfbedd244de47bdd2a',uuid=60a62685-50bd-4197-8c8f-96ff0f7d73ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "address": "fa:16:3e:02:55:a5", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a557ab9-7e", "ovs_interfaceid": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converting VIF {"id": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "address": "fa:16:3e:02:55:a5", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a557ab9-7e", "ovs_interfaceid": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:55:a5,bridge_name='br-int',has_traffic_filtering=True,id=7a557ab9-7e59-4d71-98e6-b1dae23fdb2d,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a557ab9-7e') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG os_vif [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:55:a5,bridge_name='br-int',has_traffic_filtering=True,id=7a557ab9-7e59-4d71-98e6-b1dae23fdb2d,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a557ab9-7e') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a557ab9-7e, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a557ab9-7e, col_values=(('external_ids', {'iface-id': '7a557ab9-7e59-4d71-98e6-b1dae23fdb2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:55:a5', 'vm-uuid': '60a62685-50bd-4197-8c8f-96ff0f7d73ce'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:51 user nova-compute[72782]: INFO os_vif [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:55:a5,bridge_name='br-int',has_traffic_filtering=True,id=7a557ab9-7e59-4d71-98e6-b1dae23fdb2d,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a557ab9-7e')
Aug 14 20:56:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 20:56:51 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] No VIF found with MAC fa:16:3e:02:55:a5, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 20:56:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-ca469915-00a4-469f-a89a-4d491628f021 req-3c937a93-b944-43b7-828f-26190549693f service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Received event network-vif-plugged-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:56:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ca469915-00a4-469f-a89a-4d491628f021 req-3c937a93-b944-43b7-828f-26190549693f service nova] Acquiring lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:56:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ca469915-00a4-469f-a89a-4d491628f021 req-3c937a93-b944-43b7-828f-26190549693f service nova] Lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:56:52 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ca469915-00a4-469f-a89a-4d491628f021 req-3c937a93-b944-43b7-828f-26190549693f service nova] Lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:56:52 user nova-compute[72782]: DEBUG nova.compute.manager [req-ca469915-00a4-469f-a89a-4d491628f021 req-3c937a93-b944-43b7-828f-26190549693f service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] No waiting events found dispatching network-vif-plugged-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:56:52 user nova-compute[72782]: WARNING nova.compute.manager [req-ca469915-00a4-469f-a89a-4d491628f021 req-3c937a93-b944-43b7-828f-26190549693f service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Received unexpected event network-vif-plugged-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d for instance with vm_state building and task_state spawning.
Aug 14 20:56:52 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:56:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:54 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692046614.748123, 60a62685-50bd-4197-8c8f-96ff0f7d73ce => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:56:54 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] VM Resumed (Lifecycle Event)
Aug 14 20:56:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 20:56:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 20:56:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:56:54 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Instance spawned successfully.
Aug 14 20:56:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 20:56:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:56:54 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:56:54 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692046614.7624063, 60a62685-50bd-4197-8c8f-96ff0f7d73ce => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:56:54 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] VM Started (Lifecycle Event)
Aug 14 20:56:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:56:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:56:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:56:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:56:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:56:54 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 20:56:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:56:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 20:56:54 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 20:56:54 user nova-compute[72782]: INFO nova.compute.manager [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Took 5.01 seconds to spawn the instance on the hypervisor.
Aug 14 20:56:54 user nova-compute[72782]: DEBUG nova.compute.manager [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:56:54 user nova-compute[72782]: INFO nova.compute.manager [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Took 14.03 seconds to build instance.
Aug 14 20:56:54 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-03fc61f9-1b3d-4754-a355-c98d37d2c9bc tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.143s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:56:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:56:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:56:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:56:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:56:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:56:57 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:56:57 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 283d9889-b930-48bd-b053-d015d24cdd0e {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:56:57 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Updating instance_info_cache with network_info: [{"id": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "address": "fa:16:3e:55:87:5a", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8a9fd6-60", "ovs_interfaceid": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:56:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:56:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:56:58 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:56:58 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:56:58 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8663MB free_disk=25.25967025756836GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 283d9889-b930-48bd-b053-d015d24cdd0e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 60a62685-50bd-4197-8c8f-96ff0f7d73ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing inventories for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating ProviderTree inventory for provider d26c9e3b-40e6-476e-9664-3119ebf5873b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing aggregate associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, aggregates: None {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing trait associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:56:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:56:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:56:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:57:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:57:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:57:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:57:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:57:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:57:06 user nova-compute[72782]: DEBUG nova.compute.manager [req-f6d5e4ce-0a01-4978-af13-7e2991250ccc req-1b24c164-e5dc-44d7-83ce-c1e2b000b1f9 service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Received event network-vif-plugged-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:57:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f6d5e4ce-0a01-4978-af13-7e2991250ccc req-1b24c164-e5dc-44d7-83ce-c1e2b000b1f9 service nova] Acquiring lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:57:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f6d5e4ce-0a01-4978-af13-7e2991250ccc req-1b24c164-e5dc-44d7-83ce-c1e2b000b1f9 service nova] Lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:57:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-f6d5e4ce-0a01-4978-af13-7e2991250ccc req-1b24c164-e5dc-44d7-83ce-c1e2b000b1f9 service nova] Lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:57:06 user nova-compute[72782]: DEBUG nova.compute.manager [req-f6d5e4ce-0a01-4978-af13-7e2991250ccc req-1b24c164-e5dc-44d7-83ce-c1e2b000b1f9 service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] No waiting events found dispatching network-vif-plugged-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:57:06 user nova-compute[72782]: WARNING nova.compute.manager [req-f6d5e4ce-0a01-4978-af13-7e2991250ccc req-1b24c164-e5dc-44d7-83ce-c1e2b000b1f9 service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Received unexpected event network-vif-plugged-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d for instance with vm_state building and task_state spawning.
Aug 14 20:57:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:57:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 20:57:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] There are 0 instances to clean {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 20:57:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:57:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:57:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:57:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:57:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:57:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:57:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:57:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:57:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:57:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:57:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:57:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:57:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:57:51 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:57:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:57:52 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:57:55 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:57:56 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:57:56 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72782) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 20:57:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:57:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:57:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:57:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-60a62685-50bd-4197-8c8f-96ff0f7d73ce" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:57:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-60a62685-50bd-4197-8c8f-96ff0f7d73ce" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:57:57 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:57:57 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Updating instance_info_cache with network_info: [{"id": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "address": "fa:16:3e:02:55:a5", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a557ab9-7e", "ovs_interfaceid": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:57:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-60a62685-50bd-4197-8c8f-96ff0f7d73ce" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:57:57 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:57:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:57:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:57:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:57:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:57:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:57:59 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:57:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:57:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:57:59 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:57:59 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:57:59 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8660MB free_disk=25.25899887084961GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:57:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:57:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:57:59 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 283d9889-b930-48bd-b053-d015d24cdd0e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:57:59 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 60a62685-50bd-4197-8c8f-96ff0f7d73ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:57:59 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:57:59 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:57:59 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:57:59 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:57:59 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:57:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:58:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:58:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:58:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:58:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:03 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:58:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:58:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:32 user nova-compute[72782]: DEBUG nova.compute.manager [req-5c2ee076-ecde-4187-9042-f2a6e26c0c89 req-5a152b4e-54ae-48b8-93f3-57bf5dc3eac0 service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Received event network-changed-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:58:32 user nova-compute[72782]: DEBUG nova.compute.manager [req-5c2ee076-ecde-4187-9042-f2a6e26c0c89 req-5a152b4e-54ae-48b8-93f3-57bf5dc3eac0 service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Refreshing instance network info cache due to event network-changed-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5c2ee076-ecde-4187-9042-f2a6e26c0c89 req-5a152b4e-54ae-48b8-93f3-57bf5dc3eac0 service nova] Acquiring lock "refresh_cache-60a62685-50bd-4197-8c8f-96ff0f7d73ce" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:58:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5c2ee076-ecde-4187-9042-f2a6e26c0c89 req-5a152b4e-54ae-48b8-93f3-57bf5dc3eac0 service nova] Acquired lock "refresh_cache-60a62685-50bd-4197-8c8f-96ff0f7d73ce" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:58:32 user nova-compute[72782]: DEBUG nova.network.neutron [req-5c2ee076-ecde-4187-9042-f2a6e26c0c89 req-5a152b4e-54ae-48b8-93f3-57bf5dc3eac0 service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Refreshing network info cache for port 7a557ab9-7e59-4d71-98e6-b1dae23fdb2d {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:58:33 user nova-compute[72782]: DEBUG nova.network.neutron [req-5c2ee076-ecde-4187-9042-f2a6e26c0c89 req-5a152b4e-54ae-48b8-93f3-57bf5dc3eac0 service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Updated VIF entry in instance network info cache for port 7a557ab9-7e59-4d71-98e6-b1dae23fdb2d. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:58:33 user nova-compute[72782]: DEBUG nova.network.neutron [req-5c2ee076-ecde-4187-9042-f2a6e26c0c89 req-5a152b4e-54ae-48b8-93f3-57bf5dc3eac0 service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Updating instance_info_cache with network_info: [{"id": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "address": "fa:16:3e:02:55:a5", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a557ab9-7e", "ovs_interfaceid": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:58:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-5c2ee076-ecde-4187-9042-f2a6e26c0c89 req-5a152b4e-54ae-48b8-93f3-57bf5dc3eac0 service nova] Releasing lock "refresh_cache-60a62685-50bd-4197-8c8f-96ff0f7d73ce" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG nova.compute.manager [req-88c1dc31-9b7c-46e3-91ce-a38d9cc358b7 req-71300bf1-0d95-48e9-a129-5f707ca0cff6 service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Received event network-changed-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG nova.compute.manager [req-88c1dc31-9b7c-46e3-91ce-a38d9cc358b7 req-71300bf1-0d95-48e9-a129-5f707ca0cff6 service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Refreshing instance network info cache due to event network-changed-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-88c1dc31-9b7c-46e3-91ce-a38d9cc358b7 req-71300bf1-0d95-48e9-a129-5f707ca0cff6 service nova] Acquiring lock "refresh_cache-60a62685-50bd-4197-8c8f-96ff0f7d73ce" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-88c1dc31-9b7c-46e3-91ce-a38d9cc358b7 req-71300bf1-0d95-48e9-a129-5f707ca0cff6 service nova] Acquired lock "refresh_cache-60a62685-50bd-4197-8c8f-96ff0f7d73ce" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG nova.network.neutron [req-88c1dc31-9b7c-46e3-91ce-a38d9cc358b7 req-71300bf1-0d95-48e9-a129-5f707ca0cff6 service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Refreshing network info cache for port 7a557ab9-7e59-4d71-98e6-b1dae23fdb2d {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:58:34 user nova-compute[72782]: INFO nova.compute.manager [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Terminating instance
Aug 14 20:58:34 user nova-compute[72782]: DEBUG nova.compute.manager [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG nova.network.neutron [req-88c1dc31-9b7c-46e3-91ce-a38d9cc358b7 req-71300bf1-0d95-48e9-a129-5f707ca0cff6 service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Updated VIF entry in instance network info cache for port 7a557ab9-7e59-4d71-98e6-b1dae23fdb2d. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG nova.network.neutron [req-88c1dc31-9b7c-46e3-91ce-a38d9cc358b7 req-71300bf1-0d95-48e9-a129-5f707ca0cff6 service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Updating instance_info_cache with network_info: [{"id": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "address": "fa:16:3e:02:55:a5", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a557ab9-7e", "ovs_interfaceid": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-88c1dc31-9b7c-46e3-91ce-a38d9cc358b7 req-71300bf1-0d95-48e9-a129-5f707ca0cff6 service nova] Releasing lock "refresh_cache-60a62685-50bd-4197-8c8f-96ff0f7d73ce" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG nova.compute.manager [req-25b291f4-18b6-4089-aef3-66a443bcca4c req-93e41b6f-0b3d-47a3-a1fb-85d18ce7cdde service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Received event network-vif-unplugged-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-25b291f4-18b6-4089-aef3-66a443bcca4c req-93e41b6f-0b3d-47a3-a1fb-85d18ce7cdde service nova] Acquiring lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-25b291f4-18b6-4089-aef3-66a443bcca4c req-93e41b6f-0b3d-47a3-a1fb-85d18ce7cdde service nova] Lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-25b291f4-18b6-4089-aef3-66a443bcca4c req-93e41b6f-0b3d-47a3-a1fb-85d18ce7cdde service nova] Lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG nova.compute.manager [req-25b291f4-18b6-4089-aef3-66a443bcca4c req-93e41b6f-0b3d-47a3-a1fb-85d18ce7cdde service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] No waiting events found dispatching network-vif-unplugged-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG nova.compute.manager [req-25b291f4-18b6-4089-aef3-66a443bcca4c req-93e41b6f-0b3d-47a3-a1fb-85d18ce7cdde service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Received event network-vif-unplugged-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG nova.compute.manager [req-25b291f4-18b6-4089-aef3-66a443bcca4c req-93e41b6f-0b3d-47a3-a1fb-85d18ce7cdde service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Received event network-vif-plugged-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-25b291f4-18b6-4089-aef3-66a443bcca4c req-93e41b6f-0b3d-47a3-a1fb-85d18ce7cdde service nova] Acquiring lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-25b291f4-18b6-4089-aef3-66a443bcca4c req-93e41b6f-0b3d-47a3-a1fb-85d18ce7cdde service nova] Lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-25b291f4-18b6-4089-aef3-66a443bcca4c req-93e41b6f-0b3d-47a3-a1fb-85d18ce7cdde service nova] Lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG nova.compute.manager [req-25b291f4-18b6-4089-aef3-66a443bcca4c req-93e41b6f-0b3d-47a3-a1fb-85d18ce7cdde service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] No waiting events found dispatching network-vif-plugged-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:58:34 user nova-compute[72782]: WARNING nova.compute.manager [req-25b291f4-18b6-4089-aef3-66a443bcca4c req-93e41b6f-0b3d-47a3-a1fb-85d18ce7cdde service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Received unexpected event network-vif-plugged-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d for instance with vm_state active and task_state deleting.
Aug 14 20:58:34 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Instance destroyed successfully.
Aug 14 20:58:34 user nova-compute[72782]: DEBUG nova.objects.instance [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lazy-loading 'resources' on Instance uuid 60a62685-50bd-4197-8c8f-96ff0f7d73ce {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:56:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1579523620',display_name='tempest-TestVolumeBootPattern-server-1579523620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1579523620',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3lDqNRM0dgyXsRQEWkWhJp1ZKddVfimacQxE2mNea9hU/c/Nvj3bT6VAIc+GOPx3eIlv853bKj9DkYcpchR/+fmz+870Kb1UY4vB0T5Az8VE5eoCMc0Dx35KUzi5xHNw==',key_name='tempest-TestVolumeBootPattern-1143441036',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:56:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a99378957e94fc6a148b06bcd9123bf',ramdisk_id='',reservation_id='r-6qm3v391',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-52337130',owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:56:55Z,user_data=None,user_id='2df6ae64c62142cfbedd244de47bdd2a',uuid=60a62685-50bd-4197-8c8f-96ff0f7d73ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "address": "fa:16:3e:02:55:a5", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a557ab9-7e", "ovs_interfaceid": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converting VIF {"id": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "address": "fa:16:3e:02:55:a5", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a557ab9-7e", "ovs_interfaceid": "7a557ab9-7e59-4d71-98e6-b1dae23fdb2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:55:a5,bridge_name='br-int',has_traffic_filtering=True,id=7a557ab9-7e59-4d71-98e6-b1dae23fdb2d,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a557ab9-7e') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG os_vif [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:55:a5,bridge_name='br-int',has_traffic_filtering=True,id=7a557ab9-7e59-4d71-98e6-b1dae23fdb2d,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a557ab9-7e') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a557ab9-7e, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:58:34 user nova-compute[72782]: INFO os_vif [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:55:a5,bridge_name='br-int',has_traffic_filtering=True,id=7a557ab9-7e59-4d71-98e6-b1dae23fdb2d,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a557ab9-7e')
Aug 14 20:58:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRPFqulE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:58:34 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:58:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fab4eb-630f-45c5-8781-0b6f3fa42952]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98aa4d3-620e-4179-8da1-50c60c0f49ff]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)
Aug 14 20:58:34 user nova-compute[72782]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 (non-flash)
Aug 14 20:58:34 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)
Aug 14 20:58:34 user nova-compute[72782]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 (non-flash)
Aug 14 20:58:34 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e86cad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2'): ({'sdc'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Removing single pathed devices sdc {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c966d4-69dc-4ba3-8c56-0c29064c4775]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:58:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d469cc-08ec-47f5-a9f1-43a95ef15e95]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Flushing IO for device /dev/sdc {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8f9bc3-8614-43d5-b3b3-bc56f136e5d2]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[216322f6-813a-4fb6-8509-bc9a278b874a]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] SCSI volumes sdc have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf78c6391-adc6272b521693ae', '/dev/disk/by-id/scsi-26164633632373262', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f78c6391') {{(pid=83776) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 20:58:35 user nova-compute[72782]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOf78c6391-adc6272b521693ae
Aug 14 20:58:35 user nova-compute[72782]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26164633632373262
Aug 14 20:58:35 user nova-compute[72782]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_f78c6391
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c8b9eb-3d2c-4b10-ba13-af891911d1c9]: (4, None) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b168594-ab4b-4b27-af51-5371d4925c05]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e4f458-bc92-4f54-8cb3-4fb3980cfd7f]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2, portal: 172.16.0.220,3260]
Aug 14 20:58:35 user nova-compute[72782]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2, portal: 172.16.0.220,3260] successful.
Aug 14 20:58:35 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b439813-313b-4443-a0d2-00b9c7c13cf2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd65a98-39b8-452f-8384-ca4b55b1d3b3]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] <== disconnect_volume: return (284ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:58:35 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Deleting instance files /opt/stack/data/nova/instances/60a62685-50bd-4197-8c8f-96ff0f7d73ce_del
Aug 14 20:58:35 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Deletion of /opt/stack/data/nova/instances/60a62685-50bd-4197-8c8f-96ff0f7d73ce_del complete
Aug 14 20:58:35 user nova-compute[72782]: INFO nova.compute.manager [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 14 20:58:35 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:58:35 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:58:35 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Took 0.47 seconds to deallocate network for instance.
Aug 14 20:58:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-f591d199-6bba-4f20-a8e7-d6a4bd731d1a req-607dab3a-c03d-4e97-b0c4-953eb0ce1508 service nova] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Received event network-vif-deleted-7a557ab9-7e59-4d71-98e6-b1dae23fdb2d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:58:36 user nova-compute[72782]: INFO nova.compute.manager [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Took 0.71 seconds to detach 1 volumes for instance.
Aug 14 20:58:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:58:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:58:36 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:58:36 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:58:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:58:36 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Deleted allocations for instance 60a62685-50bd-4197-8c8f-96ff0f7d73ce
Aug 14 20:58:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-ba209d13-d25d-4800-a082-d9b4b2d5bc70 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "60a62685-50bd-4197-8c8f-96ff0f7d73ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.735s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:58:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:49 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692046714.8665402, 60a62685-50bd-4197-8c8f-96ff0f7d73ce => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:58:49 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] VM Stopped (Lifecycle Event)
Aug 14 20:58:49 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fd4a58de-cbc1-4925-ab9d-1f1866e73ce9 None None] [instance: 60a62685-50bd-4197-8c8f-96ff0f7d73ce] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:58:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:58:52 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:58:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:58:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:58:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:58:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:58:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:58:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:58:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:58:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:58:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:58:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:58:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:58:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:58:58 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 20:58:58 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 283d9889-b930-48bd-b053-d015d24cdd0e {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:58:58 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Updating instance_info_cache with network_info: [{"id": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "address": "fa:16:3e:55:87:5a", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8a9fd6-60", "ovs_interfaceid": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:58:58 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:58:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 20:58:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:58:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:58:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:58:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:58:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:58:59 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 20:58:59 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72782) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 20:58:59 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:58:59 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 20:58:59 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8730MB free_disk=25.25812530517578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 20:58:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:58:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:58:59 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 283d9889-b930-48bd-b053-d015d24cdd0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 20:58:59 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 20:58:59 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 20:58:59 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:58:59 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:58:59 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 20:58:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:58:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:59:00 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 20:59:03 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:59:04 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:59:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:59:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:59:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 20:59:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:59:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 20:59:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-1e09da65-e21a-4406-801f-96ab7a270e39 req-aac314b6-a631-46aa-b888-d20cead660ae service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Received event network-changed-7f8a9fd6-607b-48b2-be15-e45fe1c3654d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:59:35 user nova-compute[72782]: DEBUG nova.compute.manager [req-1e09da65-e21a-4406-801f-96ab7a270e39 req-aac314b6-a631-46aa-b888-d20cead660ae service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Refreshing instance network info cache due to event network-changed-7f8a9fd6-607b-48b2-be15-e45fe1c3654d. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 20:59:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1e09da65-e21a-4406-801f-96ab7a270e39 req-aac314b6-a631-46aa-b888-d20cead660ae service nova] Acquiring lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 20:59:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1e09da65-e21a-4406-801f-96ab7a270e39 req-aac314b6-a631-46aa-b888-d20cead660ae service nova] Acquired lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 20:59:35 user nova-compute[72782]: DEBUG nova.network.neutron [req-1e09da65-e21a-4406-801f-96ab7a270e39 req-aac314b6-a631-46aa-b888-d20cead660ae service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Refreshing network info cache for port 7f8a9fd6-607b-48b2-be15-e45fe1c3654d {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 20:59:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "283d9889-b930-48bd-b053-d015d24cdd0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:59:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "283d9889-b930-48bd-b053-d015d24cdd0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:59:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "283d9889-b930-48bd-b053-d015d24cdd0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:59:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "283d9889-b930-48bd-b053-d015d24cdd0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:59:35 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "283d9889-b930-48bd-b053-d015d24cdd0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:59:35 user nova-compute[72782]: INFO nova.compute.manager [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Terminating instance
Aug 14 20:59:35 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 20:59:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-8db44a7c-2a67-46b5-836f-4f9a300e105b req-fbb95615-7450-4100-b5dd-a92d9b38fe73 service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Received event network-vif-unplugged-7f8a9fd6-607b-48b2-be15-e45fe1c3654d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8db44a7c-2a67-46b5-836f-4f9a300e105b req-fbb95615-7450-4100-b5dd-a92d9b38fe73 service nova] Acquiring lock "283d9889-b930-48bd-b053-d015d24cdd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8db44a7c-2a67-46b5-836f-4f9a300e105b req-fbb95615-7450-4100-b5dd-a92d9b38fe73 service nova] Lock "283d9889-b930-48bd-b053-d015d24cdd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-8db44a7c-2a67-46b5-836f-4f9a300e105b req-fbb95615-7450-4100-b5dd-a92d9b38fe73 service nova] Lock "283d9889-b930-48bd-b053-d015d24cdd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-8db44a7c-2a67-46b5-836f-4f9a300e105b req-fbb95615-7450-4100-b5dd-a92d9b38fe73 service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] No waiting events found dispatching network-vif-unplugged-7f8a9fd6-607b-48b2-be15-e45fe1c3654d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG nova.compute.manager [req-8db44a7c-2a67-46b5-836f-4f9a300e105b req-fbb95615-7450-4100-b5dd-a92d9b38fe73 service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Received event network-vif-unplugged-7f8a9fd6-607b-48b2-be15-e45fe1c3654d for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG nova.network.neutron [req-1e09da65-e21a-4406-801f-96ab7a270e39 req-aac314b6-a631-46aa-b888-d20cead660ae service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Updated VIF entry in instance network info cache for port 7f8a9fd6-607b-48b2-be15-e45fe1c3654d. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG nova.network.neutron [req-1e09da65-e21a-4406-801f-96ab7a270e39 req-aac314b6-a631-46aa-b888-d20cead660ae service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Updating instance_info_cache with network_info: [{"id": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "address": "fa:16:3e:55:87:5a", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8a9fd6-60", "ovs_interfaceid": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-1e09da65-e21a-4406-801f-96ab7a270e39 req-aac314b6-a631-46aa-b888-d20cead660ae service nova] Releasing lock "refresh_cache-283d9889-b930-48bd-b053-d015d24cdd0e" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 20:59:36 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Instance destroyed successfully.
Aug 14 20:59:36 user nova-compute[72782]: DEBUG nova.objects.instance [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lazy-loading 'resources' on Instance uuid 283d9889-b930-48bd-b053-d015d24cdd0e {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T20:54:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1828346221',display_name='tempest-TestVolumeBootPattern-server-1828346221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1828346221',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3lDqNRM0dgyXsRQEWkWhJp1ZKddVfimacQxE2mNea9hU/c/Nvj3bT6VAIc+GOPx3eIlv853bKj9DkYcpchR/+fmz+870Kb1UY4vB0T5Az8VE5eoCMc0Dx35KUzi5xHNw==',key_name='tempest-TestVolumeBootPattern-1143441036',keypairs=<?>,launch_index=0,launched_at=2023-08-14T20:54:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a99378957e94fc6a148b06bcd9123bf',ramdisk_id='',reservation_id='r-3ecnkyh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-52337130',owner_user_name='tempest-TestVolumeBootPattern-52337130-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T20:54:50Z,user_data=None,user_id='2df6ae64c62142cfbedd244de47bdd2a',uuid=283d9889-b930-48bd-b053-d015d24cdd0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "address": "fa:16:3e:55:87:5a", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8a9fd6-60", "ovs_interfaceid": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converting VIF {"id": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "address": "fa:16:3e:55:87:5a", "network": {"id": "faf64ac9-3f9d-4560-874b-4188e2daf9dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-546974691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a99378957e94fc6a148b06bcd9123bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f8a9fd6-60", "ovs_interfaceid": "7f8a9fd6-607b-48b2-be15-e45fe1c3654d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:87:5a,bridge_name='br-int',has_traffic_filtering=True,id=7f8a9fd6-607b-48b2-be15-e45fe1c3654d,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8a9fd6-60') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_vif [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:87:5a,bridge_name='br-int',has_traffic_filtering=True,id=7f8a9fd6-607b-48b2-be15-e45fe1c3654d,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8a9fd6-60') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f8a9fd6-60, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 20:59:36 user nova-compute[72782]: INFO os_vif [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:87:5a,bridge_name='br-int',has_traffic_filtering=True,id=7f8a9fd6-607b-48b2-be15-e45fe1c3654d,network=Network(faf64ac9-3f9d-4560-874b-4188e2daf9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f8a9fd6-60')
Aug 14 20:59:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQkEUuFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 20:59:36 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eee346e-6acb-495c-aafa-5d64c9eab001]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0c463c-971a-4294-be47-5c147fc0a7b5]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)
Aug 14 20:59:36 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b (non-flash)
Aug 14 20:59:36 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f64087da170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc576788-b5b4-483e-8517-51eac4c42cf9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac31f6f9-9f98-41f6-815e-cc6eac3d1b85]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c2d5f3-851b-459a-b6cf-3245a2450b85]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8d5d9f-9270-4fb0-877f-96c72297d8b5]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26138313864643464', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_583133d6', '/dev/disk/by-id/scsi-1SCST_BIO583133d6-a818dd4dd49b13e8') {{(pid=83776) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7d8e5f-7eda-4090-8249-e627562861fa]: (4, None) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe4d8af-f217-4dc3-9933-1e05c7e1619b]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7bb640-de4c-49b5-8552-869cd7cf7d4b]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b, portal: 172.16.0.220,3260]
Aug 14 20:59:36 user nova-compute[72782]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b, portal: 172.16.0.220,3260] successful.
Aug 14 20:59:36 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4445c40-96a5-427c-9189-d47cd296b95b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd636e6-810c-4704-9b22-563928f121e6]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] <== disconnect_volume: return (286ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 20:59:36 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Deleting instance files /opt/stack/data/nova/instances/283d9889-b930-48bd-b053-d015d24cdd0e_del
Aug 14 20:59:36 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Deletion of /opt/stack/data/nova/instances/283d9889-b930-48bd-b053-d015d24cdd0e_del complete
Aug 14 20:59:36 user nova-compute[72782]: INFO nova.compute.manager [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 14 20:59:36 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 20:59:36 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 20:59:37 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 20:59:37 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Took 0.45 seconds to deallocate network for instance.
Aug 14 20:59:37 user nova-compute[72782]: DEBUG nova.compute.manager [req-5af94dbe-326d-4d16-a732-55e36a524f73 req-8d4ded9d-043c-41c7-8eed-f45afb1f99a8 service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Received event network-vif-deleted-7f8a9fd6-607b-48b2-be15-e45fe1c3654d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:59:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-ca8c73dc-ad5b-4f3b-b678-efbb9d02df80 req-91f88f88-2f1f-4dc7-89a7-7346af536cf9 service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Received event network-vif-plugged-7f8a9fd6-607b-48b2-be15-e45fe1c3654d {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 20:59:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ca8c73dc-ad5b-4f3b-b678-efbb9d02df80 req-91f88f88-2f1f-4dc7-89a7-7346af536cf9 service nova] Acquiring lock "283d9889-b930-48bd-b053-d015d24cdd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:59:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ca8c73dc-ad5b-4f3b-b678-efbb9d02df80 req-91f88f88-2f1f-4dc7-89a7-7346af536cf9 service nova] Lock "283d9889-b930-48bd-b053-d015d24cdd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:59:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-ca8c73dc-ad5b-4f3b-b678-efbb9d02df80 req-91f88f88-2f1f-4dc7-89a7-7346af536cf9 service nova] Lock "283d9889-b930-48bd-b053-d015d24cdd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:59:38 user nova-compute[72782]: DEBUG nova.compute.manager [req-ca8c73dc-ad5b-4f3b-b678-efbb9d02df80 req-91f88f88-2f1f-4dc7-89a7-7346af536cf9 service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] No waiting events found dispatching network-vif-plugged-7f8a9fd6-607b-48b2-be15-e45fe1c3654d {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 20:59:38 user nova-compute[72782]: WARNING nova.compute.manager [req-ca8c73dc-ad5b-4f3b-b678-efbb9d02df80 req-91f88f88-2f1f-4dc7-89a7-7346af536cf9 service nova] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Received unexpected event network-vif-plugged-7f8a9fd6-607b-48b2-be15-e45fe1c3654d for instance with vm_state active and task_state deleting.
Aug 14 20:59:38 user nova-compute[72782]: INFO nova.compute.manager [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Took 0.85 seconds to detach 1 volumes for instance.
Aug 14 20:59:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 20:59:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 20:59:38 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 20:59:38 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 20:59:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:59:38 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Deleted allocations for instance 283d9889-b930-48bd-b053-d015d24cdd0e
Aug 14 20:59:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f37ed7eb-b85a-4fa7-bc79-76385073f539 tempest-TestVolumeBootPattern-52337130 tempest-TestVolumeBootPattern-52337130-project-member] Lock "283d9889-b930-48bd-b053-d015d24cdd0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.728s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 20:59:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:51 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692046776.5648026, 283d9889-b930-48bd-b053-d015d24cdd0e => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 20:59:51 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] VM Stopped (Lifecycle Event)
Aug 14 20:59:51 user nova-compute[72782]: DEBUG nova.compute.manager [None req-420eb923-7b4d-49fb-b79c-9d534e44f7de None None] [instance: 283d9889-b930-48bd-b053-d015d24cdd0e] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 20:59:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:52 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:59:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:59:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 20:59:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:59:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 20:59:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 20:59:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 20:59:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 21:00:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:00:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:00:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:00:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:00:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:00:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:00:00 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:00:00 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:00:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8873MB free_disk=25.25722885131836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:00:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:00:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:00:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:00:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:00:00 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:00:00 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:00:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:00:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:00:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:00:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:00:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:00:05 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:00:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:00:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:00:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:00:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:00:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:00:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:00:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:00:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:00:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:00:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:00:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:00:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:00:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:00:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:00:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:00:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:00:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:00:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:00:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:00:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:00:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:00:54 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:00:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:00:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:00:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:00:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 21:00:58 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 21:01:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:01:00 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:01:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:01:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:01:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:01:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:01:00 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:01:00 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:01:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8870MB free_disk=25.255416870117188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:01:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:01:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:01:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:01:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:01:00 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:01:00 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:01:00 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:01:00 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.120s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:01:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:01:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:01:03 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:01:03 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:01:05 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:01:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:01:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:01:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:01:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:01:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:01:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:01:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:01:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:01:38 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:01:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:01:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:01:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:01:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:01:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:01:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:01:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:01:54 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:01:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:01:55 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:01:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:01:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:01:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:01:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:01:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 21:01:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 21:01:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:02:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:02:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:02:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Starting instance... {{(pid=72782) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 21:02:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:02:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:02:01 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72782) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 21:02:01 user nova-compute[72782]: INFO nova.compute.claims [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Claim successful on node user
Aug 14 21:02:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Refreshing inventories for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Updating ProviderTree inventory for provider d26c9e3b-40e6-476e-9664-3119ebf5873b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Refreshing aggregate associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, aggregates: None {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Refreshing trait associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Start building networks asynchronously for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.315s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Allocating IP information in the background. {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] allocate_for_instance() {{(pid=72782) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 21:02:02 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 21:02:02 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:02:02 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:02:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8542MB free_disk=25.241859436035156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:02:02 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Start building block device mappings for instance. {{(pid=72782) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG nova.policy [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ace46fe05894914aa69b8f136a95dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80815a8259274d9f815b9eb918c090bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72782) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2325cf86-9132-4b69-8816-699cf95ba206 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Start spawning the instance on the hypervisor. {{(pid=72782) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Creating instance directory {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 21:02:03 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Creating image(s)
Aug 14 21:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "/opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "/opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "/opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.214s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.230s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk 1073741824 {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7,backing_fmt=raw /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk 1073741824" returned: 0 in 0.055s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "8990fad913cce9ee17eada141a5bf50d30e51dd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Successfully created port: f225adee-9471-44e5-b750-743f1177a159 {{(pid=72782) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7 --force-share --output=json" returned: 0 in 0.193s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk. size=1073741824 {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 21:02:03 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:02:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:02:04 user nova-compute[72782]: DEBUG nova.virt.disk.api [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Cannot resize image /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk to a smaller size. {{(pid=72782) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 21:02:04 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lazy-loading 'migration_context' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:02:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Created local disks {{(pid=72782) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 21:02:04 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Ensure instance console log exists: /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/console.log {{(pid=72782) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 21:02:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:02:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:02:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:02:04 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Successfully updated port: f225adee-9471-44e5-b750-743f1177a159 {{(pid=72782) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 21:02:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:02:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquired lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:02:04 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Building network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 21:02:04 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Instance cache missing network info. {{(pid=72782) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 21:02:04 user nova-compute[72782]: DEBUG nova.compute.manager [req-502fc8cc-96ef-4f52-aac1-3a1171000fb3 req-1fb6622e-568c-45ff-97f6-397b96c27b4e service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Received event network-changed-f225adee-9471-44e5-b750-743f1177a159 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:02:04 user nova-compute[72782]: DEBUG nova.compute.manager [req-502fc8cc-96ef-4f52-aac1-3a1171000fb3 req-1fb6622e-568c-45ff-97f6-397b96c27b4e service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Refreshing instance network info cache due to event network-changed-f225adee-9471-44e5-b750-743f1177a159. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:02:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-502fc8cc-96ef-4f52-aac1-3a1171000fb3 req-1fb6622e-568c-45ff-97f6-397b96c27b4e service nova] Acquiring lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.network.neutron [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updating instance_info_cache with network_info: [{"id": "f225adee-9471-44e5-b750-743f1177a159", "address": "fa:16:3e:b9:5c:87", "network": {"id": "4a9b5df8-18d8-4299-ac5b-3437f61d36ce", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1013460700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80815a8259274d9f815b9eb918c090bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf225adee-94", "ovs_interfaceid": "f225adee-9471-44e5-b750-743f1177a159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Releasing lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Instance network_info: |[{"id": "f225adee-9471-44e5-b750-743f1177a159", "address": "fa:16:3e:b9:5c:87", "network": {"id": "4a9b5df8-18d8-4299-ac5b-3437f61d36ce", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1013460700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80815a8259274d9f815b9eb918c090bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf225adee-94", "ovs_interfaceid": "f225adee-9471-44e5-b750-743f1177a159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72782) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-502fc8cc-96ef-4f52-aac1-3a1171000fb3 req-1fb6622e-568c-45ff-97f6-397b96c27b4e service nova] Acquired lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.network.neutron [req-502fc8cc-96ef-4f52-aac1-3a1171000fb3 req-1fb6622e-568c-45ff-97f6-397b96c27b4e service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Refreshing network info cache for port f225adee-9471-44e5-b750-743f1177a159 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Start _get_guest_xml network_info=[{"id": "f225adee-9471-44e5-b750-743f1177a159", "address": "fa:16:3e:b9:5c:87", "network": {"id": "4a9b5df8-18d8-4299-ac5b-3437f61d36ce", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1013460700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80815a8259274d9f815b9eb918c090bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf225adee-94", "ovs_interfaceid": "f225adee-9471-44e5-b750-743f1177a159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'image_id': '450d2d82-4a73-4a35-bff3-71ddab4bfe0e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 21:02:05 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:02:05 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] CPU controller missing on host. {{(pid=72782) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.host [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] CPU controller found on host. {{(pid=72782) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72782) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T19:41:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T19:41:12Z,direct_url=<?>,disk_format='qcow2',id=450d2d82-4a73-4a35-bff3-71ddab4bfe0e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='3d33562bad004467893841e90a8b6160',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T19:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Flavor limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Image limits 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Flavor pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Image pref 0:0:0 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Got 1 possible topologies {{(pid=72782) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.hardware [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72782) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-847184248',display_name='tempest-SnapshotDataIntegrityTests-server-847184248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-847184248',id=53,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTnt29l2LloOWBXVY79reemM1EI7siBNX7cJDeJ9p0o9yU+7uZ6mBIN/12bWUPakOdcFmxNkdHBVo9kxXwHhMvsBt8lGudGPbV6rlUdnBNSnUnyiMsZASVU5YMOMB/Ktg==',key_name='tempest-keypair-1528289917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80815a8259274d9f815b9eb918c090bf',ramdisk_id='',reservation_id='r-80rko84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1771369058',owner_user_name='tempest-SnapshotDataIntegrityTests-1771369058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:02:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ace46fe05894914aa69b8f136a95dd7',uuid=2325cf86-9132-4b69-8816-699cf95ba206,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f225adee-9471-44e5-b750-743f1177a159", "address": "fa:16:3e:b9:5c:87", "network": {"id": "4a9b5df8-18d8-4299-ac5b-3437f61d36ce", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1013460700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80815a8259274d9f815b9eb918c090bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf225adee-94", "ovs_interfaceid": "f225adee-9471-44e5-b750-743f1177a159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72782) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Converting VIF {"id": "f225adee-9471-44e5-b750-743f1177a159", "address": "fa:16:3e:b9:5c:87", "network": {"id": "4a9b5df8-18d8-4299-ac5b-3437f61d36ce", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1013460700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80815a8259274d9f815b9eb918c090bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf225adee-94", "ovs_interfaceid": "f225adee-9471-44e5-b750-743f1177a159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:5c:87,bridge_name='br-int',has_traffic_filtering=True,id=f225adee-9471-44e5-b750-743f1177a159,network=Network(4a9b5df8-18d8-4299-ac5b-3437f61d36ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf225adee-94') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lazy-loading 'pci_devices' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] End _get_guest_xml xml=<domain type="kvm">
Aug 14 21:02:05 user nova-compute[72782]:   <uuid>2325cf86-9132-4b69-8816-699cf95ba206</uuid>
Aug 14 21:02:05 user nova-compute[72782]:   <name>instance-00000035</name>
Aug 14 21:02:05 user nova-compute[72782]:   <memory>524288</memory>
Aug 14 21:02:05 user nova-compute[72782]:   <vcpu>1</vcpu>
Aug 14 21:02:05 user nova-compute[72782]:   <metadata>
Aug 14 21:02:05 user nova-compute[72782]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 21:02:05 user nova-compute[72782]:       <nova:package version="0.0.0"/>
Aug 14 21:02:05 user nova-compute[72782]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-847184248</nova:name>
Aug 14 21:02:05 user nova-compute[72782]:       <nova:creationTime>2023-08-14 21:02:05</nova:creationTime>
Aug 14 21:02:05 user nova-compute[72782]:       <nova:flavor name="m1.tiny">
Aug 14 21:02:05 user nova-compute[72782]:         <nova:memory>512</nova:memory>
Aug 14 21:02:05 user nova-compute[72782]:         <nova:disk>1</nova:disk>
Aug 14 21:02:05 user nova-compute[72782]:         <nova:swap>0</nova:swap>
Aug 14 21:02:05 user nova-compute[72782]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 21:02:05 user nova-compute[72782]:         <nova:vcpus>1</nova:vcpus>
Aug 14 21:02:05 user nova-compute[72782]:       </nova:flavor>
Aug 14 21:02:05 user nova-compute[72782]:       <nova:owner>
Aug 14 21:02:05 user nova-compute[72782]:         <nova:user uuid="9ace46fe05894914aa69b8f136a95dd7">tempest-SnapshotDataIntegrityTests-1771369058-project-member</nova:user>
Aug 14 21:02:05 user nova-compute[72782]:         <nova:project uuid="80815a8259274d9f815b9eb918c090bf">tempest-SnapshotDataIntegrityTests-1771369058</nova:project>
Aug 14 21:02:05 user nova-compute[72782]:       </nova:owner>
Aug 14 21:02:05 user nova-compute[72782]:       <nova:root type="image" uuid="450d2d82-4a73-4a35-bff3-71ddab4bfe0e"/>
Aug 14 21:02:05 user nova-compute[72782]:       <nova:ports>
Aug 14 21:02:05 user nova-compute[72782]:         <nova:port uuid="f225adee-9471-44e5-b750-743f1177a159">
Aug 14 21:02:05 user nova-compute[72782]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 21:02:05 user nova-compute[72782]:         </nova:port>
Aug 14 21:02:05 user nova-compute[72782]:       </nova:ports>
Aug 14 21:02:05 user nova-compute[72782]:     </nova:instance>
Aug 14 21:02:05 user nova-compute[72782]:   </metadata>
Aug 14 21:02:05 user nova-compute[72782]:   <sysinfo type="smbios">
Aug 14 21:02:05 user nova-compute[72782]:     <system>
Aug 14 21:02:05 user nova-compute[72782]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 21:02:05 user nova-compute[72782]:       <entry name="product">OpenStack Nova</entry>
Aug 14 21:02:05 user nova-compute[72782]:       <entry name="version">0.0.0</entry>
Aug 14 21:02:05 user nova-compute[72782]:       <entry name="serial">2325cf86-9132-4b69-8816-699cf95ba206</entry>
Aug 14 21:02:05 user nova-compute[72782]:       <entry name="uuid">2325cf86-9132-4b69-8816-699cf95ba206</entry>
Aug 14 21:02:05 user nova-compute[72782]:       <entry name="family">Virtual Machine</entry>
Aug 14 21:02:05 user nova-compute[72782]:     </system>
Aug 14 21:02:05 user nova-compute[72782]:   </sysinfo>
Aug 14 21:02:05 user nova-compute[72782]:   <os>
Aug 14 21:02:05 user nova-compute[72782]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 21:02:05 user nova-compute[72782]:     <boot dev="hd"/>
Aug 14 21:02:05 user nova-compute[72782]:     <smbios mode="sysinfo"/>
Aug 14 21:02:05 user nova-compute[72782]:   </os>
Aug 14 21:02:05 user nova-compute[72782]:   <features>
Aug 14 21:02:05 user nova-compute[72782]:     <acpi/>
Aug 14 21:02:05 user nova-compute[72782]:     <apic/>
Aug 14 21:02:05 user nova-compute[72782]:     <vmcoreinfo/>
Aug 14 21:02:05 user nova-compute[72782]:   </features>
Aug 14 21:02:05 user nova-compute[72782]:   <clock offset="utc">
Aug 14 21:02:05 user nova-compute[72782]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 21:02:05 user nova-compute[72782]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 21:02:05 user nova-compute[72782]:     <timer name="hpet" present="no"/>
Aug 14 21:02:05 user nova-compute[72782]:   </clock>
Aug 14 21:02:05 user nova-compute[72782]:   <cpu mode="custom" match="exact">
Aug 14 21:02:05 user nova-compute[72782]:     <model>Nehalem</model>
Aug 14 21:02:05 user nova-compute[72782]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 21:02:05 user nova-compute[72782]:   </cpu>
Aug 14 21:02:05 user nova-compute[72782]:   <devices>
Aug 14 21:02:05 user nova-compute[72782]:     <disk type="file" device="disk">
Aug 14 21:02:05 user nova-compute[72782]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 21:02:05 user nova-compute[72782]:       <source file="/opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk"/>
Aug 14 21:02:05 user nova-compute[72782]:       <target dev="vda" bus="virtio"/>
Aug 14 21:02:05 user nova-compute[72782]:     </disk>
Aug 14 21:02:05 user nova-compute[72782]:     <interface type="ethernet">
Aug 14 21:02:05 user nova-compute[72782]:       <mac address="fa:16:3e:b9:5c:87"/>
Aug 14 21:02:05 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 21:02:05 user nova-compute[72782]:       <mtu size="1442"/>
Aug 14 21:02:05 user nova-compute[72782]:       <target dev="tapf225adee-94"/>
Aug 14 21:02:05 user nova-compute[72782]:     </interface>
Aug 14 21:02:05 user nova-compute[72782]:     <serial type="pty">
Aug 14 21:02:05 user nova-compute[72782]:       <log file="/opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/console.log" append="off"/>
Aug 14 21:02:05 user nova-compute[72782]:     </serial>
Aug 14 21:02:05 user nova-compute[72782]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 21:02:05 user nova-compute[72782]:     <video>
Aug 14 21:02:05 user nova-compute[72782]:       <model type="virtio"/>
Aug 14 21:02:05 user nova-compute[72782]:     </video>
Aug 14 21:02:05 user nova-compute[72782]:     <rng model="virtio">
Aug 14 21:02:05 user nova-compute[72782]:       <backend model="random">/dev/urandom</backend>
Aug 14 21:02:05 user nova-compute[72782]:     </rng>
Aug 14 21:02:05 user nova-compute[72782]:     <controller type="usb" index="0" model="none"/>
Aug 14 21:02:05 user nova-compute[72782]:     <memballoon model="virtio">
Aug 14 21:02:05 user nova-compute[72782]:       <stats period="10"/>
Aug 14 21:02:05 user nova-compute[72782]:     </memballoon>
Aug 14 21:02:05 user nova-compute[72782]:   </devices>
Aug 14 21:02:05 user nova-compute[72782]: </domain>
Aug 14 21:02:05 user nova-compute[72782]:  {{(pid=72782) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-847184248',display_name='tempest-SnapshotDataIntegrityTests-server-847184248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-847184248',id=53,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTnt29l2LloOWBXVY79reemM1EI7siBNX7cJDeJ9p0o9yU+7uZ6mBIN/12bWUPakOdcFmxNkdHBVo9kxXwHhMvsBt8lGudGPbV6rlUdnBNSnUnyiMsZASVU5YMOMB/Ktg==',key_name='tempest-keypair-1528289917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80815a8259274d9f815b9eb918c090bf',ramdisk_id='',reservation_id='r-80rko84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1771369058',owner_user_name='tempest-SnapshotDataIntegrityTests-1771369058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T21:02:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ace46fe05894914aa69b8f136a95dd7',uuid=2325cf86-9132-4b69-8816-699cf95ba206,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f225adee-9471-44e5-b750-743f1177a159", "address": "fa:16:3e:b9:5c:87", "network": {"id": "4a9b5df8-18d8-4299-ac5b-3437f61d36ce", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1013460700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80815a8259274d9f815b9eb918c090bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf225adee-94", "ovs_interfaceid": "f225adee-9471-44e5-b750-743f1177a159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Converting VIF {"id": "f225adee-9471-44e5-b750-743f1177a159", "address": "fa:16:3e:b9:5c:87", "network": {"id": "4a9b5df8-18d8-4299-ac5b-3437f61d36ce", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1013460700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80815a8259274d9f815b9eb918c090bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf225adee-94", "ovs_interfaceid": "f225adee-9471-44e5-b750-743f1177a159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:5c:87,bridge_name='br-int',has_traffic_filtering=True,id=f225adee-9471-44e5-b750-743f1177a159,network=Network(4a9b5df8-18d8-4299-ac5b-3437f61d36ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf225adee-94') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG os_vif [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:5c:87,bridge_name='br-int',has_traffic_filtering=True,id=f225adee-9471-44e5-b750-743f1177a159,network=Network(4a9b5df8-18d8-4299-ac5b-3437f61d36ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf225adee-94') {{(pid=72782) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf225adee-94, may_exist=True, interface_attrs={}) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf225adee-94, col_values=(('external_ids', {'iface-id': 'f225adee-9471-44e5-b750-743f1177a159', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:5c:87', 'vm-uuid': '2325cf86-9132-4b69-8816-699cf95ba206'}),), if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:05 user nova-compute[72782]: INFO os_vif [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:5c:87,bridge_name='br-int',has_traffic_filtering=True,id=f225adee-9471-44e5-b750-743f1177a159,network=Network(4a9b5df8-18d8-4299-ac5b-3437f61d36ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf225adee-94')
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] No VIF found with MAC fa:16:3e:b9:5c:87, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.network.neutron [req-502fc8cc-96ef-4f52-aac1-3a1171000fb3 req-1fb6622e-568c-45ff-97f6-397b96c27b4e service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updated VIF entry in instance network info cache for port f225adee-9471-44e5-b750-743f1177a159. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG nova.network.neutron [req-502fc8cc-96ef-4f52-aac1-3a1171000fb3 req-1fb6622e-568c-45ff-97f6-397b96c27b4e service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updating instance_info_cache with network_info: [{"id": "f225adee-9471-44e5-b750-743f1177a159", "address": "fa:16:3e:b9:5c:87", "network": {"id": "4a9b5df8-18d8-4299-ac5b-3437f61d36ce", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1013460700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80815a8259274d9f815b9eb918c090bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf225adee-94", "ovs_interfaceid": "f225adee-9471-44e5-b750-743f1177a159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:02:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-502fc8cc-96ef-4f52-aac1-3a1171000fb3 req-1fb6622e-568c-45ff-97f6-397b96c27b4e service nova] Releasing lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:02:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:02:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:02:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:02:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:07 user nova-compute[72782]: DEBUG nova.compute.manager [req-dd4df9d9-7e56-4cc8-aaef-7169b6b0e43b req-44b81fa4-624b-40bc-a935-db9909c6f522 service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Received event network-vif-plugged-f225adee-9471-44e5-b750-743f1177a159 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:02:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-dd4df9d9-7e56-4cc8-aaef-7169b6b0e43b req-44b81fa4-624b-40bc-a935-db9909c6f522 service nova] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:02:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-dd4df9d9-7e56-4cc8-aaef-7169b6b0e43b req-44b81fa4-624b-40bc-a935-db9909c6f522 service nova] Lock "2325cf86-9132-4b69-8816-699cf95ba206-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:02:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-dd4df9d9-7e56-4cc8-aaef-7169b6b0e43b req-44b81fa4-624b-40bc-a935-db9909c6f522 service nova] Lock "2325cf86-9132-4b69-8816-699cf95ba206-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:02:07 user nova-compute[72782]: DEBUG nova.compute.manager [req-dd4df9d9-7e56-4cc8-aaef-7169b6b0e43b req-44b81fa4-624b-40bc-a935-db9909c6f522 service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] No waiting events found dispatching network-vif-plugged-f225adee-9471-44e5-b750-743f1177a159 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:02:07 user nova-compute[72782]: WARNING nova.compute.manager [req-dd4df9d9-7e56-4cc8-aaef-7169b6b0e43b req-44b81fa4-624b-40bc-a935-db9909c6f522 service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Received unexpected event network-vif-plugged-f225adee-9471-44e5-b750-743f1177a159 for instance with vm_state building and task_state spawning.
Aug 14 21:02:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:07 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:09 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:02:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:09 user nova-compute[72782]: DEBUG nova.compute.manager [req-4058c478-eb0e-4bf1-b830-2c3be03610fe req-9a4c9a16-e690-4b96-aa60-d8f3a37b71f1 service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Received event network-vif-plugged-f225adee-9471-44e5-b750-743f1177a159 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:02:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4058c478-eb0e-4bf1-b830-2c3be03610fe req-9a4c9a16-e690-4b96-aa60-d8f3a37b71f1 service nova] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:02:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4058c478-eb0e-4bf1-b830-2c3be03610fe req-9a4c9a16-e690-4b96-aa60-d8f3a37b71f1 service nova] Lock "2325cf86-9132-4b69-8816-699cf95ba206-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:02:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-4058c478-eb0e-4bf1-b830-2c3be03610fe req-9a4c9a16-e690-4b96-aa60-d8f3a37b71f1 service nova] Lock "2325cf86-9132-4b69-8816-699cf95ba206-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:02:09 user nova-compute[72782]: DEBUG nova.compute.manager [req-4058c478-eb0e-4bf1-b830-2c3be03610fe req-9a4c9a16-e690-4b96-aa60-d8f3a37b71f1 service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] No waiting events found dispatching network-vif-plugged-f225adee-9471-44e5-b750-743f1177a159 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:02:09 user nova-compute[72782]: WARNING nova.compute.manager [req-4058c478-eb0e-4bf1-b830-2c3be03610fe req-9a4c9a16-e690-4b96-aa60-d8f3a37b71f1 service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Received unexpected event network-vif-plugged-f225adee-9471-44e5-b750-743f1177a159 for instance with vm_state building and task_state spawning.
Aug 14 21:02:09 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692046929.3660257, 2325cf86-9132-4b69-8816-699cf95ba206 => Resumed> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:02:09 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] VM Resumed (Lifecycle Event)
Aug 14 21:02:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Instance event wait completed in 0 seconds for  {{(pid=72782) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 21:02:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Guest created on hypervisor {{(pid=72782) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 21:02:09 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Instance spawned successfully.
Aug 14 21:02:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 21:02:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:02:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:02:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Found default for hw_cdrom_bus of ide {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:02:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Found default for hw_disk_bus of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:02:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Found default for hw_input_bus of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:02:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Found default for hw_pointer_model of None {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:02:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Found default for hw_video_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:02:09 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Found default for hw_vif_model of virtio {{(pid=72782) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 21:02:09 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:02:09 user nova-compute[72782]: DEBUG nova.virt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Emitting event <LifecycleEvent: 1692046929.3679872, 2325cf86-9132-4b69-8816-699cf95ba206 => Started> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:02:09 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] VM Started (Lifecycle Event)
Aug 14 21:02:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:02:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72782) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 21:02:09 user nova-compute[72782]: INFO nova.compute.manager [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 21:02:09 user nova-compute[72782]: INFO nova.compute.manager [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Took 6.50 seconds to spawn the instance on the hypervisor.
Aug 14 21:02:09 user nova-compute[72782]: DEBUG nova.compute.manager [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:02:09 user nova-compute[72782]: INFO nova.compute.manager [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Took 7.80 seconds to build instance.
Aug 14 21:02:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4f24c7e9-d40f-4550-9a68-a758fa736b94 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.908s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:02:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:11 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:02:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:19 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:02:19 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 21:02:19 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] There are 0 instances to clean {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 21:02:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:23 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:02:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:41 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:02:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:02:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:02:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.041s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:02:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:02:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:02:41 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.005s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:02:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Verify base images {{(pid=72782) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 14 21:02:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Image id 450d2d82-4a73-4a35-bff3-71ddab4bfe0e yields fingerprint 8990fad913cce9ee17eada141a5bf50d30e51dd7 {{(pid=72782) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 14 21:02:41 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] image 450d2d82-4a73-4a35-bff3-71ddab4bfe0e at (/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7): checking
Aug 14 21:02:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] image 450d2d82-4a73-4a35-bff3-71ddab4bfe0e at (/opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7): image is in use {{(pid=72782) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 14 21:02:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72782) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 14 21:02:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] 2325cf86-9132-4b69-8816-699cf95ba206 is a valid instance name {{(pid=72782) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 14 21:02:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] 2325cf86-9132-4b69-8816-699cf95ba206 has a disk file {{(pid=72782) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 14 21:02:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:02:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:02:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2325cf86-9132-4b69-8816-699cf95ba206 is backed by 8990fad913cce9ee17eada141a5bf50d30e51dd7 {{(pid=72782) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 14 21:02:41 user nova-compute[72782]: WARNING nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Unknown base file: /opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c
Aug 14 21:02:41 user nova-compute[72782]: WARNING nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1b064ad33aca857b6604904004add257f9390c7f
Aug 14 21:02:41 user nova-compute[72782]: WARNING nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c
Aug 14 21:02:41 user nova-compute[72782]: WARNING nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Unknown base file: /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719
Aug 14 21:02:41 user nova-compute[72782]: WARNING nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65
Aug 14 21:02:41 user nova-compute[72782]: WARNING nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Unknown base file: /opt/stack/data/nova/instances/_base/124cf09669d2c652a7e47d3f9894d52c12c78248
Aug 14 21:02:41 user nova-compute[72782]: WARNING nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37
Aug 14 21:02:41 user nova-compute[72782]: WARNING nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1
Aug 14 21:02:41 user nova-compute[72782]: WARNING nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Unknown base file: /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f
Aug 14 21:02:41 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Active base files: /opt/stack/data/nova/instances/_base/8990fad913cce9ee17eada141a5bf50d30e51dd7
Aug 14 21:02:41 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Removable base files: /opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c /opt/stack/data/nova/instances/_base/1b064ad33aca857b6604904004add257f9390c7f /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719 /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65 /opt/stack/data/nova/instances/_base/124cf09669d2c652a7e47d3f9894d52c12c78248 /opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37 /opt/stack/data/nova/instances/_base/e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1 /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f
Aug 14 21:02:41 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/82cd5b17a612011434277ceb66e2e257753aca6c
Aug 14 21:02:41 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1b064ad33aca857b6604904004add257f9390c7f
Aug 14 21:02:41 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1935faec8c79bbe8ab47c54066dab112a958bf3c
Aug 14 21:02:41 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/793afb69c72aa4ff9ed612867f10698cbb92a719
Aug 14 21:02:41 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e68f4278b71f57223a2d19d5d6452607d94b2e65
Aug 14 21:02:41 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/124cf09669d2c652a7e47d3f9894d52c12c78248
Aug 14 21:02:41 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c7a73938604df90d7bb825f338818817a5834b37
Aug 14 21:02:41 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e3dc9ac2fdcbf3059dfcf6303c425d4d63bc0ed1
Aug 14 21:02:41 user nova-compute[72782]: INFO nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/79602d575bcce32d6d5315b4ef0c73f7a85a007f
Aug 14 21:02:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Verification complete {{(pid=72782) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 14 21:02:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Verify swap images {{(pid=72782) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 14 21:02:41 user nova-compute[72782]: DEBUG nova.virt.libvirt.imagecache [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Verify ephemeral images {{(pid=72782) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 14 21:02:43 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:53 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:02:53 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Triggering sync for uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 21:02:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:02:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "2325cf86-9132-4b69-8816-699cf95ba206" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:02:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "2325cf86-9132-4b69-8816-699cf95ba206" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:02:55 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:02:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:02:56 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:02:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:02:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:02:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 21:02:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:02:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:02:59 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:02:59 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:02:59 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updating instance_info_cache with network_info: [{"id": "f225adee-9471-44e5-b750-743f1177a159", "address": "fa:16:3e:b9:5c:87", "network": {"id": "4a9b5df8-18d8-4299-ac5b-3437f61d36ce", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1013460700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80815a8259274d9f815b9eb918c090bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf225adee-94", "ovs_interfaceid": "f225adee-9471-44e5-b750-743f1177a159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:02:59 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:02:59 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:03:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:03:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:03:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:03:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:03:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:03:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:03:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:03:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:03:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:03:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:03:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:03:02 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:03:02 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:03:02 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:03:02 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8654MB free_disk=25.20144271850586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:03:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:03:02 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:03:03 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2325cf86-9132-4b69-8816-699cf95ba206 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:03:03 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:03:03 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:03:03 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:03:03 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:03:03 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:03:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:03:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:03:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:03:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:03:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:03:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:03:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72782) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 21:03:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:03:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:03:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:03:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:03:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:03:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:03:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:03:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:03:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:03:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:03:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:03:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:03:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:03:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:03:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:03:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:03:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:03:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:03:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:03:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:03:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:03:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:03:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:03:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:03:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:03:53 user nova-compute[72782]: DEBUG nova.compute.manager [req-80be2bce-24d5-4329-a8cf-e2548f77d0cd req-7c1fd7dc-c79a-4cfc-ad16-fbfdfef8f494 service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Received event network-changed-f225adee-9471-44e5-b750-743f1177a159 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:03:53 user nova-compute[72782]: DEBUG nova.compute.manager [req-80be2bce-24d5-4329-a8cf-e2548f77d0cd req-7c1fd7dc-c79a-4cfc-ad16-fbfdfef8f494 service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Refreshing instance network info cache due to event network-changed-f225adee-9471-44e5-b750-743f1177a159. {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 21:03:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-80be2bce-24d5-4329-a8cf-e2548f77d0cd req-7c1fd7dc-c79a-4cfc-ad16-fbfdfef8f494 service nova] Acquiring lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:03:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-80be2bce-24d5-4329-a8cf-e2548f77d0cd req-7c1fd7dc-c79a-4cfc-ad16-fbfdfef8f494 service nova] Acquired lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:03:53 user nova-compute[72782]: DEBUG nova.network.neutron [req-80be2bce-24d5-4329-a8cf-e2548f77d0cd req-7c1fd7dc-c79a-4cfc-ad16-fbfdfef8f494 service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Refreshing network info cache for port f225adee-9471-44e5-b750-743f1177a159 {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 21:03:53 user nova-compute[72782]: DEBUG nova.network.neutron [req-80be2bce-24d5-4329-a8cf-e2548f77d0cd req-7c1fd7dc-c79a-4cfc-ad16-fbfdfef8f494 service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updated VIF entry in instance network info cache for port f225adee-9471-44e5-b750-743f1177a159. {{(pid=72782) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 21:03:53 user nova-compute[72782]: DEBUG nova.network.neutron [req-80be2bce-24d5-4329-a8cf-e2548f77d0cd req-7c1fd7dc-c79a-4cfc-ad16-fbfdfef8f494 service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updating instance_info_cache with network_info: [{"id": "f225adee-9471-44e5-b750-743f1177a159", "address": "fa:16:3e:b9:5c:87", "network": {"id": "4a9b5df8-18d8-4299-ac5b-3437f61d36ce", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1013460700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80815a8259274d9f815b9eb918c090bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf225adee-94", "ovs_interfaceid": "f225adee-9471-44e5-b750-743f1177a159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:03:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-80be2bce-24d5-4329-a8cf-e2548f77d0cd req-7c1fd7dc-c79a-4cfc-ad16-fbfdfef8f494 service nova] Releasing lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:03:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:03:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:03:56 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:03:56 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG nova.objects.instance [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lazy-loading 'flavor' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:03:57 user nova-compute[72782]: INFO nova.compute.manager [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Attaching volume 6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 to /dev/vdb
Aug 14 21:03:57 user nova-compute[72782]: DEBUG os_brick.utils [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8061bb4-1e38-43a0-894e-53e9db346e1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1395d5de-dd08-4776-9271-b9db5c491f56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab840353-43d7-4e7a-96c4-1265657691e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa64c4b6-1127-4e0b-b4a4-1d3823d2e7b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:03:57 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:03:57 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e53f66c-9c3f-45c5-b1ab-58d16ff4297f]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG os_brick.utils [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:03:57 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updating existing volume attachment record: a16619a3-e4a6-4402-a948-bdc04abcc432 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:03:59 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:04:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:04:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 21:04:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:04:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:04:01 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:04:01 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:04:01 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updating instance_info_cache with network_info: [{"id": "f225adee-9471-44e5-b750-743f1177a159", "address": "fa:16:3e:b9:5c:87", "network": {"id": "4a9b5df8-18d8-4299-ac5b-3437f61d36ce", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1013460700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80815a8259274d9f815b9eb918c090bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf225adee-94", "ovs_interfaceid": "f225adee-9471-44e5-b750-743f1177a159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:04:01 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:04:01 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:04:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:04:03 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:04:04 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:04:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:04:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:04:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:04:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:04:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:04 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:04 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:04 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:04:04 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:04:04 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8693MB free_disk=25.20014190673828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:04:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:04:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:04:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2325cf86-9132-4b69-8816-699cf95ba206 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:04:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:04:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:04:05 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:04:05 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:04:05 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:04:05 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:04:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npiScWkT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:04:06 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:04:06 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:04:06 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfe943b-e3a8-4214-a24e-b6dc32d5636f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:04:06 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6490bbaa-40ef-4127-aeb8-1e95c664841e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7] added
Aug 14 21:04:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca0900a-e234-4dcd-a588-7efab8821fba]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0da2366-63b0-486a-bf2f-47bfff2e8de7]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npiScWkT {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npiScWkT" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe10c63-2dc1-4672-9717-583f30892ef7]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'npiScWkT'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2073507e-c045-4001-90f6-1ff93274ccc7]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[78470bc5-8543-4924-ba63-3eaf0fbd1459]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 21:04:06 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 21:04:06 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:04:06 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 21:04:06 user nova-compute[72782]: 
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[beddf4e9-ba22-43e2-9ca0-f3a132a72e17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7, portal: 172.16.0.220,3260]
Aug 14 21:04:06 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7, portal: 172.16.0.220,3260] successful.
Aug 14 21:04:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb88517-dfc3-49d5-abbc-e23b10a95721]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d027dbc4-c2e3-4aca-a916-77fc475e1fbc]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 (non-flash)
Aug 14 21:04:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 (non-flash)
Aug 14 21:04:06 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c90b78-a80e-4116-bae8-160689541104]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:04:06 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npiScWkT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:04:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:04:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:04:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:04:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:04:07 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23763386632663566', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:04:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763386632663566', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:04:07 user nova-compute[72782]: DEBUG nova.objects.instance [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lazy-loading 'flavor' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:04:07 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:04:07 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:04:07 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 21:04:07 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:04:07 user nova-compute[72782]:   <serial>6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7</serial>
Aug 14 21:04:07 user nova-compute[72782]: </disk>
Aug 14 21:04:07 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:04:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:04:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:04:08 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] No VIF found with MAC fa:16:3e:b9:5c:87, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:04:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8b7278ab-8594-42fc-8d4e-a2297291659f tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.572s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:04:09 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:04:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:12 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:04:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:24 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:04:31 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:04:31 user nova-compute[72782]: INFO nova.compute.manager [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Detaching volume 6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7
Aug 14 21:04:32 user nova-compute[72782]: INFO nova.virt.block_device [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Attempting to driver detach volume 6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 from mountpoint /dev/vdb
Aug 14 21:04:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Attempting to detach device vdb from instance 2325cf86-9132-4b69-8816-699cf95ba206 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:04:32 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:04:32 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 21:04:32 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:04:32 user nova-compute[72782]:   <serial>6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7</serial>
Aug 14 21:04:32 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:04:32 user nova-compute[72782]: </disk>
Aug 14 21:04:32 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:04:32 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Successfully detached device vdb from instance 2325cf86-9132-4b69-8816-699cf95ba206 from the persistent domain config.
Aug 14 21:04:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2325cf86-9132-4b69-8816-699cf95ba206 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:04:32 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:04:32 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 21:04:32 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:04:32 user nova-compute[72782]:   <serial>6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7</serial>
Aug 14 21:04:32 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:04:32 user nova-compute[72782]: </disk>
Aug 14 21:04:32 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692047072.4745321, 2325cf86-9132-4b69-8816-699cf95ba206 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:04:32 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Successfully detached device vdb from instance 2325cf86-9132-4b69-8816-699cf95ba206 from the live domain config.
Aug 14 21:04:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npiScWkT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:04:32 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:04:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1735c4-0a37-4ad3-be1c-cb5fc7289c2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f73dd08-b997-4559-852b-328806edbdb7]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 (non-flash)
Aug 14 21:04:32 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 (non-flash)
Aug 14 21:04:32 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6410ed6950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81353f2-1050-42ec-980a-6727b54dbbee]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eec39a6-d763-4770-8d7d-aa2dbaf845f7]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b818f9b3-e0d4-4822-8acb-62ea0302c996]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[21af7a01-d3f3-4494-b0a1-1a13a346c597]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac19ad16-f957-4b4c-b4fe-6b588097e8c5]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4d6c08-ea02-4132-9497-159a78cfe1e3]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7, portal: 172.16.0.220,3260]
Aug 14 21:04:32 user nova-compute[72782]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7, portal: 172.16.0.220,3260] successful.
Aug 14 21:04:32 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6fbe3e02-436a-4a95-aa8b-320a1bf4a5c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[362ddcf0-c08c-44b6-852d-5ea248b17f89]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] <== disconnect_volume: return (265ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:04:32 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:04:33 user nova-compute[72782]: DEBUG nova.objects.instance [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lazy-loading 'flavor' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:04:33 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-236925f2-db66-407a-9c69-f2365fa267d4 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.619s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:04:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:04:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:04:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:04:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:04:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:04:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:04:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:04:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:04:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:04:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:04:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:04:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:04:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:04:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:04:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:04:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:04:56 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:04:57 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:05:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:05:03 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:05:03 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:05:03 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 21:05:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:05:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:05:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:05:03 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:05:03 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updating instance_info_cache with network_info: [{"id": "f225adee-9471-44e5-b750-743f1177a159", "address": "fa:16:3e:b9:5c:87", "network": {"id": "4a9b5df8-18d8-4299-ac5b-3437f61d36ce", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1013460700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80815a8259274d9f815b9eb918c090bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf225adee-94", "ovs_interfaceid": "f225adee-9471-44e5-b750-743f1177a159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:05:03 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:05:03 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:05:03 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:05:04 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:05:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:05:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:05:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:05:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:05:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:05:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:05:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:06 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:06 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:05:06 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:05:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8712MB free_disk=25.198986053466797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:05:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:05:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:05:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2325cf86-9132-4b69-8816-699cf95ba206 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:05:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:05:06 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:05:07 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:05:07 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:05:07 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:05:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:05:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:05:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:05:09 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:05:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:05:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:05:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:05:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:05:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG nova.objects.instance [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lazy-loading 'flavor' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:05:26 user nova-compute[72782]: INFO nova.compute.manager [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Attaching volume 5ebb01b4-4ef7-456d-b691-a5f832f1e293 to /dev/vdb
Aug 14 21:05:26 user nova-compute[72782]: DEBUG os_brick.utils [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a044b7b4-3093-40c3-b8ca-3f06c5961ea7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca1951c-a432-43a7-b422-7e3f3cd07d35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eff512c-a2f6-4ae5-bc5e-c665310974e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75d6ac5-e3b0-4401-815a-544ae86c5236]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:05:26 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:05:26 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5e1a7a-b0bd-4bd5-8701-5fdde743ba8b]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG os_brick.utils [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:05:26 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updating existing volume attachment record: 04d09452-7fe2-4408-a66e-b27a9274eb39 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:05:29 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:05:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXFqseIS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:05:34 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:05:34 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:05:34 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeeeaef7-8033-409f-9e71-a0ab4c8d13ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:05:34 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1a2042-5013-4796-98d0-f39cd4b5ea15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293] added
Aug 14 21:05:34 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6edafe9-b277-4459-8058-58662b1957b6]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f540017-4bfc-4c61-a776-631b89fd19e6]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aXFqseIS {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aXFqseIS" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[574421fa-58be-476c-baf9-a713dfefd994]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aXFqseIS'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8a67fb-4242-400d-a2ed-6ee516f81d31]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4fce87-3d89-4991-9d0e-a6f3ae0a630f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 21:05:34 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 21:05:34 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:05:34 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 21:05:34 user nova-compute[72782]: 
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6b7b6f-bc19-4381-89c0-27e469cc4984]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293, portal: 172.16.0.220,3260]
Aug 14 21:05:34 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293, portal: 172.16.0.220,3260] successful.
Aug 14 21:05:34 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3618a80f-b736-41ed-a59c-260b39c385ec]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee251e76-d3ec-4136-b658-65c48f2f62cb]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 (non-flash)
Aug 14 21:05:34 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 (non-flash)
Aug 14 21:05:34 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:05:34 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:35 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:35 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[53535f38-ae5d-478a-9329-07c1e99821ea]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:35 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:05:35 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXFqseIS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:05:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:05:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:05:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:05:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:05:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:05:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:05:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:05:36 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26639323065666532', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:05:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639323065666532', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:05:36 user nova-compute[72782]: DEBUG nova.objects.instance [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lazy-loading 'flavor' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:05:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:05:36 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:05:36 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 21:05:36 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:05:36 user nova-compute[72782]:   <serial>5ebb01b4-4ef7-456d-b691-a5f832f1e293</serial>
Aug 14 21:05:36 user nova-compute[72782]: </disk>
Aug 14 21:05:36 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:05:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:05:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:05:36 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] No VIF found with MAC fa:16:3e:b9:5c:87, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:05:36 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-37627505-d004-4d73-95a6-cf973ecb8b18 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.204s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:05:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:05:38 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:05:38 user nova-compute[72782]: INFO nova.compute.manager [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Detaching volume 5ebb01b4-4ef7-456d-b691-a5f832f1e293
Aug 14 21:05:38 user nova-compute[72782]: INFO nova.virt.block_device [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Attempting to driver detach volume 5ebb01b4-4ef7-456d-b691-a5f832f1e293 from mountpoint /dev/vdb
Aug 14 21:05:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Attempting to detach device vdb from instance 2325cf86-9132-4b69-8816-699cf95ba206 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:05:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:05:38 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:05:38 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 21:05:38 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:05:38 user nova-compute[72782]:   <serial>5ebb01b4-4ef7-456d-b691-a5f832f1e293</serial>
Aug 14 21:05:38 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:05:38 user nova-compute[72782]: </disk>
Aug 14 21:05:38 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:05:38 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Successfully detached device vdb from instance 2325cf86-9132-4b69-8816-699cf95ba206 from the persistent domain config.
Aug 14 21:05:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2325cf86-9132-4b69-8816-699cf95ba206 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:05:38 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:05:38 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:05:38 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 21:05:38 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:05:38 user nova-compute[72782]:   <serial>5ebb01b4-4ef7-456d-b691-a5f832f1e293</serial>
Aug 14 21:05:38 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:05:38 user nova-compute[72782]: </disk>
Aug 14 21:05:38 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692047139.0909185, 2325cf86-9132-4b69-8816-699cf95ba206 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:05:39 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Successfully detached device vdb from instance 2325cf86-9132-4b69-8816-699cf95ba206 from the live domain config.
Aug 14 21:05:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aXFqseIS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:05:39 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:05:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[940676d8-e056-4404-97ce-2be7e4ecd4b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[61636a2b-b29b-4f73-9212-065d70c58593]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 (non-flash)
Aug 14 21:05:39 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 (non-flash)
Aug 14 21:05:39 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f64084829e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[743f589b-dc4f-4e25-bd78-739774f447e6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3b56a3-83e2-4693-91c1-633853be1bb9]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[598b1d57-0b65-4946-8b7c-b3f362fab5b2]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[df14aece-2e96-4713-b458-1058dce574dd]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b89270d-a80b-4e5b-b037-07379ddca36a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a214f03c-61e1-431b-a0ff-2e09b1e9b184]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293, portal: 172.16.0.220,3260]
Aug 14 21:05:39 user nova-compute[72782]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293, portal: 172.16.0.220,3260] successful.
Aug 14 21:05:39 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ebb01b4-4ef7-456d-b691-a5f832f1e293 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd554464-7d37-490d-bf4b-1fb7d481068f]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] <== disconnect_volume: return (263ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:05:39 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:05:40 user nova-compute[72782]: DEBUG nova.objects.instance [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lazy-loading 'flavor' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:05:40 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-4089550f-a43f-4183-9abf-351f04a3bccd tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.593s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:05:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:05:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:05:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:05:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:05:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:05:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:05:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:05:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:05:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:05:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:05:58 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:06:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:06:04 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:06:04 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:06:04 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 21:06:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:06:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:06:04 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:06:04 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:06:04 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updating instance_info_cache with network_info: [{"id": "f225adee-9471-44e5-b750-743f1177a159", "address": "fa:16:3e:b9:5c:87", "network": {"id": "4a9b5df8-18d8-4299-ac5b-3437f61d36ce", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1013460700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80815a8259274d9f815b9eb918c090bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf225adee-94", "ovs_interfaceid": "f225adee-9471-44e5-b750-743f1177a159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:06:04 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:06:04 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:06:04 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:06:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:06:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:06:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:06:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:06:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:06:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:06:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:06:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:08 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:06:08 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:06:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8716MB free_disk=25.197948455810547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:06:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:06:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:06:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2325cf86-9132-4b69-8816-699cf95ba206 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:06:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:06:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:06:09 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:06:09 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:06:09 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:06:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:06:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:06:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:06:10 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:06:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:06:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:06:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:06:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:06:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:06:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:06:12 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:06:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:06:16 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:06:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:06:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:06:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG nova.objects.instance [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lazy-loading 'flavor' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:06:32 user nova-compute[72782]: INFO nova.compute.manager [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Attaching volume 0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 to /dev/vdb
Aug 14 21:06:32 user nova-compute[72782]: DEBUG os_brick.utils [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f40214-3549-4bef-bb6a-b9ee5e8bcdf0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a9e617-b8ee-4549-90ee-80e5012d6d8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc3a5b7-6159-4c9b-8641-17097c37a889]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59d800b-7fee-434c-a290-78020350e357]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:06:32 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:06:32 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efd5d6f-9a37-4920-ba27-90c435adaab3]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG os_brick.utils [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:06:32 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updating existing volume attachment record: 8713f312-db8e-4d01-af86-64f9fe340297 {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:06:34 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:06:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oaCWjYMd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:06:40 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:06:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:06:40 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:06:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:06:40 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:06:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc13f519-0170-4182-b371-c65bbe1bdf33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:06:40 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ac7f1c-ae21-4fd7-b591-1d2cb8a257ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9] added
Aug 14 21:06:40 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e16c67-1331-4c2e-910a-13634a82a16e]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[666233bc-ccf1-4e8e-b671-ba80f6d11eba]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oaCWjYMd {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oaCWjYMd" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2445fb6a-7546-4c86-ad8c-4a5ae678892c]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oaCWjYMd'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:06:40 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[b719553a-7383-432b-a1e1-5006c0bacd4d]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bf7f19-1c66-4358-b0d6-f52bdff825eb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 21:06:41 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 21:06:41 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:06:41 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 21:06:41 user nova-compute[72782]: 
Aug 14 21:06:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeca788-44bb-4a24-bee6-3b11b6696293]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9, portal: 172.16.0.220,3260]
Aug 14 21:06:41 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9, portal: 172.16.0.220,3260] successful.
Aug 14 21:06:41 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[78040a12-3069-480d-9c39-2fd2f4270883]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a29505f-97b5-4a25-b44d-1fb1a498d702]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 (non-flash)
Aug 14 21:06:41 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 (non-flash)
Aug 14 21:06:41 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab9cc94-2714-4412-a3c1-3f9d763575b9]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:41 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:06:42 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:06:42 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oaCWjYMd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:06:42 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:06:42 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23461343733306539', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:06:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461343733306539', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:06:42 user nova-compute[72782]: DEBUG nova.objects.instance [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lazy-loading 'flavor' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:06:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:06:42 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:06:42 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 21:06:42 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:06:42 user nova-compute[72782]:   <serial>0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9</serial>
Aug 14 21:06:42 user nova-compute[72782]: </disk>
Aug 14 21:06:42 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:06:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:06:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:06:42 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] No VIF found with MAC fa:16:3e:b9:5c:87, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:06:42 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-094ddf66-2072-4fc0-848d-1db50d5b4379 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.930s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:06:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:06:45 user nova-compute[72782]: INFO nova.compute.manager [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Detaching volume 0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9
Aug 14 21:06:45 user nova-compute[72782]: INFO nova.virt.block_device [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Attempting to driver detach volume 0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 from mountpoint /dev/vdb
Aug 14 21:06:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Attempting to detach device vdb from instance 2325cf86-9132-4b69-8816-699cf95ba206 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:06:45 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:06:45 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 21:06:45 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:06:45 user nova-compute[72782]:   <serial>0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9</serial>
Aug 14 21:06:45 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:06:45 user nova-compute[72782]: </disk>
Aug 14 21:06:45 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:06:45 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Successfully detached device vdb from instance 2325cf86-9132-4b69-8816-699cf95ba206 from the persistent domain config.
Aug 14 21:06:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2325cf86-9132-4b69-8816-699cf95ba206 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:06:45 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:06:45 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 21:06:45 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:06:45 user nova-compute[72782]:   <serial>0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9</serial>
Aug 14 21:06:45 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:06:45 user nova-compute[72782]: </disk>
Aug 14 21:06:45 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692047205.6473489, 2325cf86-9132-4b69-8816-699cf95ba206 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:06:45 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Successfully detached device vdb from instance 2325cf86-9132-4b69-8816-699cf95ba206 from the live domain config.
Aug 14 21:06:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oaCWjYMd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:06:45 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:06:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f836db6-f4b8-4974-9e28-c71498b83548]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1c12b5-79f9-433c-a695-7a0da5908550]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 (non-flash)
Aug 14 21:06:45 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 (non-flash)
Aug 14 21:06:45 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f63e8461fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0be5c6-c587-4dcb-9549-045aaf57438d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fe9352-9431-4e62-a84b-55911893d723]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e4d9d9-3554-4523-850e-1c6309e8625e]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e945a8-c554-4ef3-a537-820baee31adc]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f25c3b3-bcd5-426b-9e4c-64547b866e54]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16ac8ec-f7d7-4b47-a757-d35053d79bdb]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9, portal: 172.16.0.220,3260]
Aug 14 21:06:45 user nova-compute[72782]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9, portal: 172.16.0.220,3260] successful.
Aug 14 21:06:45 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c6a2f2f-b55c-4fb1-9f36-1c97ea8c8ef9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9225b7-986c-4872-93bf-cc1db3ead6c3]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] <== disconnect_volume: return (264ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:06:45 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:06:46 user nova-compute[72782]: DEBUG nova.objects.instance [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lazy-loading 'flavor' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:06:46 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-dda1d319-7ca8-4fd3-aeb6-6183a4307013 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.561s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:06:49 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:06:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:06:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:06:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:06:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:07:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:07:05 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:07:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:07:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:07:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:07:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 21:07:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:07:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:07:06 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:07:06 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:07:06 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updating instance_info_cache with network_info: [{"id": "f225adee-9471-44e5-b750-743f1177a159", "address": "fa:16:3e:b9:5c:87", "network": {"id": "4a9b5df8-18d8-4299-ac5b-3437f61d36ce", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1013460700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80815a8259274d9f815b9eb918c090bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf225adee-94", "ovs_interfaceid": "f225adee-9471-44e5-b750-743f1177a159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:07:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:07:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:07:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:07:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:07:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:07:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:07:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:07:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:07:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:08 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:08 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:07:08 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:07:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8717MB free_disk=25.197010040283203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:07:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:07:08 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:07:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2325cf86-9132-4b69-8816-699cf95ba206 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:07:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:07:08 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:07:08 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing inventories for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 21:07:08 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating ProviderTree inventory for provider d26c9e3b-40e6-476e-9664-3119ebf5873b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 21:07:08 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Updating inventory in ProviderTree for provider d26c9e3b-40e6-476e-9664-3119ebf5873b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 21:07:09 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing aggregate associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, aggregates: None {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 21:07:09 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Refreshing trait associations for resource provider d26c9e3b-40e6-476e-9664-3119ebf5873b, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NODE,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=72782) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 21:07:09 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:07:09 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:07:09 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:07:09 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:07:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:07:11 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:07:11 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:07:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:07:12 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:07:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:07:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:07:25 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:07:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:07:28 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:07:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 21:07:28 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] There are 0 instances to clean {{(pid=72782) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 21:07:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:07:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG nova.objects.instance [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lazy-loading 'flavor' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:07:39 user nova-compute[72782]: INFO nova.compute.manager [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Attaching volume d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 to /dev/vdb
Aug 14 21:07:39 user nova-compute[72782]: DEBUG os_brick.utils [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e65e8a1-d267-40ad-9eb2-71b16827e4d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3aa894d56736\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33f1638-c7e4-4a92-9ef6-7ba0a3b1ff2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1c0134-ad50-4f45-bf74-a0c43c3dd47c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[825c253a-53ed-4509-ac31-42f9c0edd30b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Running cmd (subprocess): nvme version {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] 'nvme version' failed. Not Retrying. {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] nvme not present on system {{(pid=72782) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 21:07:39 user nova-compute[72782]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 21:07:39 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeee5046-015f-4d83-9998-39267ca22d6c]: (4, '') {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72782) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.lightos [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] LIGHTOS: no hostnqn found. {{(pid=72782) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG os_brick.utils [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3aa894d56736', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:07:39 user nova-compute[72782]: DEBUG nova.virt.block_device [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updating existing volume attachment record: f6b554d0-2720-4267-bfec-1c6d9706e01c {{(pid=72782) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 21:07:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:07:44 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:07:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Calling os-brick to attach iSCSI Volume {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXdOfVYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:07:48 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:07:48 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:07:48 user nova-compute[72782]: INFO os_brick.initiator.connectors.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f07d78a-71a8-452e-9b2f-27ae75ae9abc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 21:07:48 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d286f9-9588-4938-9623-4b102e1ea7c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0] added\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0] added
Aug 14 21:07:48 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd2ac73-7651-487c-ba71-4112998bfe75]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[787c9670-e88e-452d-9d3f-109b53a4a66e]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QXdOfVYS {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QXdOfVYS" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fa0eda-45a3-4ed7-94c1-3ddb0f99fdc4]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QXdOfVYS'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1b99de-0358-449c-90f3-e49c94805fd0]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a8c2a7-7a71-4192-94ba-9dab454cdada]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 21:07:48 user nova-compute[72782]:  {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 21:07:48 user nova-compute[72782]:  {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:07:48 user nova-compute[72782]: WARNING os_brick.initiator.connectors.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 21:07:48 user nova-compute[72782]: 
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --login {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d55afb1-2d57-4391-a4cf-493b49136023]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0, portal: 172.16.0.220,3260]
Aug 14 21:07:48 user nova-compute[72782]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0, portal: 172.16.0.220,3260] successful.
Aug 14 21:07:48 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e34a88b-034d-41b8-833b-819a489ab9f9]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc04ca6f-7445-4783-90c1-4d230d6885cd]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 (non-flash)
Aug 14 21:07:48 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 (non-flash)
Aug 14 21:07:48 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Connected to 172.16.0.220:3260 {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=72782) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72782) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4518d3dc-eb43-414e-9f1b-4ba85e10e6d4]: (4, ('- - 0', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72782) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 21:07:48 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXdOfVYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72782) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 21:07:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:07:49 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23030373436643436', 'path': '/dev/sdb'} {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:07:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030373436643436', 'path': '/dev/sdb'} {{(pid=72782) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 21:07:49 user nova-compute[72782]: DEBUG nova.objects.instance [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lazy-loading 'flavor' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:07:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 21:07:49 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:07:49 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 21:07:49 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:07:49 user nova-compute[72782]:   <serial>d1a32e62-7f9f-4b67-82c3-caee07fe0bf0</serial>
Aug 14 21:07:49 user nova-compute[72782]: </disk>
Aug 14 21:07:49 user nova-compute[72782]:  {{(pid=72782) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 21:07:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] No BDM found with device name vda, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:07:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72782) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 21:07:49 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] No VIF found with MAC fa:16:3e:b9:5c:87, not building metadata {{(pid=72782) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 21:07:50 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-dc79b007-641d-42a6-a811-d0b73993a971 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.479s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:07:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:07:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:07:51 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:07:51 user nova-compute[72782]: INFO nova.compute.manager [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Detaching volume d1a32e62-7f9f-4b67-82c3-caee07fe0bf0
Aug 14 21:07:52 user nova-compute[72782]: INFO nova.virt.block_device [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Attempting to driver detach volume d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 from mountpoint /dev/vdb
Aug 14 21:07:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Attempting to detach device vdb from instance 2325cf86-9132-4b69-8816-699cf95ba206 from the persistent domain config. {{(pid=72782) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:07:52 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:07:52 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 21:07:52 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:07:52 user nova-compute[72782]:   <serial>d1a32e62-7f9f-4b67-82c3-caee07fe0bf0</serial>
Aug 14 21:07:52 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:07:52 user nova-compute[72782]: </disk>
Aug 14 21:07:52 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:07:52 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Successfully detached device vdb from instance 2325cf86-9132-4b69-8816-699cf95ba206 from the persistent domain config.
Aug 14 21:07:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2325cf86-9132-4b69-8816-699cf95ba206 from the live domain config. {{(pid=72782) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.guest [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 21:07:52 user nova-compute[72782]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 21:07:52 user nova-compute[72782]:   <source dev="/dev/sdb"/>
Aug 14 21:07:52 user nova-compute[72782]:   <target dev="vdb" bus="virtio"/>
Aug 14 21:07:52 user nova-compute[72782]:   <serial>d1a32e62-7f9f-4b67-82c3-caee07fe0bf0</serial>
Aug 14 21:07:52 user nova-compute[72782]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 21:07:52 user nova-compute[72782]: </disk>
Aug 14 21:07:52 user nova-compute[72782]:  {{(pid=72782) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-21e3d43e-40af-4b86-9655-21fd62cef579 None None] Received event <DeviceRemovedEvent: 1692047272.4983542, 2325cf86-9132-4b69-8816-699cf95ba206 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72782) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.driver [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 21:07:52 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Successfully detached device vdb from instance 2325cf86-9132-4b69-8816-699cf95ba206 from the live domain config.
Aug 14 21:07:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] calling os-brick to detach iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6408488c40>, {'target_iqns': ['iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXdOfVYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 21:07:52 user nova-compute[72782]: WARNING os_brick.initiator.connectors.base [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 21:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0', 0)] {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1f2cf5-bdb3-4d5d-bc55-88b2479fb927]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5617f8-f9d7-45de-9b5d-0be037d20305]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 (non-flash)\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 (non-flash)
Aug 14 21:07:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 (non-flash)
Aug 14 21:07:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f64085b5ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0'): ({'sdb'}, set())}) {{(pid=72782) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Removing single pathed devices sdb {{(pid=72782) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f3063b-9a50-44f3-b11c-29bef6fc7f00]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4bdcf7-75ac-45b1-ad80-d2e86fb02597]: (4, ('ok\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Flushing IO for device /dev/sdb {{(pid=72782) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e67789-9345-4104-91e6-efd8d810685a]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72782) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e997155-3bde-4eb2-8cbb-b2bfc55b44e9]: (4, ('1', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.linuxscsi [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] SCSI volumes sdb have been removed. {{(pid=72782) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0')] {{(pid=72782) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faf46f5-a7c5-4e75-8698-e7d8aa20c2d2]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --logout {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be378d1-0128-4063-90e2-8cb42dacb183]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0, portal: 172.16.0.220,3260]
Aug 14 21:07:52 user nova-compute[72782]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0, portal: 172.16.0.220,3260] successful.
Aug 14 21:07:52 user nova-compute[72782]:  stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --op delete {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1a32e62-7f9f-4b67-82c3-caee07fe0bf0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG oslo.privsep.daemon [-] privsep: reply[011d176b-cefe-40fc-9eca-3e42f1ec23b9]: (4, ('', '')) {{(pid=83776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72782) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.base [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] <== disconnect_volume: return (269ms) None {{(pid=72782) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 21:07:52 user nova-compute[72782]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Disconnected iSCSI Volume {{(pid=72782) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 21:07:53 user nova-compute[72782]: DEBUG nova.objects.instance [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lazy-loading 'flavor' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:07:53 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-f28ee38e-42fc-48ba-842d-555f75d5b0b2 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.638s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:07:54 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:07:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:07:59 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:08:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:08:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:08:05 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:08:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:08:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:08:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:08:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:08:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:08:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:08:06 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:08:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:08:06 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 21:08:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:08:06 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:08:06 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:08:06 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:08:07 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updating instance_info_cache with network_info: [{"id": "f225adee-9471-44e5-b750-743f1177a159", "address": "fa:16:3e:b9:5c:87", "network": {"id": "4a9b5df8-18d8-4299-ac5b-3437f61d36ce", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1013460700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80815a8259274d9f815b9eb918c090bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf225adee-94", "ovs_interfaceid": "f225adee-9471-44e5-b750-743f1177a159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:08:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:08:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:08:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:08:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:08:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:08:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:08:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:08:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:08:10 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:08:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:08:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:08:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:08:10 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:08:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:08:10 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:08:10 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:08:10 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8714MB free_disk=25.195999145507812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:08:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:08:10 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:08:10 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2325cf86-9132-4b69-8816-699cf95ba206 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:08:10 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:08:10 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:08:11 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:08:11 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:08:11 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:08:11 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:08:11 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:08:11 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72782) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 21:08:13 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:08:13 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:08:13 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:08:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:08:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:08:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:08:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:08:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:08:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:08:16 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:08:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:08:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:08:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:08:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:08:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:08:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:08:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:08:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:08:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:08:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:08:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:08:25 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:08:30 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:08:35 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:08:40 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:08:45 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:08:50 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:08:55 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:09:00 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:09:01 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:09:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:09:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:09:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:09:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:09:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:09:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:09:05 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:09:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:09:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:09:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 21:09:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 21:09:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquired lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 21:09:07 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Forcefully refreshing network info cache for instance {{(pid=72782) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 21:09:07 user nova-compute[72782]: DEBUG nova.objects.instance [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lazy-loading 'info_cache' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:09:07 user nova-compute[72782]: DEBUG nova.network.neutron [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updating instance_info_cache with network_info: [{"id": "f225adee-9471-44e5-b750-743f1177a159", "address": "fa:16:3e:b9:5c:87", "network": {"id": "4a9b5df8-18d8-4299-ac5b-3437f61d36ce", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1013460700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80815a8259274d9f815b9eb918c090bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf225adee-94", "ovs_interfaceid": "f225adee-9471-44e5-b750-743f1177a159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:09:07 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Releasing lock "refresh_cache-2325cf86-9132-4b69-8816-699cf95ba206" {{(pid=72782) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 21:09:07 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updated the network info_cache for instance {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 21:09:07 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:09:09 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:09:10 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:09:10 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:09:12 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:09:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:09:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:09:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:09:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:09:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:09:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:09:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 21:09:12 user nova-compute[72782]: DEBUG oslo_concurrency.processutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72782) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 21:09:12 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:09:12 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:09:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8739MB free_disk=25.19512176513672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:09:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:09:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:09:13 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Instance 2325cf86-9132-4b69-8816-699cf95ba206 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72782) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 21:09:13 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:09:13 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:09:13 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:09:13 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:09:13 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:09:13 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:09:14 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:09:14 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:09:14 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:09:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:09:20 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:09:21 user nova-compute[72782]: INFO nova.compute.manager [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Terminating instance
Aug 14 21:09:21 user nova-compute[72782]: DEBUG nova.compute.manager [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Start destroying the instance on the hypervisor. {{(pid=72782) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-34049768-d741-4543-b131-5d1ff15b77db req-329ff83f-e860-459a-a402-b9539217c67d service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Received event network-vif-unplugged-f225adee-9471-44e5-b750-743f1177a159 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-34049768-d741-4543-b131-5d1ff15b77db req-329ff83f-e860-459a-a402-b9539217c67d service nova] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-34049768-d741-4543-b131-5d1ff15b77db req-329ff83f-e860-459a-a402-b9539217c67d service nova] Lock "2325cf86-9132-4b69-8816-699cf95ba206-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-34049768-d741-4543-b131-5d1ff15b77db req-329ff83f-e860-459a-a402-b9539217c67d service nova] Lock "2325cf86-9132-4b69-8816-699cf95ba206-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-34049768-d741-4543-b131-5d1ff15b77db req-329ff83f-e860-459a-a402-b9539217c67d service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] No waiting events found dispatching network-vif-unplugged-f225adee-9471-44e5-b750-743f1177a159 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG nova.compute.manager [req-34049768-d741-4543-b131-5d1ff15b77db req-329ff83f-e860-459a-a402-b9539217c67d service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Received event network-vif-unplugged-f225adee-9471-44e5-b750-743f1177a159 for instance with task_state deleting. {{(pid=72782) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:09:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [-] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Instance destroyed successfully.
Aug 14 21:09:21 user nova-compute[72782]: DEBUG nova.objects.instance [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lazy-loading 'resources' on Instance uuid 2325cf86-9132-4b69-8816-699cf95ba206 {{(pid=72782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG nova.virt.libvirt.vif [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T21:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-847184248',display_name='tempest-SnapshotDataIntegrityTests-server-847184248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-847184248',id=53,image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTnt29l2LloOWBXVY79reemM1EI7siBNX7cJDeJ9p0o9yU+7uZ6mBIN/12bWUPakOdcFmxNkdHBVo9kxXwHhMvsBt8lGudGPbV6rlUdnBNSnUnyiMsZASVU5YMOMB/Ktg==',key_name='tempest-keypair-1528289917',keypairs=<?>,launch_index=0,launched_at=2023-08-14T21:02:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80815a8259274d9f815b9eb918c090bf',ramdisk_id='',reservation_id='r-80rko84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='450d2d82-4a73-4a35-bff3-71ddab4bfe0e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1771369058',owner_user_name='tempest-SnapshotDataIntegrityTests-1771369058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T21:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ace46fe05894914aa69b8f136a95dd7',uuid=2325cf86-9132-4b69-8816-699cf95ba206,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f225adee-9471-44e5-b750-743f1177a159", "address": "fa:16:3e:b9:5c:87", "network": {"id": "4a9b5df8-18d8-4299-ac5b-3437f61d36ce", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1013460700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80815a8259274d9f815b9eb918c090bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf225adee-94", "ovs_interfaceid": "f225adee-9471-44e5-b750-743f1177a159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Converting VIF {"id": "f225adee-9471-44e5-b750-743f1177a159", "address": "fa:16:3e:b9:5c:87", "network": {"id": "4a9b5df8-18d8-4299-ac5b-3437f61d36ce", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1013460700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80815a8259274d9f815b9eb918c090bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf225adee-94", "ovs_interfaceid": "f225adee-9471-44e5-b750-743f1177a159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG nova.network.os_vif_util [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:5c:87,bridge_name='br-int',has_traffic_filtering=True,id=f225adee-9471-44e5-b750-743f1177a159,network=Network(4a9b5df8-18d8-4299-ac5b-3437f61d36ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf225adee-94') {{(pid=72782) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG os_vif [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:5c:87,bridge_name='br-int',has_traffic_filtering=True,id=f225adee-9471-44e5-b750-743f1177a159,network=Network(4a9b5df8-18d8-4299-ac5b-3437f61d36ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf225adee-94') {{(pid=72782) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf225adee-94, bridge=br-int, if_exists=True) {{(pid=72782) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:09:21 user nova-compute[72782]: INFO os_vif [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:5c:87,bridge_name='br-int',has_traffic_filtering=True,id=f225adee-9471-44e5-b750-743f1177a159,network=Network(4a9b5df8-18d8-4299-ac5b-3437f61d36ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf225adee-94')
Aug 14 21:09:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Deleting instance files /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206_del
Aug 14 21:09:21 user nova-compute[72782]: INFO nova.virt.libvirt.driver [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Deletion of /opt/stack/data/nova/instances/2325cf86-9132-4b69-8816-699cf95ba206_del complete
Aug 14 21:09:21 user nova-compute[72782]: INFO nova.compute.manager [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 14 21:09:21 user nova-compute[72782]: DEBUG oslo.service.loopingcall [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72782) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG nova.compute.manager [-] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Deallocating network for instance {{(pid=72782) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 21:09:21 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] deallocate_for_instance() {{(pid=72782) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 21:09:22 user nova-compute[72782]: DEBUG nova.network.neutron [-] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Updating instance_info_cache with network_info: [] {{(pid=72782) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 21:09:22 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Took 0.79 seconds to deallocate network for instance.
Aug 14 21:09:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:09:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:09:22 user nova-compute[72782]: DEBUG nova.compute.manager [req-0b2e92e7-ee48-4a03-8d89-fe294185b875 req-c6a0b4ff-f05e-449f-ad2d-3f8c5916df7b service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Received event network-vif-deleted-f225adee-9471-44e5-b750-743f1177a159 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:09:22 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:09:22 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:09:22 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:09:23 user nova-compute[72782]: INFO nova.scheduler.client.report [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Deleted allocations for instance 2325cf86-9132-4b69-8816-699cf95ba206
Aug 14 21:09:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-8489f451-96b6-4d92-a038-f6c61eb49513 tempest-SnapshotDataIntegrityTests-1771369058 tempest-SnapshotDataIntegrityTests-1771369058-project-member] Lock "2325cf86-9132-4b69-8816-699cf95ba206" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.211s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:09:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-167b8522-f1e0-4a0c-8174-8a57b4df5a60 req-9a365d49-d04b-4a42-ba7a-e36dcfd1034d service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Received event network-vif-plugged-f225adee-9471-44e5-b750-743f1177a159 {{(pid=72782) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 21:09:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-167b8522-f1e0-4a0c-8174-8a57b4df5a60 req-9a365d49-d04b-4a42-ba7a-e36dcfd1034d service nova] Acquiring lock "2325cf86-9132-4b69-8816-699cf95ba206-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:09:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-167b8522-f1e0-4a0c-8174-8a57b4df5a60 req-9a365d49-d04b-4a42-ba7a-e36dcfd1034d service nova] Lock "2325cf86-9132-4b69-8816-699cf95ba206-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:09:23 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [req-167b8522-f1e0-4a0c-8174-8a57b4df5a60 req-9a365d49-d04b-4a42-ba7a-e36dcfd1034d service nova] Lock "2325cf86-9132-4b69-8816-699cf95ba206-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:09:23 user nova-compute[72782]: DEBUG nova.compute.manager [req-167b8522-f1e0-4a0c-8174-8a57b4df5a60 req-9a365d49-d04b-4a42-ba7a-e36dcfd1034d service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] No waiting events found dispatching network-vif-plugged-f225adee-9471-44e5-b750-743f1177a159 {{(pid=72782) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 21:09:23 user nova-compute[72782]: WARNING nova.compute.manager [req-167b8522-f1e0-4a0c-8174-8a57b4df5a60 req-9a365d49-d04b-4a42-ba7a-e36dcfd1034d service nova] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Received unexpected event network-vif-plugged-f225adee-9471-44e5-b750-743f1177a159 for instance with vm_state deleted and task_state None.
Aug 14 21:09:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:09:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:09:36 user nova-compute[72782]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692047361.87643, 2325cf86-9132-4b69-8816-699cf95ba206 => Stopped> {{(pid=72782) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 21:09:36 user nova-compute[72782]: INFO nova.compute.manager [-] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] VM Stopped (Lifecycle Event)
Aug 14 21:09:36 user nova-compute[72782]: DEBUG nova.compute.manager [None req-f664cfa3-494e-41b1-89d2-9cf48909070b None None] [instance: 2325cf86-9132-4b69-8816-699cf95ba206] Checking state {{(pid=72782) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 21:09:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:09:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:09:46 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:09:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:09:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:09:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72782) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 21:09:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:09:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72782) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 21:09:51 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:09:56 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:10:01 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:10:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:10:02 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:10:06 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:10:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:10:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Starting heal instance info cache {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 21:10:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Rebuilding the list of instances to heal {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 21:10:08 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Didn't find any instances for network info cache update. {{(pid=72782) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 21:10:08 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:10:09 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:10:11 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:10:11 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:10:12 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:10:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:10:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:10:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:10:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Auditing locally available compute resources for user (node: user) {{(pid=72782) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 21:10:12 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:10:12 user nova-compute[72782]: WARNING nova.virt.libvirt.driver [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 21:10:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Hypervisor/Node resource view: name=user free_ram=8882MB free_disk=25.222488403320312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72782) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 21:10:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 21:10:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 21:10:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 21:10:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72782) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 21:10:12 user nova-compute[72782]: DEBUG nova.compute.provider_tree [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed in ProviderTree for provider: d26c9e3b-40e6-476e-9664-3119ebf5873b {{(pid=72782) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 21:10:12 user nova-compute[72782]: DEBUG nova.scheduler.client.report [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Inventory has not changed for provider d26c9e3b-40e6-476e-9664-3119ebf5873b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72782) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 21:10:12 user nova-compute[72782]: DEBUG nova.compute.resource_tracker [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Compute_service record updated for user:user {{(pid=72782) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 21:10:12 user nova-compute[72782]: DEBUG oslo_concurrency.lockutils [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=72782) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 21:10:14 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:10:14 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:10:15 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:10:16 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:10:16 user nova-compute[72782]: DEBUG nova.compute.manager [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72782) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 21:10:16 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:10:17 user nova-compute[72782]: DEBUG oslo_service.periodic_task [None req-fb5f4b50-957c-456f-8606-7ad40f2c2957 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72782) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 21:10:19 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:10:21 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:10:26 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:10:31 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 21:10:36 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 21:10:41 user nova-compute[72782]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72782) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}